2024-09-13T17:41:56.928 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T17:41:56.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:41:57.052 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937 branch: wip-rishabh-testing-20240910.100730-reef description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7903937' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync rbytes: false syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzxU5U3HS/+mK8kOPh91slqTZ5XSdtEauJ/l8+UUmYN6z/jXemJFaxf/K581fAd7bbz2007EWRSXHmSEuONn6A= smithi122.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGcGo2a1aOwwg6Ta3sdXathdlRPRt90Mnxt+Ngh99zNp4Puzjjnrk0vyr1aVsunSC+7/QqEvilq2nfRysWPvmDU= smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKj7ctVcvTNbIx1OF7dZXsCTPDBP2tgG3YaE5m8iV7la64rVMYli5iVxk81sHwARYcTzObNhmzQUZbERe8eYsfA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T17:41:57.053 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T17:41:57.053 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T17:41:57.054 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T17:41:57.055 INFO:teuthology.task.internal:Checking packages... 2024-09-13T17:41:57.076 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T17:41:57.077 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T17:41:57.077 INFO:teuthology.packaging:ref: None 2024-09-13T17:41:57.077 INFO:teuthology.packaging:tag: None 2024-09-13T17:41:57.077 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:41:57.077 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:41:57.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:41:57.228 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T17:41:57.229 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T17:41:57.235 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T17:41:57.236 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T17:41:57.255 INFO:teuthology.task.internal:Saving configuration 2024-09-13T17:41:57.275 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T17:41:57.281 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T17:41:57.313 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:35:54.412264', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKzxU5U3HS/+mK8kOPh91slqTZ5XSdtEauJ/l8+UUmYN6z/jXemJFaxf/K581fAd7bbz2007EWRSXHmSEuONn6A='} 2024-09-13T17:41:57.345 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi122.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:35:54.410735', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGcGo2a1aOwwg6Ta3sdXathdlRPRt90Mnxt+Ngh99zNp4Puzjjnrk0vyr1aVsunSC+7/QqEvilq2nfRysWPvmDU='} 2024-09-13T17:41:57.375 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:35:54.413646', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKj7ctVcvTNbIx1OF7dZXsCTPDBP2tgG3YaE5m8iV7la64rVMYli5iVxk81sHwARYcTzObNhmzQUZbERe8eYsfA='} 2024-09-13T17:41:57.376 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T17:41:57.382 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-13T17:41:57.382 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-13T17:41:57.382 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-13T17:41:57.382 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T17:41:57.493 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7d0209c3a0>, signals=[15]) 2024-09-13T17:41:57.493 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T17:41:57.499 INFO:teuthology.task.internal:Opening connections... 2024-09-13T17:41:57.499 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2024-09-13T17:41:57.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:41:57.585 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi122.front.sepia.ceph.com 2024-09-13T17:41:57.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:41:57.670 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi143.front.sepia.ceph.com 2024-09-13T17:41:57.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:41:57.760 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T17:41:57.768 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2024-09-13T17:41:57.787 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2024-09-13T17:41:57.788 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2024-09-13T17:41:57.847 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2024-09-13T17:41:57.847 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2024-09-13T17:41:57.847 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2024-09-13T17:41:57.847 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2024-09-13T17:41:57.847 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2024-09-13T17:41:57.848 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2024-09-13T17:41:57.848 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T17:41:57.848 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2024-09-13T17:41:57.848 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2024-09-13T17:41:57.848 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T17:41:57.848 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2024-09-13T17:41:57.848 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T17:41:57.848 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T17:41:57.848 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T17:41:57.849 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2024-09-13T17:41:57.880 DEBUG:teuthology.orchestra.run.smithi122:> uname -m 2024-09-13T17:41:57.898 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2024-09-13T17:41:57.898 DEBUG:teuthology.orchestra.run.smithi122:> cat /etc/os-release 2024-09-13T17:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2024-09-13T17:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="9" 2024-09-13T17:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2024-09-13T17:41:57.956 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2024-09-13T17:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="9" 2024-09-13T17:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el9" 2024-09-13T17:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T17:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2024-09-13T17:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout:LOGO="fedora-logo-icon" 2024-09-13T17:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T17:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2024-09-13T17:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T17:41:57.957 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T17:41:57.958 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T17:41:57.958 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2024-09-13T17:41:57.988 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2024-09-13T17:41:58.006 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2024-09-13T17:41:58.007 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2024-09-13T17:41:58.065 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2024-09-13T17:41:58.066 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="9" 2024-09-13T17:41:58.066 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2024-09-13T17:41:58.066 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2024-09-13T17:41:58.066 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="9" 2024-09-13T17:41:58.066 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el9" 2024-09-13T17:41:58.066 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T17:41:58.066 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2024-09-13T17:41:58.066 INFO:teuthology.orchestra.run.smithi143.stdout:LOGO="fedora-logo-icon" 2024-09-13T17:41:58.067 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T17:41:58.067 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2024-09-13T17:41:58.067 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T17:41:58.067 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T17:41:58.067 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T17:41:58.067 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2024-09-13T17:41:58.104 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T17:41:58.115 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T17:41:58.121 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T17:41:58.121 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:41:58.126 DEBUG:teuthology.orchestra.run.smithi122:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:41:58.129 DEBUG:teuthology.orchestra.run.smithi143:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:41:58.146 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T17:41:58.152 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T17:41:58.152 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:41:58.185 DEBUG:teuthology.orchestra.run.smithi122:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:41:58.187 DEBUG:teuthology.orchestra.run.smithi143:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:41:58.296 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T17:41:58.402 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T17:41:58.416 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T17:41:58.417 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-13T17:41:58.417 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-13T17:41:58.417 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:41:58.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:41:58.436 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T17:41:58.609 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:41:58.609 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T17:41:58.609 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-09-13T17:41:58.628 INFO:teuthology.orchestra.run.smithi027.stdout:5.14.0-503.el9.x86_64 2024-09-13T17:41:58.629 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:41:58.629 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T17:41:58.629 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum upgrade -y linux-firmware 2024-09-13T17:42:03.158 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.2 MB 00:02 2024-09-13T17:42:05.384 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-13T17:42:10.318 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.5 MB 00:00 2024-09-13T17:42:11.777 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-13T17:42:12.847 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-13T17:42:18.478 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T17:42:20.644 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-13T17:42:20.645 INFO:teuthology.orchestra.run.smithi027.stdout:Nothing to do. 2024-09-13T17:42:20.645 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-13T17:42:20.764 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T17:42:20.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T17:42:20.917 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T17:42:20.917 DEBUG:teuthology.orchestra.run.smithi027:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T17:42:20.920 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi027.front.sepia.ceph.com to complete... 2024-09-13T17:42:27.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13 17:42:27 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T17:42:27.240 INFO:teuthology.orchestra.run.smithi027.stderr:FINISHED --2024-09-13 17:42:27-- 2024-09-13T17:42:27.240 INFO:teuthology.orchestra.run.smithi027.stderr:Total wall clock time: 6.3s 2024-09-13T17:42:27.240 INFO:teuthology.orchestra.run.smithi027.stderr:Downloaded: 1 files, 343M in 6.0s (57.1 MB/s) 2024-09-13T17:42:27.243 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T17:42:27.243 DEBUG:teuthology.orchestra.run.smithi027:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T17:42:29.444 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying... ######################################## 2024-09-13T17:42:29.601 INFO:teuthology.orchestra.run.smithi027.stdout:Preparing... ######################################## 2024-09-13T17:42:29.738 INFO:teuthology.orchestra.run.smithi027.stdout:Updating / installing... 2024-09-13T17:42:38.077 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T17:43:18.545 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi027.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T17:43:18.545 DEBUG:teuthology.orchestra.run.smithi027:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T17:43:18.639 INFO:teuthology.orchestra.run.smithi027.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:43:18.639 INFO:teuthology.orchestra.run.smithi027.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:43:18.639 INFO:teuthology.orchestra.run.smithi027.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:43:18.639 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T17:43:18.640 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T17:43:18.641 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T17:43:18.642 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T17:43:18.643 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T17:43:18.644 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T17:43:18.645 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T17:43:18.646 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T17:43:18.647 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T17:43:18.648 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T17:43:18.649 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T17:43:18.650 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T17:43:18.651 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T17:43:18.652 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T17:43:18.653 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T17:43:18.654 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T17:43:18.655 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T17:43:18.656 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T17:43:18.657 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T17:43:18.658 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T17:43:18.659 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T17:43:18.660 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T17:43:18.661 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T17:43:18.662 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T17:43:18.663 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T17:43:18.664 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T17:43:18.665 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T17:43:18.665 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T17:43:18.665 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T17:43:18.665 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T17:43:18.665 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T17:43:18.665 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T17:43:18.665 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T17:43:18.668 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T17:43:18.668 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T17:43:18.668 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T17:43:18.668 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T17:43:18.668 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T17:43:18.668 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T17:43:18.668 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T17:43:18.668 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T17:43:18.669 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T17:43:18.670 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T17:43:18.671 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T17:43:18.672 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T17:43:18.673 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T17:43:18.674 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T17:43:18.675 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T17:43:18.676 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T17:43:18.677 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T17:43:18.678 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T17:43:18.679 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T17:43:18.680 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T17:43:18.681 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T17:43:18.682 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T17:43:18.683 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T17:43:18.684 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T17:43:18.685 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T17:43:18.686 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T17:43:18.687 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T17:43:18.688 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T17:43:18.689 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T17:43:18.690 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T17:43:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T17:43:18.692 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T17:43:18.693 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T17:43:18.694 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T17:43:18.695 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T17:43:18.696 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T17:43:18.697 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T17:43:18.698 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T17:43:18.699 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T17:43:18.700 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T17:43:18.701 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T17:43:18.702 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T17:43:18.703 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T17:43:18.704 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T17:43:18.705 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T17:43:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T17:43:18.707 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T17:43:18.708 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T17:43:18.709 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T17:43:18.710 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T17:43:18.711 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T17:43:18.712 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T17:43:18.713 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T17:43:18.714 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T17:43:18.715 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T17:43:18.716 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T17:43:18.717 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T17:43:18.718 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T17:43:18.719 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T17:43:18.720 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T17:43:18.721 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T17:43:18.722 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T17:43:18.723 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T17:43:18.724 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T17:43:18.725 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T17:43:18.726 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T17:43:18.727 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T17:43:18.728 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T17:43:18.729 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T17:43:18.730 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T17:43:18.731 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T17:43:18.732 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T17:43:18.733 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T17:43:18.734 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T17:43:18.735 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T17:43:18.736 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T17:43:18.737 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T17:43:18.738 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T17:43:18.739 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T17:43:18.740 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T17:43:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T17:43:18.742 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T17:43:18.743 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T17:43:18.744 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T17:43:18.745 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T17:43:18.746 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T17:43:18.747 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T17:43:18.748 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T17:43:18.749 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T17:43:18.750 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T17:43:18.751 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T17:43:18.752 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T17:43:18.753 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T17:43:18.754 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T17:43:18.755 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T17:43:18.756 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T17:43:18.757 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T17:43:18.758 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T17:43:18.759 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T17:43:18.760 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T17:43:18.761 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T17:43:18.762 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T17:43:18.763 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T17:43:18.764 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T17:43:18.765 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T17:43:18.766 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T17:43:18.767 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T17:43:18.768 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T17:43:18.769 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T17:43:18.770 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T17:43:18.771 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T17:43:18.772 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T17:43:18.773 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T17:43:18.774 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T17:43:18.775 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T17:43:18.776 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T17:43:18.777 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T17:43:18.778 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T17:43:18.779 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T17:43:18.780 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T17:43:18.781 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T17:43:18.782 INFO:teuthology.orchestra.run.smithi027.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T17:43:18.786 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:43:18.787 DEBUG:teuthology.orchestra.run.smithi027:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T17:43:18.813 INFO:teuthology.orchestra.run.smithi027.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T17:43:18.813 INFO:teuthology.orchestra.run.smithi027.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T17:43:18.813 INFO:teuthology.orchestra.run.smithi027.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T17:43:18.813 INFO:teuthology.orchestra.run.smithi027.stdout:fi 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout:for file in vmlinuz System.map config; do 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout: fi 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout:done 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout:fi 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout:fi 2024-09-13T17:43:18.814 INFO:teuthology.orchestra.run.smithi027.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T17:43:18.815 INFO:teuthology.orchestra.run.smithi027.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T17:43:18.815 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:43:18.815 INFO:teuthology.orchestra.run.smithi027.stdout:fi 2024-09-13T17:43:18.816 DEBUG:teuthology.orchestra.run.smithi027:> sudo rpm -qi grub2-tools 2024-09-13T17:43:18.902 INFO:teuthology.orchestra.run.smithi027.stdout:Name : grub2-tools 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Epoch : 1 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Version : 2.06 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Release : 82.el9 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: x86_64 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Group : Unspecified 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Size : 8274670 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:License : GPLv3+ 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T17:43:18.903 INFO:teuthology.orchestra.run.smithi027.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:Packager : builder@centos.org 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:Vendor : CentOS 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:Summary : Support tools for GRUB. 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:Description : 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:hardware devices. 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:43:18.904 INFO:teuthology.orchestra.run.smithi027.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T17:43:18.905 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T17:43:18.905 INFO:teuthology.task.kernel:Updating grub on smithi027 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:43:18.905 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T17:43:19.541 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2024-09-13T17:43:20.929 INFO:teuthology.orchestra.run.smithi027.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T17:43:20.956 INFO:teuthology.orchestra.run.smithi027.stderr:done 2024-09-13T17:43:20.958 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2024-09-13T17:43:20.974 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.tiWX4urfUL 2024-09-13T17:43:20.974 DEBUG:teuthology.orchestra.run.smithi027:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tiWX4urfUL 2024-09-13T17:43:21.042 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.tiWX4urfUL 2024-09-13T17:43:21.182 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.tiWX4urfUL is 6KB 2024-09-13T17:43:21.231 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.tiWX4urfUL 2024-09-13T17:43:21.246 DEBUG:teuthology.orchestra.run.smithi027:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T17:43:21.310 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T17:43:21.310 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T17:43:21.310 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T17:43:21.310 INFO:teuthology.orchestra.run.smithi027.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T17:43:21.311 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:43:21.461 DEBUG:teuthology.orchestra.run.smithi027:> sudo shutdown -r now 2024-09-13T17:43:51.464 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T17:43:51.465 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-13T17:43:51.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:44:09.793 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-13T17:44:18.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-13T17:44:18.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:44:21.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-13T17:44:33.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-13T17:44:33.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:44:36.957 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-13T17:44:51.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-13T17:44:51.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:44:55.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2024-09-13T17:45:13.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-13T17:45:13.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:45:44.845 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-09-13T17:45:45.485 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-13T17:45:45.485 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T17:45:45.485 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2024-09-13T17:45:45.520 INFO:teuthology.orchestra.run.smithi027.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:45:45.521 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T17:45:45.521 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:45:45.521 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T17:45:46.522 DEBUG:teuthology.parallel:result is None 2024-09-13T17:45:46.522 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T17:45:46.532 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T17:45:46.532 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:45:46.536 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:45:46.539 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:45:46.570 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T17:45:46.576 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T17:45:46.585 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T17:45:46.586 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:45:46.615 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:45:46.617 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:45:46.716 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T17:45:46.724 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T17:45:46.724 DEBUG:teuthology.orchestra.run.smithi122:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:45:46.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:45:46.742 DEBUG:teuthology.orchestra.run.smithi143:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:45:46.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:45:46.759 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:45:46.763 DEBUG:teuthology.orchestra.run.smithi122:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:45:46.785 DEBUG:teuthology.orchestra.run.smithi143:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:45:46.828 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:45:46.832 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:45:46.843 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:45:46.849 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:45:46.899 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:45:46.960 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:45:46.964 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T17:45:46.971 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T17:45:46.972 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:45:46.975 DEBUG:teuthology.orchestra.run.smithi122:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:45:46.977 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:45:47.030 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T17:45:47.038 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T17:45:47.039 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:45:47.043 DEBUG:teuthology.orchestra.run.smithi122:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:45:47.047 DEBUG:teuthology.orchestra.run.smithi143:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:45:47.076 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:45:47.190 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:45:47.263 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:45:47.335 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:45:47.401 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:45:47.401 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:45:47.457 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:45:47.505 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:45:47.550 DEBUG:teuthology.orchestra.run.smithi122:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:45:47.638 DEBUG:teuthology.orchestra.run.smithi122:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:45:47.678 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:45:47.679 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:45:47.747 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:45:47.801 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:45:47.847 DEBUG:teuthology.orchestra.run.smithi143:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:45:47.944 DEBUG:teuthology.orchestra.run.smithi143:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:45:47.974 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:45:47.974 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:45:48.041 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2024-09-13T17:45:48.044 DEBUG:teuthology.orchestra.run.smithi122:> sudo service rsyslog restart 2024-09-13T17:45:48.047 DEBUG:teuthology.orchestra.run.smithi143:> sudo service rsyslog restart 2024-09-13T17:45:48.090 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:45:48.113 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:45:48.152 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T17:45:48.615 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T17:45:48.622 INFO:teuthology.task.internal:Starting timer... 2024-09-13T17:45:48.622 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T17:45:48.632 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T17:45:48.645 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-13T17:45:48.645 DEBUG:teuthology.orchestra.run.smithi027:> sudo service auditd rotate 2024-09-13T17:45:48.746 INFO:teuthology.orchestra.run.smithi027.stdout:Rotating logs: 2024-09-13T17:45:48.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo service auditd rotate 2024-09-13T17:45:48.809 INFO:teuthology.orchestra.run.smithi122.stdout:Rotating logs: 2024-09-13T17:45:48.811 DEBUG:teuthology.orchestra.run.smithi143:> sudo service auditd rotate 2024-09-13T17:45:48.871 INFO:teuthology.orchestra.run.smithi143.stdout:Rotating logs: 2024-09-13T17:45:48.873 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T17:45:48.873 DEBUG:teuthology.orchestra.run.smithi027:> /usr/sbin/getenforce 2024-09-13T17:45:48.911 INFO:teuthology.orchestra.run.smithi027.stdout:Permissive 2024-09-13T17:45:48.912 DEBUG:teuthology.orchestra.run.smithi122:> /usr/sbin/getenforce 2024-09-13T17:45:48.936 INFO:teuthology.orchestra.run.smithi122.stdout:Permissive 2024-09-13T17:45:48.936 DEBUG:teuthology.orchestra.run.smithi143:> /usr/sbin/getenforce 2024-09-13T17:45:48.956 INFO:teuthology.orchestra.run.smithi143.stdout:Permissive 2024-09-13T17:45:48.956 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi027.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi122.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi143.front.sepia.ceph.com': 'permissive'} 2024-09-13T17:45:48.956 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:45:49.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:45:49.014 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:45:49.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:45:49.042 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T17:45:49.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:45:49.068 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T17:45:49.068 DEBUG:teuthology.orchestra.run.smithi027:> sudo /usr/sbin/setenforce permissive 2024-09-13T17:45:49.147 DEBUG:teuthology.orchestra.run.smithi122:> sudo /usr/sbin/setenforce permissive 2024-09-13T17:45:49.178 DEBUG:teuthology.orchestra.run.smithi143:> sudo /usr/sbin/setenforce permissive 2024-09-13T17:45:49.210 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T17:45:49.219 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T17:45:49.229 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T17:45:49.230 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi027.front.sepia.ceph.com,smithi122.front.sepia.ceph.com,smithi143.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T17:50:33.419 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi027.front.sepia.ceph.com'), Remote(name='ubuntu@smithi122.front.sepia.ceph.com'), Remote(name='ubuntu@smithi143.front.sepia.ceph.com')] 2024-09-13T17:50:33.420 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-13T17:50:33.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:50:33.519 DEBUG:teuthology.orchestra.run.smithi027:> true 2024-09-13T17:50:33.644 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2024-09-13T17:50:33.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-13T17:50:33.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi122.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:50:33.728 DEBUG:teuthology.orchestra.run.smithi122:> true 2024-09-13T17:50:33.813 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi122.front.sepia.ceph.com' 2024-09-13T17:50:33.814 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-13T17:50:33.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:50:33.899 DEBUG:teuthology.orchestra.run.smithi143:> true 2024-09-13T17:50:33.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2024-09-13T17:50:33.983 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T17:50:33.995 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T17:50:33.995 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:50:33.996 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:50:34.000 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:50:34.000 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:50:34.002 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T17:50:34.002 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T17:50:34.034 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T17:50:34.050 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T17:50:34.056 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T17:50:34.060 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T17:50:34.072 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T17:50:34.077 INFO:teuthology.orchestra.run.smithi122.stderr:sudo: ntpd: command not found 2024-09-13T17:50:34.089 INFO:teuthology.orchestra.run.smithi122.stdout:506 Cannot talk to daemon 2024-09-13T17:50:34.091 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T17:50:34.098 INFO:teuthology.orchestra.run.smithi143.stderr:sudo: ntpd: command not found 2024-09-13T17:50:34.104 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T17:50:34.112 INFO:teuthology.orchestra.run.smithi143.stdout:506 Cannot talk to daemon 2024-09-13T17:50:34.118 INFO:teuthology.orchestra.run.smithi122.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T17:50:34.127 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T17:50:34.142 INFO:teuthology.orchestra.run.smithi143.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T17:50:34.143 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: ntpd: command not found 2024-09-13T17:50:34.168 INFO:teuthology.orchestra.run.smithi027.stdout:506 Cannot talk to daemon 2024-09-13T17:50:34.175 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:50:34.180 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:50:34.180 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-13T17:50:34.180 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.180 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.180 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.180 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.198 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T17:50:34.199 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:50:34.203 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:50:34.203 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-09-13T17:50:34.203 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.203 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.203 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.203 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.228 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T17:50:34.328 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2024-09-13T17:50:34.336 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T17:50:34.336 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2024-09-13T17:50:34.336 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.336 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.336 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.336 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T17:50:34.337 INFO:teuthology.run_tasks:Running task install... 2024-09-13T17:50:34.346 DEBUG:teuthology.task.install:project ceph 2024-09-13T17:50:34.346 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T17:50:34.346 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T17:50:34.346 INFO:teuthology.task.install:Using flavor: default 2024-09-13T17:50:34.351 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T17:50:34.352 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T17:50:34.352 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T17:50:34.352 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:50:34.354 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T17:50:34.354 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:50:34.355 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T17:50:34.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:50:34.510 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T17:50:34.510 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T17:50:34.521 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T17:50:34.522 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T17:50:34.533 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T17:50:34.533 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T17:50:34.726 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T17:50:34.727 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:50:34.727 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T17:50:34.745 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T17:50:34.745 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:50:34.745 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T17:50:34.763 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T17:50:34.763 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:50:34.763 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T17:50:34.774 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T17:50:34.774 DEBUG:teuthology.orchestra.run.smithi122:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T17:50:34.785 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T17:50:34.785 DEBUG:teuthology.orchestra.run.smithi027:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T17:50:34.789 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T17:50:34.790 DEBUG:teuthology.orchestra.run.smithi143:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T17:50:34.841 DEBUG:teuthology.orchestra.run.smithi122:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T17:50:34.856 DEBUG:teuthology.orchestra.run.smithi143:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T17:50:34.884 DEBUG:teuthology.orchestra.run.smithi027:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T17:50:34.917 DEBUG:teuthology.orchestra.run.smithi122:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T17:50:34.931 DEBUG:teuthology.orchestra.run.smithi143:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T17:50:34.964 DEBUG:teuthology.orchestra.run.smithi027:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T17:50:34.981 INFO:teuthology.orchestra.run.smithi122.stdout:check_obsoletes = 1 2024-09-13T17:50:34.983 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum clean all 2024-09-13T17:50:34.996 INFO:teuthology.orchestra.run.smithi143.stdout:check_obsoletes = 1 2024-09-13T17:50:34.998 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum clean all 2024-09-13T17:50:35.021 INFO:teuthology.orchestra.run.smithi027.stdout:check_obsoletes = 1 2024-09-13T17:50:35.024 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum clean all 2024-09-13T17:50:35.206 INFO:teuthology.orchestra.run.smithi122.stdout:45 files removed 2024-09-13T17:50:35.223 INFO:teuthology.orchestra.run.smithi143.stdout:45 files removed 2024-09-13T17:50:35.233 DEBUG:teuthology.orchestra.run.smithi122:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T17:50:35.250 DEBUG:teuthology.orchestra.run.smithi143:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T17:50:35.298 INFO:teuthology.orchestra.run.smithi027.stdout:45 files removed 2024-09-13T17:50:35.332 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T17:50:35.794 INFO:teuthology.orchestra.run.smithi122.stdout:ceph packages for x86_64 274 kB/s | 78 kB 00:00 2024-09-13T17:50:35.806 INFO:teuthology.orchestra.run.smithi143.stdout:ceph packages for x86_64 278 kB/s | 78 kB 00:00 2024-09-13T17:50:36.069 INFO:teuthology.orchestra.run.smithi122.stdout:ceph noarch packages 49 kB/s | 11 kB 00:00 2024-09-13T17:50:36.090 INFO:teuthology.orchestra.run.smithi143.stdout:ceph noarch packages 48 kB/s | 11 kB 00:00 2024-09-13T17:50:36.117 INFO:teuthology.orchestra.run.smithi027.stdout:ceph packages for x86_64 231 kB/s | 78 kB 00:00 2024-09-13T17:50:36.328 INFO:teuthology.orchestra.run.smithi122.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-13T17:50:36.357 INFO:teuthology.orchestra.run.smithi143.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-13T17:50:36.425 INFO:teuthology.orchestra.run.smithi027.stdout:ceph noarch packages 44 kB/s | 11 kB 00:00 2024-09-13T17:50:36.767 INFO:teuthology.orchestra.run.smithi027.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2024-09-13T17:50:36.841 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-13T17:50:37.070 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-13T17:50:38.930 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-13T17:50:39.651 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 8.2 MB 00:02 2024-09-13T17:50:43.348 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-13T17:50:45.090 INFO:teuthology.orchestra.run.smithi122.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 19 kB 00:00 2024-09-13T17:50:46.602 INFO:teuthology.orchestra.run.smithi122.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-13T17:50:51.959 INFO:teuthology.orchestra.run.smithi122.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T17:50:54.262 INFO:teuthology.orchestra.run.smithi122.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:50:54.263 INFO:teuthology.orchestra.run.smithi122.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:50:54.276 INFO:teuthology.orchestra.run.smithi122.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T17:50:54.277 INFO:teuthology.orchestra.run.smithi122.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T17:50:54.278 INFO:teuthology.orchestra.run.smithi122.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T17:50:54.279 INFO:teuthology.orchestra.run.smithi122.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T17:50:54.281 INFO:teuthology.orchestra.run.smithi122.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T17:50:54.283 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T17:50:54.284 INFO:teuthology.orchestra.run.smithi122.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T17:50:54.346 INFO:teuthology.orchestra.run.smithi122.stdout:Dependencies resolved. 2024-09-13T17:50:54.363 INFO:teuthology.orchestra.run.smithi122.stdout:====================================================================================== 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: Package Arch Version Repository Size 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout:====================================================================================== 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout:Installing: 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T17:50:54.364 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T17:50:54.365 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T17:50:54.366 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrading: 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T17:50:54.367 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout:Installing dependencies: 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T17:50:54.368 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T17:50:54.369 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T17:50:54.370 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T17:50:54.371 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T17:50:54.372 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T17:50:54.373 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T17:50:54.374 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction Summary 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout:====================================================================================== 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout:Install 130 Packages 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout:Upgrade 8 Packages 2024-09-13T17:50:54.375 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:50:54.376 INFO:teuthology.orchestra.run.smithi122.stdout:Total download size: 203 M 2024-09-13T17:50:54.376 INFO:teuthology.orchestra.run.smithi122.stdout:Downloading Packages: 2024-09-13T17:50:54.968 INFO:teuthology.orchestra.run.smithi122.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 27 kB/s | 6.5 kB 00:00 2024-09-13T17:50:55.419 INFO:teuthology.orchestra.run.smithi122.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 1.8 MB/s | 852 kB 00:00 2024-09-13T17:50:55.544 INFO:teuthology.orchestra.run.smithi122.stdout:(3/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 6.2 MB/s | 5.1 MB 00:00 2024-09-13T17:50:55.569 INFO:teuthology.orchestra.run.smithi122.stdout:(4/138): ceph-immutable-object-cache-18.2.4-860 949 kB/s | 142 kB 00:00 2024-09-13T17:50:55.703 INFO:teuthology.orchestra.run.smithi122.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 13 MB/s | 2.1 MB 00:00 2024-09-13T17:50:55.969 INFO:teuthology.orchestra.run.smithi122.stdout:(6/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 18 MB/s | 4.7 MB 00:00 2024-09-13T17:50:56.003 INFO:teuthology.orchestra.run.smithi122.stdout:(7/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 3.4 MB/s | 1.5 MB 00:00 2024-09-13T17:50:56.195 INFO:teuthology.orchestra.run.smithi122.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 13 MB/s | 18 MB 00:01 2024-09-13T17:50:56.270 INFO:teuthology.orchestra.run.smithi122.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 337 kB/s | 25 kB 00:00 2024-09-13T17:50:56.846 INFO:teuthology.orchestra.run.smithi122.stdout:(10/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 19 MB/s | 17 MB 00:00 2024-09-13T17:50:56.921 INFO:teuthology.orchestra.run.smithi122.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 2.9 MB/s | 224 kB 00:00 2024-09-13T17:50:56.996 INFO:teuthology.orchestra.run.smithi122.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 414 kB/s | 31 kB 00:00 2024-09-13T17:50:57.080 INFO:teuthology.orchestra.run.smithi122.stdout:(13/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 8.4 MB/s | 712 kB 00:00 2024-09-13T17:50:57.163 INFO:teuthology.orchestra.run.smithi122.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 1.9 MB/s | 166 kB 00:00 2024-09-13T17:50:57.239 INFO:teuthology.orchestra.run.smithi122.stdout:(15/138): librados-devel-18.2.4-860.g6c6b083f.e 1.7 MB/s | 127 kB 00:00 2024-09-13T17:50:57.322 INFO:teuthology.orchestra.run.smithi122.stdout:(16/138): libradosstriper1-18.2.4-860.g6c6b083f 5.6 MB/s | 478 kB 00:00 2024-09-13T17:50:57.339 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:19 2024-09-13T17:50:57.431 INFO:teuthology.orchestra.run.smithi122.stdout:(17/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 5.4 MB/s | 7.7 MB 00:01 2024-09-13T17:50:57.498 INFO:teuthology.orchestra.run.smithi122.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 677 kB/s | 45 kB 00:00 2024-09-13T17:50:57.565 INFO:teuthology.orchestra.run.smithi122.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 1.9 MB/s | 129 kB 00:00 2024-09-13T17:50:57.640 INFO:teuthology.orchestra.run.smithi122.stdout:(20/138): python3-cephfs-18.2.4-860.g6c6b083f.e 2.1 MB/s | 162 kB 00:00 2024-09-13T17:50:57.707 INFO:teuthology.orchestra.run.smithi122.stdout:(21/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 4.5 MB 00:00 2024-09-13T17:50:57.732 INFO:teuthology.orchestra.run.smithi122.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 3.4 MB/s | 321 kB 00:00 2024-09-13T17:50:57.791 INFO:teuthology.orchestra.run.smithi122.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 3.5 MB/s | 301 kB 00:00 2024-09-13T17:50:57.816 INFO:teuthology.orchestra.run.smithi122.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.2 MB/s | 99 kB 00:00 2024-09-13T17:50:57.858 INFO:teuthology.orchestra.run.smithi122.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.3 MB/s | 87 kB 00:00 2024-09-13T17:50:57.933 INFO:teuthology.orchestra.run.smithi122.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.2 MB/s | 172 kB 00:00 2024-09-13T17:50:58.009 INFO:teuthology.orchestra.run.smithi122.stdout:(27/138): ceph-grafana-dashboards-18.2.4-860.g6 326 kB/s | 24 kB 00:00 2024-09-13T17:50:58.084 INFO:teuthology.orchestra.run.smithi122.stdout:(28/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 1.8 MB/s | 139 kB 00:00 2024-09-13T17:50:58.317 INFO:teuthology.orchestra.run.smithi122.stdout:(29/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 6.0 MB/s | 3.0 MB 00:00 2024-09-13T17:50:58.368 INFO:teuthology.orchestra.run.smithi122.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 12 MB/s | 3.5 MB 00:00 2024-09-13T17:50:58.468 INFO:teuthology.orchestra.run.smithi122.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 2.4 MB/s | 246 kB 00:00 2024-09-13T17:50:58.560 INFO:teuthology.orchestra.run.smithi122.stdout:(32/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 538 kB/s | 49 kB 00:00 2024-09-13T17:50:58.635 INFO:teuthology.orchestra.run.smithi122.stdout:(33/138): ceph-prometheus-alerts-18.2.4-860.g6c 219 kB/s | 16 kB 00:00 2024-09-13T17:50:59.019 INFO:teuthology.orchestra.run.smithi122.stdout:(34/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 14 MB/s | 40 MB 00:02 2024-09-13T17:50:59.044 INFO:teuthology.orchestra.run.smithi122.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 647 kB/s | 264 kB 00:00 2024-09-13T17:50:59.094 INFO:teuthology.orchestra.run.smithi122.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 2.9 MB/s | 226 kB 00:00 2024-09-13T17:50:59.111 INFO:teuthology.orchestra.run.smithi122.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 273 kB/s | 18 kB 00:00 2024-09-13T17:50:59.228 INFO:teuthology.orchestra.run.smithi122.stdout:(38/138): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-13T17:50:59.314 INFO:teuthology.orchestra.run.smithi122.stdout:(39/138): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-13T17:50:59.347 INFO:teuthology.orchestra.run.smithi122.stdout:(40/138): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-13T17:50:59.381 INFO:teuthology.orchestra.run.smithi122.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-09-13T17:50:59.431 INFO:teuthology.orchestra.run.smithi122.stdout:(42/138): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.2 MB 00:00 2024-09-13T17:50:59.457 INFO:teuthology.orchestra.run.smithi122.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-13T17:50:59.473 INFO:teuthology.orchestra.run.smithi122.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 3.2 MB/s | 135 kB 00:00 2024-09-13T17:50:59.565 INFO:teuthology.orchestra.run.smithi122.stdout:(45/138): ceph-mgr-diskprediction-local-18.2.4- 5.9 MB/s | 7.4 MB 00:01 2024-09-13T17:50:59.591 INFO:teuthology.orchestra.run.smithi122.stdout:(46/138): python3-requests-2.25.1-8.el9.noarch. 933 kB/s | 125 kB 00:00 2024-09-13T17:50:59.616 INFO:teuthology.orchestra.run.smithi122.stdout:(47/138): python3-urllib3-1.26.5-6.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-09-13T17:50:59.708 INFO:teuthology.orchestra.run.smithi122.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 4.7 MB/s | 689 kB 00:00 2024-09-13T17:50:59.733 INFO:teuthology.orchestra.run.smithi122.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 914 kB/s | 107 kB 00:00 2024-09-13T17:50:59.758 INFO:teuthology.orchestra.run.smithi122.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-13T17:50:59.792 INFO:teuthology.orchestra.run.smithi122.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 4.6 MB/s | 943 kB 00:00 2024-09-13T17:50:59.817 INFO:teuthology.orchestra.run.smithi122.stdout:(52/138): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-09-13T17:50:59.833 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:19 2024-09-13T17:50:59.843 INFO:teuthology.orchestra.run.smithi122.stdout:(53/138): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-13T17:50:59.868 INFO:teuthology.orchestra.run.smithi122.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-13T17:50:59.893 INFO:teuthology.orchestra.run.smithi122.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-13T17:50:59.910 INFO:teuthology.orchestra.run.smithi122.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 160 kB 00:00 2024-09-13T17:50:59.935 INFO:teuthology.orchestra.run.smithi122.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-13T17:50:59.977 INFO:teuthology.orchestra.run.smithi122.stdout:(58/138): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-13T17:51:00.003 INFO:teuthology.orchestra.run.smithi122.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-13T17:51:00.028 INFO:teuthology.orchestra.run.smithi122.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-13T17:51:00.053 INFO:teuthology.orchestra.run.smithi122.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-13T17:51:00.087 INFO:teuthology.orchestra.run.smithi122.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-13T17:51:00.112 INFO:teuthology.orchestra.run.smithi122.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 657 kB/s | 38 kB 00:00 2024-09-13T17:51:00.171 INFO:teuthology.orchestra.run.smithi122.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.9 MB/s | 3.0 MB 00:00 2024-09-13T17:51:00.254 INFO:teuthology.orchestra.run.smithi122.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-13T17:51:00.321 INFO:teuthology.orchestra.run.smithi122.stdout:(66/138): openblas-openmp-0.3.26-2.el9.x86_64.r 21 MB/s | 4.9 MB 00:00 2024-09-13T17:51:00.355 INFO:teuthology.orchestra.run.smithi122.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-13T17:51:00.388 INFO:teuthology.orchestra.run.smithi122.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-13T17:51:00.455 INFO:teuthology.orchestra.run.smithi122.stdout:(69/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-13T17:51:00.514 INFO:teuthology.orchestra.run.smithi122.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-13T17:51:00.589 INFO:teuthology.orchestra.run.smithi122.stdout:(71/138): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-13T17:51:00.614 INFO:teuthology.orchestra.run.smithi122.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-09-13T17:51:00.631 INFO:teuthology.orchestra.run.smithi122.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 612 kB/s | 26 kB 00:00 2024-09-13T17:51:00.648 INFO:teuthology.orchestra.run.smithi122.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 570 kB/s | 19 kB 00:00 2024-09-13T17:51:00.673 INFO:teuthology.orchestra.run.smithi122.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-09-13T17:51:00.690 INFO:teuthology.orchestra.run.smithi122.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 830 kB/s | 35 kB 00:00 2024-09-13T17:51:00.766 INFO:teuthology.orchestra.run.smithi122.stdout:(77/138): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-13T17:51:00.791 INFO:teuthology.orchestra.run.smithi122.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-13T17:51:00.816 INFO:teuthology.orchestra.run.smithi122.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-13T17:51:00.842 INFO:teuthology.orchestra.run.smithi122.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-13T17:51:00.859 INFO:teuthology.orchestra.run.smithi122.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-13T17:51:00.892 INFO:teuthology.orchestra.run.smithi122.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-13T17:51:00.917 INFO:teuthology.orchestra.run.smithi122.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-13T17:51:00.934 INFO:teuthology.orchestra.run.smithi122.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-13T17:51:00.951 INFO:teuthology.orchestra.run.smithi122.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-13T17:51:01.035 INFO:teuthology.orchestra.run.smithi122.stdout:(86/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-13T17:51:01.060 INFO:teuthology.orchestra.run.smithi122.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-13T17:51:01.085 INFO:teuthology.orchestra.run.smithi122.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 6.0 MB/s | 304 kB 00:00 2024-09-13T17:51:01.111 INFO:teuthology.orchestra.run.smithi122.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T17:51:01.136 INFO:teuthology.orchestra.run.smithi122.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-13T17:51:01.161 INFO:teuthology.orchestra.run.smithi122.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T17:51:01.186 INFO:teuthology.orchestra.run.smithi122.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 889 kB/s | 45 kB 00:00 2024-09-13T17:51:01.245 INFO:teuthology.orchestra.run.smithi122.stdout:(93/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 5.2 MB/s | 308 kB 00:00 2024-09-13T17:51:01.504 INFO:teuthology.orchestra.run.smithi122.stdout:(94/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-13T17:51:01.537 INFO:teuthology.orchestra.run.smithi122.stdout:(95/138): fmt-8.1.1-5.el9.x86_64.rpm 295 kB/s | 111 kB 00:00 2024-09-13T17:51:01.563 INFO:teuthology.orchestra.run.smithi122.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-13T17:51:01.588 INFO:teuthology.orchestra.run.smithi122.stdout:(97/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 318 kB/s | 26 kB 00:00 2024-09-13T17:51:01.613 INFO:teuthology.orchestra.run.smithi122.stdout:(98/138): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T17:51:01.680 INFO:teuthology.orchestra.run.smithi122.stdout:(99/138): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-13T17:51:01.706 INFO:teuthology.orchestra.run.smithi122.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T17:51:01.731 INFO:teuthology.orchestra.run.smithi122.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T17:51:01.756 INFO:teuthology.orchestra.run.smithi122.stdout:(102/138): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-13T17:51:01.781 INFO:teuthology.orchestra.run.smithi122.stdout:(103/138): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-13T17:51:01.815 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - CRB 9.4 MB/s | 6.5 MB 00:00 2024-09-13T17:51:01.815 INFO:teuthology.orchestra.run.smithi122.stdout:(104/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-09-13T17:51:01.840 INFO:teuthology.orchestra.run.smithi122.stdout:(105/138): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-09-13T17:51:01.865 INFO:teuthology.orchestra.run.smithi122.stdout:(106/138): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-13T17:51:01.882 INFO:teuthology.orchestra.run.smithi122.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 255 kB/s | 11 kB 00:00 2024-09-13T17:51:01.899 INFO:teuthology.orchestra.run.smithi122.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 527 kB/s | 18 kB 00:00 2024-09-13T17:51:01.925 INFO:teuthology.orchestra.run.smithi122.stdout:(109/138): python3-google-auth-2.34.0-1.el9.noa 2.0 MB/s | 220 kB 00:00 2024-09-13T17:51:01.941 INFO:teuthology.orchestra.run.smithi122.stdout:(110/138): python3-jaraco-collections-3.0.0-8.e 392 kB/s | 23 kB 00:00 2024-09-13T17:51:01.959 INFO:teuthology.orchestra.run.smithi122.stdout:(111/138): python3-jaraco-functools-3.5.0-2.el9 330 kB/s | 19 kB 00:00 2024-09-13T17:51:01.975 INFO:teuthology.orchestra.run.smithi122.stdout:(112/138): python3-jaraco-text-3.2.0-6.el9.noar 390 kB/s | 20 kB 00:00 2024-09-13T17:51:01.992 INFO:teuthology.orchestra.run.smithi122.stdout:(113/138): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-13T17:51:02.017 INFO:teuthology.orchestra.run.smithi122.stdout:(114/138): python3-more-itertools-8.12.0-2.el9. 1.8 MB/s | 79 kB 00:00 2024-09-13T17:51:02.035 INFO:teuthology.orchestra.run.smithi122.stdout:(115/138): python3-natsort-7.1.1-5.el9.noarch.r 1.3 MB/s | 58 kB 00:00 2024-09-13T17:51:02.051 INFO:teuthology.orchestra.run.smithi122.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 996 kB/s | 16 kB 00:00 2024-09-13T17:51:02.077 INFO:teuthology.orchestra.run.smithi122.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-13T17:51:02.102 INFO:teuthology.orchestra.run.smithi122.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-13T17:51:02.119 INFO:teuthology.orchestra.run.smithi122.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-09-13T17:51:02.136 INFO:teuthology.orchestra.run.smithi122.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-13T17:51:02.161 INFO:teuthology.orchestra.run.smithi122.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2024-09-13T17:51:02.178 INFO:teuthology.orchestra.run.smithi122.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 853 kB/s | 36 kB 00:00 2024-09-13T17:51:02.195 INFO:teuthology.orchestra.run.smithi122.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 2.2 MB/s | 74 kB 00:00 2024-09-13T17:51:02.228 INFO:teuthology.orchestra.run.smithi122.stdout:(124/138): python3-kubernetes-26.1.0-2.el9.noar 3.8 MB/s | 1.0 MB 00:00 2024-09-13T17:51:02.246 INFO:teuthology.orchestra.run.smithi122.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-13T17:51:02.271 INFO:teuthology.orchestra.run.smithi122.stdout:(126/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-13T17:51:02.287 INFO:teuthology.orchestra.run.smithi122.stdout:(127/138): python3-zc-lockfile-2.0-10.el9.noarc 479 kB/s | 20 kB 00:00 2024-09-13T17:51:02.313 INFO:teuthology.orchestra.run.smithi122.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-13T17:51:02.338 INFO:teuthology.orchestra.run.smithi122.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-09-13T17:51:02.397 INFO:teuthology.orchestra.run.smithi122.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T17:51:02.514 INFO:teuthology.orchestra.run.smithi122.stdout:(131/138): NetworkManager-1.49.90-1.el9.x86_64. 20 MB/s | 2.3 MB 00:00 2024-09-13T17:51:02.606 INFO:teuthology.orchestra.run.smithi122.stdout:(132/138): NetworkManager-libnm-1.49.90-1.el9.x 20 MB/s | 1.8 MB 00:00 2024-09-13T17:51:02.665 INFO:teuthology.orchestra.run.smithi122.stdout:(133/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 9.2 MB/s | 3.0 MB 00:00 2024-09-13T17:51:02.690 INFO:teuthology.orchestra.run.smithi122.stdout:(134/138): NetworkManager-team-1.49.90-1.el9.x8 488 kB/s | 41 kB 00:00 2024-09-13T17:51:02.715 INFO:teuthology.orchestra.run.smithi122.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 4.8 MB/s | 249 kB 00:00 2024-09-13T17:51:02.765 INFO:teuthology.orchestra.run.smithi122.stdout:(136/138): librados2-18.2.4-860.g6c6b083f.el9.x 7.3 MB/s | 3.3 MB 00:00 2024-09-13T17:51:02.799 INFO:teuthology.orchestra.run.smithi122.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-13T17:51:02.849 INFO:teuthology.orchestra.run.smithi122.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-09-13T17:51:02.855 INFO:teuthology.orchestra.run.smithi122.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:51:02.856 INFO:teuthology.orchestra.run.smithi122.stdout:Total 24 MB/s | 203 MB 00:08 2024-09-13T17:51:03.408 INFO:teuthology.orchestra.run.smithi143.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 19 kB 00:00 2024-09-13T17:51:03.939 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction check 2024-09-13T17:51:04.084 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction check succeeded. 2024-09-13T17:51:04.084 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction test 2024-09-13T17:51:04.543 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-13T17:51:04.874 INFO:teuthology.orchestra.run.smithi143.stdout:Extra Packages for Enterprise Linux 17 MB/s | 23 MB 00:01 2024-09-13T17:51:05.706 INFO:teuthology.orchestra.run.smithi122.stdout:Transaction test succeeded. 2024-09-13T17:51:05.706 INFO:teuthology.orchestra.run.smithi122.stdout:Running transaction 2024-09-13T17:51:06.185 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 19 kB 00:00 2024-09-13T17:51:07.299 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-13T17:51:10.296 INFO:teuthology.orchestra.run.smithi143.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-13T17:51:11.283 INFO:teuthology.orchestra.run.smithi122.stdout: Preparing : 1/1 2024-09-13T17:51:11.403 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T17:51:11.513 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T17:51:11.570 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T17:51:11.612 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T17:51:11.638 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T17:51:11.680 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T17:51:11.990 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T17:51:12.097 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:51:12.215 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:51:12.257 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:51:12.348 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:51:12.378 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:51:12.522 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T17:51:12.565 INFO:teuthology.orchestra.run.smithi143.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:51:12.566 INFO:teuthology.orchestra.run.smithi143.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:51:12.577 INFO:teuthology.orchestra.run.smithi143.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T17:51:12.578 INFO:teuthology.orchestra.run.smithi143.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T17:51:12.579 INFO:teuthology.orchestra.run.smithi143.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T17:51:12.580 INFO:teuthology.orchestra.run.smithi143.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T17:51:12.581 INFO:teuthology.orchestra.run.smithi143.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T17:51:12.584 INFO:teuthology.orchestra.run.smithi143.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T17:51:12.584 INFO:teuthology.orchestra.run.smithi143.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T17:51:12.591 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T17:51:12.619 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:51:12.644 INFO:teuthology.orchestra.run.smithi143.stdout:Dependencies resolved. 2024-09-13T17:51:12.662 INFO:teuthology.orchestra.run.smithi143.stdout:====================================================================================== 2024-09-13T17:51:12.662 INFO:teuthology.orchestra.run.smithi143.stdout: Package Arch Version Repository Size 2024-09-13T17:51:12.662 INFO:teuthology.orchestra.run.smithi143.stdout:====================================================================================== 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout:Installing: 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T17:51:12.663 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T17:51:12.664 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T17:51:12.665 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrading: 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout:Installing dependencies: 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T17:51:12.666 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T17:51:12.667 INFO:teuthology.orchestra.run.smithi143.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T17:51:12.668 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T17:51:12.669 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T17:51:12.670 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T17:51:12.671 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T17:51:12.672 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction Summary 2024-09-13T17:51:12.673 INFO:teuthology.orchestra.run.smithi143.stdout:====================================================================================== 2024-09-13T17:51:12.674 INFO:teuthology.orchestra.run.smithi143.stdout:Install 130 Packages 2024-09-13T17:51:12.674 INFO:teuthology.orchestra.run.smithi143.stdout:Upgrade 8 Packages 2024-09-13T17:51:12.674 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:51:12.674 INFO:teuthology.orchestra.run.smithi143.stdout:Total download size: 203 M 2024-09-13T17:51:12.674 INFO:teuthology.orchestra.run.smithi143.stdout:Downloading Packages: 2024-09-13T17:51:12.720 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:51:12.745 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:51:12.911 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:51:13.042 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T17:51:13.081 INFO:teuthology.orchestra.run.smithi143.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-13T17:51:13.133 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:51:13.210 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:51:13.248 INFO:teuthology.orchestra.run.smithi143.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 5.0 MB/s | 852 kB 00:00 2024-09-13T17:51:13.340 INFO:teuthology.orchestra.run.smithi143.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 1.5 MB/s | 142 kB 00:00 2024-09-13T17:51:13.440 INFO:teuthology.orchestra.run.smithi143.stdout:(4/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 10 MB/s | 5.1 MB 00:00 2024-09-13T17:51:13.509 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:51:13.547 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T17:51:13.549 INFO:teuthology.orchestra.run.smithi143.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 10 MB/s | 2.1 MB 00:00 2024-09-13T17:51:13.582 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T17:51:13.582 INFO:teuthology.orchestra.run.smithi143.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-13T17:51:13.647 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T17:51:13.690 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T17:51:13.718 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T17:51:13.787 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T17:51:13.840 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T17:51:13.871 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T17:51:13.903 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T17:51:13.906 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T17:51:13.924 INFO:teuthology.orchestra.run.smithi143.stdout:(7/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 4.7 MB 00:00 2024-09-13T17:51:13.981 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T17:51:14.017 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T17:51:14.060 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T17:51:14.116 INFO:teuthology.orchestra.run.smithi143.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 16 MB/s | 18 MB 00:01 2024-09-13T17:51:14.142 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T17:51:14.167 INFO:teuthology.orchestra.run.smithi143.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 505 kB/s | 25 kB 00:00 2024-09-13T17:51:14.282 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T17:51:14.337 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T17:51:14.425 INFO:teuthology.orchestra.run.smithi143.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 15 MB/s | 7.7 MB 00:00 2024-09-13T17:51:14.584 INFO:teuthology.orchestra.run.smithi143.stdout:(11/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 17 MB/s | 17 MB 00:01 2024-09-13T17:51:14.609 INFO:teuthology.orchestra.run.smithi143.stdout:(12/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 1.2 MB/s | 224 kB 00:00 2024-09-13T17:51:14.634 INFO:teuthology.orchestra.run.smithi143.stdout:(13/138): libcephfs-devel-18.2.4-860.g6c6b083f. 620 kB/s | 31 kB 00:00 2024-09-13T17:51:14.676 INFO:teuthology.orchestra.run.smithi143.stdout:(14/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 10 MB/s | 712 kB 00:00 2024-09-13T17:51:14.702 INFO:teuthology.orchestra.run.smithi143.stdout:(15/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.4 MB/s | 166 kB 00:00 2024-09-13T17:51:14.727 INFO:teuthology.orchestra.run.smithi143.stdout:(16/138): librados-devel-18.2.4-860.g6c6b083f.e 2.5 MB/s | 127 kB 00:00 2024-09-13T17:51:14.752 INFO:teuthology.orchestra.run.smithi143.stdout:(17/138): libradosstriper1-18.2.4-860.g6c6b083f 9.3 MB/s | 478 kB 00:00 2024-09-13T17:51:14.811 INFO:teuthology.orchestra.run.smithi143.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 770 kB/s | 45 kB 00:00 2024-09-13T17:51:14.891 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T17:51:14.920 INFO:teuthology.orchestra.run.smithi143.stdout:(19/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 23 MB/s | 4.5 MB 00:00 2024-09-13T17:51:14.945 INFO:teuthology.orchestra.run.smithi143.stdout:(20/138): python3-ceph-common-18.2.4-860.g6c6b0 967 kB/s | 129 kB 00:00 2024-09-13T17:51:14.970 INFO:teuthology.orchestra.run.smithi143.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 3.2 MB/s | 162 kB 00:00 2024-09-13T17:51:14.976 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T17:51:15.017 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T17:51:15.029 INFO:teuthology.orchestra.run.smithi143.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 3.8 MB/s | 321 kB 00:00 2024-09-13T17:51:15.054 INFO:teuthology.orchestra.run.smithi143.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 3.5 MB/s | 301 kB 00:00 2024-09-13T17:51:15.055 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T17:51:15.088 INFO:teuthology.orchestra.run.smithi143.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.7 MB/s | 99 kB 00:00 2024-09-13T17:51:15.097 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T17:51:15.117 INFO:teuthology.orchestra.run.smithi143.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.4 MB/s | 87 kB 00:00 2024-09-13T17:51:15.180 INFO:teuthology.orchestra.run.smithi143.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.5 MB/s | 172 kB 00:00 2024-09-13T17:51:15.264 INFO:teuthology.orchestra.run.smithi143.stdout:(27/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 17 MB/s | 3.0 MB 00:00 2024-09-13T17:51:15.268 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T17:51:15.289 INFO:teuthology.orchestra.run.smithi143.stdout:(28/138): ceph-grafana-dashboards-18.2.4-860.g6 225 kB/s | 24 kB 00:00 2024-09-13T17:51:15.322 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T17:51:15.347 INFO:teuthology.orchestra.run.smithi143.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.3 MB/s | 139 kB 00:00 2024-09-13T17:51:15.432 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T17:51:15.476 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T17:51:15.515 INFO:teuthology.orchestra.run.smithi143.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 16 MB/s | 3.5 MB 00:00 2024-09-13T17:51:15.531 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T17:51:15.590 INFO:teuthology.orchestra.run.smithi143.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 3.2 MB/s | 246 kB 00:00 2024-09-13T17:51:15.604 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T17:51:15.635 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T17:51:15.671 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T17:51:15.698 INFO:teuthology.orchestra.run.smithi143.stdout:(32/138): ceph-mgr-diskprediction-local-18.2.4- 21 MB/s | 7.4 MB 00:00 2024-09-13T17:51:15.723 INFO:teuthology.orchestra.run.smithi143.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 369 kB/s | 49 kB 00:00 2024-09-13T17:51:15.726 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T17:51:15.757 INFO:teuthology.orchestra.run.smithi143.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 281 kB/s | 16 kB 00:00 2024-09-13T17:51:15.771 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T17:51:15.783 INFO:teuthology.orchestra.run.smithi143.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 4.4 MB/s | 264 kB 00:00 2024-09-13T17:51:15.808 INFO:teuthology.orchestra.run.smithi143.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-13T17:51:15.814 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T17:51:15.825 INFO:teuthology.orchestra.run.smithi143.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 435 kB/s | 18 kB 00:00 2024-09-13T17:51:15.949 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T17:51:15.991 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T17:51:16.032 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T17:51:16.134 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T17:51:16.174 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T17:51:16.214 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T17:51:16.239 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T17:51:16.267 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T17:51:16.292 INFO:teuthology.orchestra.run.smithi143.stdout:(38/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 19 MB/s | 40 MB 00:02 2024-09-13T17:51:16.300 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T17:51:16.337 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T17:51:16.371 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T17:51:16.410 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T17:51:16.439 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T17:51:16.474 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T17:51:16.475 INFO:teuthology.orchestra.run.smithi027.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:51:16.476 INFO:teuthology.orchestra.run.smithi027.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T17:51:16.488 INFO:teuthology.orchestra.run.smithi027.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T17:51:16.489 INFO:teuthology.orchestra.run.smithi027.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T17:51:16.490 INFO:teuthology.orchestra.run.smithi027.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T17:51:16.491 INFO:teuthology.orchestra.run.smithi027.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T17:51:16.493 INFO:teuthology.orchestra.run.smithi027.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T17:51:16.495 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T17:51:16.496 INFO:teuthology.orchestra.run.smithi027.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T17:51:16.507 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T17:51:16.563 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================== 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================== 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T17:51:16.582 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T17:51:16.583 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T17:51:16.584 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrading: 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T17:51:16.585 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T17:51:16.586 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T17:51:16.587 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T17:51:16.588 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T17:51:16.589 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T17:51:16.590 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T17:51:16.591 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:51:16.592 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2024-09-13T17:51:16.593 INFO:teuthology.orchestra.run.smithi027.stdout:====================================================================================== 2024-09-13T17:51:16.593 INFO:teuthology.orchestra.run.smithi027.stdout:Install 130 Packages 2024-09-13T17:51:16.593 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrade 8 Packages 2024-09-13T17:51:16.593 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:51:16.593 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 203 M 2024-09-13T17:51:16.594 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2024-09-13T17:51:16.708 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T17:51:16.742 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T17:51:16.777 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T17:51:16.784 INFO:teuthology.orchestra.run.smithi143.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 82 kB/s | 80 kB 00:00 2024-09-13T17:51:16.824 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T17:51:16.939 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T17:51:16.994 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T17:51:17.034 INFO:teuthology.orchestra.run.smithi143.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 258 kB/s | 191 kB 00:00 2024-09-13T17:51:17.117 INFO:teuthology.orchestra.run.smithi143.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 620 kB/s | 801 kB 00:01 2024-09-13T17:51:17.322 INFO:teuthology.orchestra.run.smithi027.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 44 kB/s | 6.5 kB 00:00 2024-09-13T17:51:17.514 INFO:teuthology.orchestra.run.smithi027.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 4.4 MB/s | 852 kB 00:00 2024-09-13T17:51:17.589 INFO:teuthology.orchestra.run.smithi027.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 1.9 MB/s | 142 kB 00:00 2024-09-13T17:51:17.626 INFO:teuthology.orchestra.run.smithi143.stdout:(42/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 301 kB/s | 253 kB 00:00 2024-09-13T17:51:17.702 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T17:51:17.756 INFO:teuthology.orchestra.run.smithi027.stdout:(4/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 8.8 MB/s | 5.1 MB 00:00 2024-09-13T17:51:17.758 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T17:51:17.792 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T17:51:17.793 INFO:teuthology.orchestra.run.smithi143.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2024-09-13T17:51:17.831 INFO:teuthology.orchestra.run.smithi027.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 8.7 MB/s | 2.1 MB 00:00 2024-09-13T17:51:17.893 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T17:51:17.926 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T17:51:17.982 INFO:teuthology.orchestra.run.smithi027.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 6.5 MB/s | 1.5 MB 00:00 2024-09-13T17:51:17.993 INFO:teuthology.orchestra.run.smithi143.stdout:(44/138): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-13T17:51:18.117 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T17:51:18.158 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T17:51:18.234 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T17:51:18.307 INFO:teuthology.orchestra.run.smithi027.stdout:(7/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 16 MB/s | 18 MB 00:01 2024-09-13T17:51:18.344 INFO:teuthology.orchestra.run.smithi143.stdout:(45/138): python3-pycparser-2.20-6.el9.noarch.r 188 kB/s | 135 kB 00:00 2024-09-13T17:51:18.399 INFO:teuthology.orchestra.run.smithi027.stdout:(8/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 8.2 MB/s | 4.7 MB 00:00 2024-09-13T17:51:18.457 INFO:teuthology.orchestra.run.smithi027.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 434 kB/s | 25 kB 00:00 2024-09-13T17:51:18.485 INFO:teuthology.orchestra.run.smithi143.stdout:(46/138): python3-requests-2.25.1-8.el9.noarch. 180 kB/s | 125 kB 00:00 2024-09-13T17:51:18.602 INFO:teuthology.orchestra.run.smithi143.stdout:(47/138): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-09-13T17:51:18.645 INFO:teuthology.orchestra.run.smithi143.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-13T17:51:18.691 INFO:teuthology.orchestra.run.smithi027.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 20 MB/s | 7.7 MB 00:00 2024-09-13T17:51:18.695 INFO:teuthology.orchestra.run.smithi143.stdout:(49/138): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-09-13T17:51:18.741 INFO:teuthology.orchestra.run.smithi027.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 4.4 MB/s | 224 kB 00:00 2024-09-13T17:51:18.753 INFO:teuthology.orchestra.run.smithi143.stdout:(50/138): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-09-13T17:51:18.795 INFO:teuthology.orchestra.run.smithi143.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 943 kB 00:00 2024-09-13T17:51:18.816 INFO:teuthology.orchestra.run.smithi027.stdout:(12/138): libcephfs-devel-18.2.4-860.g6c6b083f. 416 kB/s | 31 kB 00:00 2024-09-13T17:51:18.821 INFO:teuthology.orchestra.run.smithi143.stdout:(52/138): python3-urllib3-1.26.5-6.el9.noarch.r 260 kB/s | 215 kB 00:00 2024-09-13T17:51:18.846 INFO:teuthology.orchestra.run.smithi143.stdout:(53/138): flexiblas-3.0.4-8.el9.x86_64.rpm 354 kB/s | 33 kB 00:00 2024-09-13T17:51:18.856 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T17:51:18.871 INFO:teuthology.orchestra.run.smithi143.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-13T17:51:18.946 INFO:teuthology.orchestra.run.smithi143.stdout:(55/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-09-13T17:51:18.972 INFO:teuthology.orchestra.run.smithi143.stdout:(56/138): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-09-13T17:51:18.988 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:51:18.997 INFO:teuthology.orchestra.run.smithi143.stdout:(57/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-13T17:51:19.022 INFO:teuthology.orchestra.run.smithi143.stdout:(58/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 600 kB/s | 45 kB 00:00 2024-09-13T17:51:19.042 INFO:teuthology.orchestra.run.smithi027.stdout:(13/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 16 MB/s | 17 MB 00:01 2024-09-13T17:51:19.056 INFO:teuthology.orchestra.run.smithi143.stdout:(59/138): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-13T17:51:19.081 INFO:teuthology.orchestra.run.smithi143.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 418 kB/s | 24 kB 00:00 2024-09-13T17:51:19.083 INFO:teuthology.orchestra.run.smithi027.stdout:(14/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 2.6 MB/s | 712 kB 00:00 2024-09-13T17:51:19.106 INFO:teuthology.orchestra.run.smithi143.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-13T17:51:19.109 INFO:teuthology.orchestra.run.smithi027.stdout:(15/138): libcephsqlite-18.2.4-860.g6c6b083f.el 2.4 MB/s | 166 kB 00:00 2024-09-13T17:51:19.140 INFO:teuthology.orchestra.run.smithi143.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-13T17:51:19.142 INFO:teuthology.orchestra.run.smithi027.stdout:(16/138): librados-devel-18.2.4-860.g6c6b083f.e 2.1 MB/s | 127 kB 00:00 2024-09-13T17:51:19.165 INFO:teuthology.orchestra.run.smithi143.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 656 kB/s | 38 kB 00:00 2024-09-13T17:51:19.190 INFO:teuthology.orchestra.run.smithi143.stdout:(64/138): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-13T17:51:19.201 INFO:teuthology.orchestra.run.smithi027.stdout:(17/138): libradosstriper1-18.2.4-860.g6c6b083f 5.1 MB/s | 478 kB 00:00 2024-09-13T17:51:19.335 INFO:teuthology.orchestra.run.smithi027.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 338 kB/s | 45 kB 00:00 2024-09-13T17:51:19.349 INFO:teuthology.orchestra.run.smithi143.stdout:(65/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-13T17:51:19.399 INFO:teuthology.orchestra.run.smithi143.stdout:(66/138): postgresql-13.16-1.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-09-13T17:51:19.452 INFO:teuthology.orchestra.run.smithi027.stdout:(19/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 14 MB/s | 4.5 MB 00:00 2024-09-13T17:51:19.469 INFO:teuthology.orchestra.run.smithi027.stdout:(20/138): python3-ceph-common-18.2.4-860.g6c6b0 967 kB/s | 129 kB 00:00 2024-09-13T17:51:19.483 INFO:teuthology.orchestra.run.smithi143.stdout:(67/138): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-13T17:51:19.502 INFO:teuthology.orchestra.run.smithi027.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 3.2 MB/s | 162 kB 00:00 2024-09-13T17:51:19.508 INFO:teuthology.orchestra.run.smithi143.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-13T17:51:19.534 INFO:teuthology.orchestra.run.smithi143.stdout:(69/138): postgresql-contrib-13.16-1.el9.x86_64 4.8 MB/s | 910 kB 00:00 2024-09-13T17:51:19.536 INFO:teuthology.orchestra.run.smithi027.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 4.7 MB/s | 321 kB 00:00 2024-09-13T17:51:19.562 INFO:teuthology.orchestra.run.smithi027.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 5.0 MB/s | 301 kB 00:00 2024-09-13T17:51:19.578 INFO:teuthology.orchestra.run.smithi027.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 2.3 MB/s | 99 kB 00:00 2024-09-13T17:51:19.592 INFO:teuthology.orchestra.run.smithi143.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-13T17:51:19.635 INFO:teuthology.orchestra.run.smithi027.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.2 MB/s | 87 kB 00:00 2024-09-13T17:51:19.704 INFO:teuthology.orchestra.run.smithi027.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.5 MB/s | 172 kB 00:00 2024-09-13T17:51:19.709 INFO:teuthology.orchestra.run.smithi143.stdout:(71/138): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 6.0 MB 00:00 2024-09-13T17:51:19.734 INFO:teuthology.orchestra.run.smithi143.stdout:(72/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-09-13T17:51:19.768 INFO:teuthology.orchestra.run.smithi143.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-09-13T17:51:19.771 INFO:teuthology.orchestra.run.smithi027.stdout:(27/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 16 MB/s | 3.0 MB 00:00 2024-09-13T17:51:19.793 INFO:teuthology.orchestra.run.smithi143.stdout:(74/138): python3-jsonpointer-2.0-4.el9.noarch. 325 kB/s | 19 kB 00:00 2024-09-13T17:51:19.796 INFO:teuthology.orchestra.run.smithi027.stdout:(28/138): ceph-grafana-dashboards-18.2.4-860.g6 266 kB/s | 24 kB 00:00 2024-09-13T17:51:19.821 INFO:teuthology.orchestra.run.smithi027.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.7 MB/s | 139 kB 00:00 2024-09-13T17:51:19.827 INFO:teuthology.orchestra.run.smithi143.stdout:(75/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-13T17:51:19.853 INFO:teuthology.orchestra.run.smithi143.stdout:(76/138): python3-markupsafe-1.1.1-12.el9.x86_6 591 kB/s | 35 kB 00:00 2024-09-13T17:51:19.920 INFO:teuthology.orchestra.run.smithi143.stdout:(77/138): postgresql-server-13.16-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-09-13T17:51:19.945 INFO:teuthology.orchestra.run.smithi143.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-13T17:51:19.978 INFO:teuthology.orchestra.run.smithi143.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-13T17:51:20.004 INFO:teuthology.orchestra.run.smithi143.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-13T17:51:20.013 INFO:teuthology.orchestra.run.smithi027.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 16 MB/s | 3.5 MB 00:00 2024-09-13T17:51:20.029 INFO:teuthology.orchestra.run.smithi143.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-13T17:51:20.054 INFO:teuthology.orchestra.run.smithi143.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-13T17:51:20.063 INFO:teuthology.orchestra.run.smithi027.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 4.8 MB/s | 246 kB 00:00 2024-09-13T17:51:20.121 INFO:teuthology.orchestra.run.smithi143.stdout:(83/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 5.1 MB 00:00 2024-09-13T17:51:20.139 INFO:teuthology.orchestra.run.smithi027.stdout:(32/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 659 kB/s | 49 kB 00:00 2024-09-13T17:51:20.147 INFO:teuthology.orchestra.run.smithi143.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-09-13T17:51:20.197 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:51:20.200 INFO:teuthology.orchestra.run.smithi143.stdout:(85/138): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-09-13T17:51:20.222 INFO:teuthology.orchestra.run.smithi143.stdout:(86/138): python3-requests-oauthlib-1.3.0-12.el 533 kB/s | 54 kB 00:00 2024-09-13T17:51:20.256 INFO:teuthology.orchestra.run.smithi027.stdout:(33/138): ceph-mgr-diskprediction-local-18.2.4- 17 MB/s | 7.4 MB 00:00 2024-09-13T17:51:20.256 INFO:teuthology.orchestra.run.smithi143.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 759 kB/s | 42 kB 00:00 2024-09-13T17:51:20.280 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T17:51:20.281 INFO:teuthology.orchestra.run.smithi027.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 116 kB/s | 16 kB 00:00 2024-09-13T17:51:20.281 INFO:teuthology.orchestra.run.smithi143.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-13T17:51:20.306 INFO:teuthology.orchestra.run.smithi143.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T17:51:20.308 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T17:51:20.331 INFO:teuthology.orchestra.run.smithi027.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 3.4 MB/s | 264 kB 00:00 2024-09-13T17:51:20.340 INFO:teuthology.orchestra.run.smithi143.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-13T17:51:20.341 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T17:51:20.356 INFO:teuthology.orchestra.run.smithi027.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 2.9 MB/s | 226 kB 00:00 2024-09-13T17:51:20.365 INFO:teuthology.orchestra.run.smithi143.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-13T17:51:20.382 INFO:teuthology.orchestra.run.smithi027.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 364 kB/s | 18 kB 00:00 2024-09-13T17:51:20.398 INFO:teuthology.orchestra.run.smithi143.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-13T17:51:20.441 INFO:teuthology.orchestra.run.smithi143.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.4 MB/s | 111 kB 00:00 2024-09-13T17:51:20.474 INFO:teuthology.orchestra.run.smithi143.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 4.1 MB/s | 308 kB 00:00 2024-09-13T17:51:20.500 INFO:teuthology.orchestra.run.smithi143.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T17:51:20.525 INFO:teuthology.orchestra.run.smithi143.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-13T17:51:20.558 INFO:teuthology.orchestra.run.smithi143.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-13T17:51:20.625 INFO:teuthology.orchestra.run.smithi143.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T17:51:20.640 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T17:51:20.684 INFO:teuthology.orchestra.run.smithi143.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 9.2 MB/s | 548 kB 00:00 2024-09-13T17:51:20.688 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:51:20.709 INFO:teuthology.orchestra.run.smithi143.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T17:51:20.735 INFO:teuthology.orchestra.run.smithi143.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T17:51:20.760 INFO:teuthology.orchestra.run.smithi143.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-13T17:51:20.778 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:51:20.782 INFO:teuthology.orchestra.run.smithi027.stdout:(38/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 17 MB/s | 40 MB 00:02 2024-09-13T17:51:20.809 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T17:51:20.835 INFO:teuthology.orchestra.run.smithi143.stdout:(103/138): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-13T17:51:20.845 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T17:51:20.861 INFO:teuthology.orchestra.run.smithi143.stdout:(104/138): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-09-13T17:51:20.882 INFO:teuthology.orchestra.run.smithi027.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 152 kB/s | 80 kB 00:00 2024-09-13T17:51:20.886 INFO:teuthology.orchestra.run.smithi143.stdout:(105/138): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-13T17:51:20.920 INFO:teuthology.orchestra.run.smithi143.stdout:(106/138): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-09-13T17:51:20.924 INFO:teuthology.orchestra.run.smithi027.stdout:(40/138): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-13T17:51:20.945 INFO:teuthology.orchestra.run.smithi143.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 182 kB/s | 11 kB 00:00 2024-09-13T17:51:20.950 INFO:teuthology.orchestra.run.smithi027.stdout:(41/138): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-13T17:51:20.970 INFO:teuthology.orchestra.run.smithi143.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 351 kB/s | 18 kB 00:00 2024-09-13T17:51:20.975 INFO:teuthology.orchestra.run.smithi027.stdout:(42/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-13T17:51:20.995 INFO:teuthology.orchestra.run.smithi143.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-13T17:51:21.021 INFO:teuthology.orchestra.run.smithi143.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-13T17:51:21.034 INFO:teuthology.orchestra.run.smithi027.stdout:(43/138): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-09-13T17:51:21.046 INFO:teuthology.orchestra.run.smithi143.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-13T17:51:21.051 INFO:teuthology.orchestra.run.smithi027.stdout:(44/138): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-13T17:51:21.071 INFO:teuthology.orchestra.run.smithi143.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T17:51:21.097 INFO:teuthology.orchestra.run.smithi027.stdout:(45/138): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-13T17:51:21.105 INFO:teuthology.orchestra.run.smithi143.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-13T17:51:21.126 INFO:teuthology.orchestra.run.smithi027.stdout:(46/138): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-13T17:51:21.130 INFO:teuthology.orchestra.run.smithi143.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-13T17:51:21.160 INFO:teuthology.orchestra.run.smithi027.stdout:(47/138): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-09-13T17:51:21.164 INFO:teuthology.orchestra.run.smithi143.stdout:(115/138): python3-kubernetes-26.1.0-2.el9.noar 7.1 MB/s | 1.0 MB 00:00 2024-09-13T17:51:21.189 INFO:teuthology.orchestra.run.smithi143.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-09-13T17:51:21.193 INFO:teuthology.orchestra.run.smithi027.stdout:(48/138): automake-1.16.2-8.el9.noarch.rpm 7.0 MB/s | 689 kB 00:00 2024-09-13T17:51:21.215 INFO:teuthology.orchestra.run.smithi143.stdout:(117/138): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-13T17:51:21.227 INFO:teuthology.orchestra.run.smithi027.stdout:(49/138): bison-3.7.4-5.el9.x86_64.rpm 9.2 MB/s | 943 kB 00:00 2024-09-13T17:51:21.240 INFO:teuthology.orchestra.run.smithi143.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-13T17:51:21.248 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T17:51:21.257 INFO:teuthology.orchestra.run.smithi143.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 735 kB/s | 31 kB 00:00 2024-09-13T17:51:21.260 INFO:teuthology.orchestra.run.smithi027.stdout:(50/138): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-13T17:51:21.274 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:51:21.286 INFO:teuthology.orchestra.run.smithi027.stdout:(51/138): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-09-13T17:51:21.311 INFO:teuthology.orchestra.run.smithi027.stdout:(52/138): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-13T17:51:21.336 INFO:teuthology.orchestra.run.smithi027.stdout:(53/138): flexiblas-3.0.4-8.el9.x86_64.rpm 433 kB/s | 33 kB 00:00 2024-09-13T17:51:21.345 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:51:21.367 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T17:51:21.378 INFO:teuthology.orchestra.run.smithi027.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-13T17:51:21.399 INFO:teuthology.orchestra.run.smithi143.stdout:(120/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-13T17:51:21.416 INFO:teuthology.orchestra.run.smithi143.stdout:(121/138): python3-rsa-4.9-2.el9.noarch.rpm 373 kB/s | 59 kB 00:00 2024-09-13T17:51:21.445 INFO:teuthology.orchestra.run.smithi027.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-13T17:51:21.449 INFO:teuthology.orchestra.run.smithi143.stdout:(122/138): python3-routes-2.5.1-5.el9.noarch.rp 901 kB/s | 188 kB 00:00 2024-09-13T17:51:21.466 INFO:teuthology.orchestra.run.smithi143.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-13T17:51:21.470 INFO:teuthology.orchestra.run.smithi027.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-13T17:51:21.492 INFO:teuthology.orchestra.run.smithi143.stdout:(124/138): python3-tempora-5.0.0-2.el9.noarch.r 388 kB/s | 36 kB 00:00 2024-09-13T17:51:21.517 INFO:teuthology.orchestra.run.smithi143.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-13T17:51:21.529 INFO:teuthology.orchestra.run.smithi027.stdout:(57/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-09-13T17:51:21.542 INFO:teuthology.orchestra.run.smithi143.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-13T17:51:21.554 INFO:teuthology.orchestra.run.smithi027.stdout:(58/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-13T17:51:21.567 INFO:teuthology.orchestra.run.smithi143.stdout:(127/138): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-13T17:51:21.588 INFO:teuthology.orchestra.run.smithi027.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-13T17:51:21.593 INFO:teuthology.orchestra.run.smithi143.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T17:51:21.618 INFO:teuthology.orchestra.run.smithi143.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-13T17:51:21.621 INFO:teuthology.orchestra.run.smithi027.stdout:(60/138): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-13T17:51:21.647 INFO:teuthology.orchestra.run.smithi027.stdout:(61/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 266 kB/s | 24 kB 00:00 2024-09-13T17:51:21.672 INFO:teuthology.orchestra.run.smithi027.stdout:(62/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-13T17:51:21.693 INFO:teuthology.orchestra.run.smithi143.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-13T17:51:21.697 INFO:teuthology.orchestra.run.smithi027.stdout:(63/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-13T17:51:21.723 INFO:teuthology.orchestra.run.smithi027.stdout:(64/138): openblas-0.3.26-2.el9.x86_64.rpm 509 kB/s | 38 kB 00:00 2024-09-13T17:51:21.865 INFO:teuthology.orchestra.run.smithi027.stdout:(65/138): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-13T17:51:21.877 INFO:teuthology.orchestra.run.smithi143.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 12 MB/s | 3.3 MB 00:00 2024-09-13T17:51:21.936 INFO:teuthology.orchestra.run.smithi143.stdout:(132/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 9.5 MB/s | 3.0 MB 00:00 2024-09-13T17:51:21.948 INFO:teuthology.orchestra.run.smithi027.stdout:(66/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-13T17:51:22.015 INFO:teuthology.orchestra.run.smithi027.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 5.9 MB/s | 910 kB 00:00 2024-09-13T17:51:22.040 INFO:teuthology.orchestra.run.smithi027.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-13T17:51:22.133 INFO:teuthology.orchestra.run.smithi027.stdout:(69/138): postgresql-13.16-1.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-09-13T17:51:22.249 INFO:teuthology.orchestra.run.smithi027.stdout:(70/138): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-13T17:51:22.337 INFO:teuthology.orchestra.run.smithi027.stdout:(71/138): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-13T17:51:22.375 INFO:teuthology.orchestra.run.smithi027.stdout:(72/138): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-13T17:51:22.400 INFO:teuthology.orchestra.run.smithi027.stdout:(73/138): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-13T17:51:22.442 INFO:teuthology.orchestra.run.smithi027.stdout:(74/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.3 MB/s | 248 kB 00:00 2024-09-13T17:51:22.467 INFO:teuthology.orchestra.run.smithi027.stdout:(75/138): python3-jsonpointer-2.0-4.el9.noarch. 209 kB/s | 19 kB 00:00 2024-09-13T17:51:22.493 INFO:teuthology.orchestra.run.smithi027.stdout:(76/138): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-13T17:51:22.503 INFO:teuthology.orchestra.run.smithi143.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 72 kB/s | 41 kB 00:00 2024-09-13T17:51:22.518 INFO:teuthology.orchestra.run.smithi027.stdout:(77/138): python3-markupsafe-1.1.1-12.el9.x86_6 461 kB/s | 35 kB 00:00 2024-09-13T17:51:22.626 INFO:teuthology.orchestra.run.smithi027.stdout:(78/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-09-13T17:51:22.652 INFO:teuthology.orchestra.run.smithi027.stdout:(79/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 250 kB 00:00 2024-09-13T17:51:22.677 INFO:teuthology.orchestra.run.smithi027.stdout:(80/138): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-13T17:51:22.702 INFO:teuthology.orchestra.run.smithi027.stdout:(81/138): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-13T17:51:22.719 INFO:teuthology.orchestra.run.smithi027.stdout:(82/138): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-09-13T17:51:22.770 INFO:teuthology.orchestra.run.smithi027.stdout:(83/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-13T17:51:22.786 INFO:teuthology.orchestra.run.smithi027.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-09-13T17:51:22.828 INFO:teuthology.orchestra.run.smithi143.stdout:(134/138): NetworkManager-1.49.90-1.el9.x86_64. 2.0 MB/s | 2.3 MB 00:01 2024-09-13T17:51:22.828 INFO:teuthology.orchestra.run.smithi027.stdout:(85/138): python3-pyasn1-modules-0.4.8-6.el9.no 2.2 MB/s | 279 kB 00:00 2024-09-13T17:51:22.853 INFO:teuthology.orchestra.run.smithi027.stdout:(86/138): python3-requests-oauthlib-1.3.0-12.el 643 kB/s | 54 kB 00:00 2024-09-13T17:51:22.870 INFO:teuthology.orchestra.run.smithi143.stdout:(135/138): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:00 2024-09-13T17:51:22.904 INFO:teuthology.orchestra.run.smithi027.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 557 kB/s | 42 kB 00:00 2024-09-13T17:51:22.946 INFO:teuthology.orchestra.run.smithi027.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-13T17:51:22.971 INFO:teuthology.orchestra.run.smithi027.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-09-13T17:51:23.005 INFO:teuthology.orchestra.run.smithi027.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-13T17:51:23.055 INFO:teuthology.orchestra.run.smithi027.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 763 kB/s | 64 kB 00:00 2024-09-13T17:51:23.105 INFO:teuthology.orchestra.run.smithi027.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 446 kB/s | 45 kB 00:00 2024-09-13T17:51:23.164 INFO:teuthology.orchestra.run.smithi027.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.0 MB/s | 111 kB 00:00 2024-09-13T17:51:23.223 INFO:teuthology.orchestra.run.smithi027.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 2.6 MB/s | 308 kB 00:00 2024-09-13T17:51:23.248 INFO:teuthology.orchestra.run.smithi027.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T17:51:23.292 INFO:teuthology.orchestra.run.smithi027.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-13T17:51:23.295 INFO:teuthology.orchestra.run.smithi143.stdout:(136/138): NetworkManager-tui-1.49.90-1.el9.x86 314 kB/s | 249 kB 00:00 2024-09-13T17:51:23.324 INFO:teuthology.orchestra.run.smithi027.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-13T17:51:23.377 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:51:23.407 INFO:teuthology.orchestra.run.smithi027.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.9 MB/s | 839 kB 00:00 2024-09-13T17:51:23.414 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:51:23.482 INFO:teuthology.orchestra.run.smithi027.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 7.1 MB/s | 548 kB 00:00 2024-09-13T17:51:23.508 INFO:teuthology.orchestra.run.smithi027.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-13T17:51:23.533 INFO:teuthology.orchestra.run.smithi027.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-13T17:51:23.558 INFO:teuthology.orchestra.run.smithi027.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 572 kB/s | 14 kB 00:00 2024-09-13T17:51:23.592 INFO:teuthology.orchestra.run.smithi027.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-13T17:51:23.676 INFO:teuthology.orchestra.run.smithi027.stdout:(104/138): libarrow-9.0.0-11.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-09-13T17:51:23.709 INFO:teuthology.orchestra.run.smithi027.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-13T17:51:23.743 INFO:teuthology.orchestra.run.smithi027.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 325 kB/s | 11 kB 00:00 2024-09-13T17:51:23.793 INFO:teuthology.orchestra.run.smithi027.stdout:(107/138): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-09-13T17:51:23.795 INFO:teuthology.orchestra.run.smithi143.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-13T17:51:23.818 INFO:teuthology.orchestra.run.smithi027.stdout:(108/138): python3-google-auth-2.34.0-1.el9.noa 1.5 MB/s | 220 kB 00:00 2024-09-13T17:51:23.844 INFO:teuthology.orchestra.run.smithi027.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-13T17:51:23.869 INFO:teuthology.orchestra.run.smithi027.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-13T17:51:23.894 INFO:teuthology.orchestra.run.smithi027.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 394 kB/s | 20 kB 00:00 2024-09-13T17:51:23.928 INFO:teuthology.orchestra.run.smithi027.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-09-13T17:51:23.933 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:51:23.953 INFO:teuthology.orchestra.run.smithi027.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-13T17:51:23.953 INFO:teuthology.orchestra.run.smithi143.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.2 MB/s | 2.4 MB 00:01 2024-09-13T17:51:23.961 INFO:teuthology.orchestra.run.smithi143.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:51:23.961 INFO:teuthology.orchestra.run.smithi143.stdout:Total 18 MB/s | 203 MB 00:11 2024-09-13T17:51:23.984 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:51:23.987 INFO:teuthology.orchestra.run.smithi027.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-09-13T17:51:24.020 INFO:teuthology.orchestra.run.smithi027.stdout:(115/138): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-13T17:51:24.045 INFO:teuthology.orchestra.run.smithi027.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-13T17:51:24.079 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:51:24.079 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T17:51:24.080 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T17:51:24.080 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:24.106 INFO:teuthology.orchestra.run.smithi027.stdout:(117/138): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-09-13T17:51:24.110 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:51:24.138 INFO:teuthology.orchestra.run.smithi027.stdout:(118/138): python3-repoze-lru-0.7-16.el9.noarch 981 kB/s | 31 kB 00:00 2024-09-13T17:51:24.163 INFO:teuthology.orchestra.run.smithi027.stdout:(119/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 768 kB/s | 90 kB 00:00 2024-09-13T17:51:24.188 INFO:teuthology.orchestra.run.smithi027.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T17:51:24.213 INFO:teuthology.orchestra.run.smithi027.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T17:51:24.239 INFO:teuthology.orchestra.run.smithi027.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-13T17:51:24.265 INFO:teuthology.orchestra.run.smithi027.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-13T17:51:24.290 INFO:teuthology.orchestra.run.smithi027.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T17:51:24.315 INFO:teuthology.orchestra.run.smithi027.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T17:51:24.332 INFO:teuthology.orchestra.run.smithi027.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-13T17:51:24.365 INFO:teuthology.orchestra.run.smithi027.stdout:(127/138): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-13T17:51:24.391 INFO:teuthology.orchestra.run.smithi027.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-13T17:51:24.600 INFO:teuthology.orchestra.run.smithi027.stdout:(129/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.0 MB/s | 16 MB 00:01 2024-09-13T17:51:24.650 INFO:teuthology.orchestra.run.smithi027.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-09-13T17:51:24.750 INFO:teuthology.orchestra.run.smithi027.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 9.2 MB/s | 3.3 MB 00:00 2024-09-13T17:51:24.825 INFO:teuthology.orchestra.run.smithi027.stdout:(132/138): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-13T17:51:24.875 INFO:teuthology.orchestra.run.smithi027.stdout:(133/138): NetworkManager-libnm-1.49.90-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-09-13T17:51:24.918 INFO:teuthology.orchestra.run.smithi027.stdout:(134/138): NetworkManager-team-1.49.90-1.el9.x8 444 kB/s | 41 kB 00:00 2024-09-13T17:51:24.943 INFO:teuthology.orchestra.run.smithi027.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 3.6 MB/s | 249 kB 00:00 2024-09-13T17:51:25.014 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction check 2024-09-13T17:51:25.018 INFO:teuthology.orchestra.run.smithi027.stdout:(136/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 7.2 MB/s | 3.0 MB 00:00 2024-09-13T17:51:25.068 INFO:teuthology.orchestra.run.smithi027.stdout:(137/138): openssl-3.2.2-6.el9.x86_64.rpm 9.0 MB/s | 1.4 MB 00:00 2024-09-13T17:51:25.143 INFO:teuthology.orchestra.run.smithi027.stdout:(138/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-09-13T17:51:25.148 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:51:25.148 INFO:teuthology.orchestra.run.smithi027.stdout:Total 24 MB/s | 203 MB 00:08 2024-09-13T17:51:25.157 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction check succeeded. 2024-09-13T17:51:25.158 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction test 2024-09-13T17:51:26.849 INFO:teuthology.orchestra.run.smithi143.stdout:Transaction test succeeded. 2024-09-13T17:51:26.849 INFO:teuthology.orchestra.run.smithi143.stdout:Running transaction 2024-09-13T17:51:26.995 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2024-09-13T17:51:27.188 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2024-09-13T17:51:27.189 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2024-09-13T17:51:29.474 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2024-09-13T17:51:29.474 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2024-09-13T17:51:32.391 INFO:teuthology.orchestra.run.smithi143.stdout: Preparing : 1/1 2024-09-13T17:51:32.465 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T17:51:32.568 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T17:51:32.741 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T17:51:32.775 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T17:51:32.800 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T17:51:32.844 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T17:51:33.226 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T17:51:33.285 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:51:33.428 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:51:33.453 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:51:33.545 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:51:33.566 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:51:33.724 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T17:51:33.789 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T17:51:33.816 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:51:33.918 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:51:33.942 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:51:34.116 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:51:34.239 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T17:51:34.338 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:51:34.428 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:51:34.708 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:51:34.765 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T17:51:34.807 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T17:51:34.872 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T17:51:34.907 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T17:51:34.943 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T17:51:35.011 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T17:51:35.081 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T17:51:35.112 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T17:51:35.148 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T17:51:35.224 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T17:51:35.268 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T17:51:35.302 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T17:51:35.375 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T17:51:35.508 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T17:51:35.562 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T17:51:35.671 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:51:35.671 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /sys 2024-09-13T17:51:35.671 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /proc 2024-09-13T17:51:35.672 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /mnt 2024-09-13T17:51:35.672 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /var/tmp 2024-09-13T17:51:35.672 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /home 2024-09-13T17:51:35.672 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /root 2024-09-13T17:51:35.672 INFO:teuthology.orchestra.run.smithi122.stdout:skipping the directory /tmp 2024-09-13T17:51:35.672 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:35.832 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2024-09-13T17:51:35.838 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:51:35.854 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:51:35.854 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:35.855 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T17:51:35.855 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:36.017 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T17:51:36.068 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T17:51:36.081 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T17:51:36.134 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T17:51:36.159 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T17:51:36.178 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T17:51:36.196 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T17:51:36.209 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T17:51:36.243 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T17:51:36.268 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T17:51:36.285 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T17:51:36.437 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T17:51:36.493 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T17:51:36.600 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T17:51:36.642 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T17:51:36.677 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T17:51:36.697 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T17:51:36.771 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T17:51:36.811 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T17:51:36.846 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T17:51:36.893 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T17:51:36.909 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:51:36.938 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T17:51:36.981 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T17:51:37.080 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:51:37.110 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:51:37.114 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T17:51:37.157 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T17:51:37.215 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T17:51:37.216 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:51:37.250 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:51:37.283 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:51:37.310 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:51:37.310 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:37.310 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T17:51:37.310 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:51:37.310 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:51:37.311 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:37.317 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T17:51:37.357 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T17:51:37.389 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T17:51:37.415 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T17:51:37.442 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T17:51:37.467 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T17:51:37.495 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T17:51:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T17:51:37.508 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:51:37.529 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T17:51:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:51:37.531 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:37.531 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T17:51:37.531 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:51:37.531 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:51:37.531 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:37.564 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T17:51:37.566 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T17:51:37.596 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T17:51:37.612 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:51:37.630 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T17:51:37.664 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T17:51:37.706 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T17:51:37.740 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T17:51:37.740 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:51:37.765 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:51:37.775 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T17:51:37.824 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T17:51:37.922 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T17:51:37.976 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:51:37.978 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T17:51:38.000 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:51:38.000 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:38.000 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T17:51:38.000 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:51:38.001 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:51:38.001 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:38.003 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T17:51:38.106 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T17:51:38.171 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T17:51:38.179 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T17:51:38.226 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T17:51:38.329 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:51:38.410 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T17:51:38.413 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:51:38.468 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T17:51:38.538 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T17:51:38.634 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T17:51:38.695 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T17:51:38.763 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T17:51:38.774 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T17:51:38.776 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T17:51:38.793 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T17:51:38.810 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T17:51:38.842 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T17:51:38.844 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T17:51:38.870 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T17:51:38.889 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T17:51:38.890 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T17:51:38.927 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T17:51:38.975 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T17:51:39.022 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T17:51:39.055 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T17:51:39.110 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T17:51:39.148 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T17:51:39.150 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T17:51:39.209 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T17:51:39.227 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T17:51:39.241 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T17:51:39.313 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T17:51:39.325 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:51:39.352 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:51:39.380 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T17:51:39.404 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T17:51:39.444 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T17:51:39.446 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T17:51:39.475 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:51:39.491 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T17:51:39.580 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T17:51:39.777 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T17:51:39.848 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T17:51:39.868 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T17:51:39.981 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:51:40.511 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:51:40.548 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T17:51:40.560 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:51:40.700 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T17:51:40.751 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T17:51:40.789 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T17:51:40.843 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T17:51:41.037 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T17:51:41.114 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T17:51:41.198 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:51:41.255 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T17:51:41.296 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T17:51:41.324 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T17:51:41.357 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T17:51:41.518 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:51:41.560 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:51:41.656 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T17:51:41.662 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:51:41.695 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:51:41.786 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:51:41.817 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T17:51:41.817 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T17:51:41.846 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:51:41.853 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T17:51:41.870 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:51:41.870 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:41.870 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T17:51:41.870 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:51:41.870 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:51:41.870 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:41.921 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:51:41.929 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T17:51:41.933 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:51:42.002 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T17:51:42.026 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T17:51:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T17:51:42.096 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T17:51:42.136 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T17:51:42.173 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T17:51:42.233 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T17:51:42.256 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T17:51:42.281 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:51:42.292 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T17:51:42.342 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T17:51:42.344 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:51:42.367 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T17:51:42.523 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T17:51:42.599 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T17:51:42.643 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T17:51:42.773 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T17:51:42.786 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T17:51:42.816 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:51:42.816 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T17:51:42.839 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:51:42.839 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:42.839 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T17:51:42.840 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:51:42.840 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:51:42.840 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:42.859 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T17:51:42.908 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:51:42.920 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T17:51:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:51:42.931 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:42.931 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T17:51:42.931 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:42.966 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T17:51:42.983 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:51:42.999 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T17:51:43.006 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:51:43.006 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:43.006 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T17:51:43.006 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:51:43.007 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:51:43.007 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:43.036 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T17:51:43.078 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T17:51:43.117 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T17:51:43.154 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T17:51:43.188 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T17:51:43.221 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T17:51:43.291 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T17:51:43.301 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:51:43.322 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T17:51:43.324 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:51:43.324 INFO:teuthology.orchestra.run.smithi122.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:43.324 INFO:teuthology.orchestra.run.smithi122.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T17:51:43.324 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:51:43.325 INFO:teuthology.orchestra.run.smithi122.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:51:43.325 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:43.358 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T17:51:43.409 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T17:51:43.537 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T17:51:43.627 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T17:51:44.428 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:51:44.463 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:51:44.592 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T17:51:44.644 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T17:51:44.677 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T17:51:44.799 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T17:51:44.844 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T17:51:44.990 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:51:45.025 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:51:45.092 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T17:51:45.124 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:51:45.124 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T17:51:45.124 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T17:51:45.125 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:51:45.125 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T17:51:45.152 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:51:45.231 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T17:51:46.132 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T17:51:46.267 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:51:46.963 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T17:51:47.004 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T17:51:47.045 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T17:51:47.077 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T17:51:47.249 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T17:51:47.300 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T17:51:47.331 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T17:51:47.360 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T17:51:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T17:51:47.965 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:51:47.966 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:51:48.005 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:51:48.028 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:51:48.063 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T17:51:48.100 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T17:51:48.132 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T17:51:48.601 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T17:51:48.678 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:51:48.832 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T17:51:48.836 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T17:51:48.867 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T17:51:48.917 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T17:51:48.926 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T17:51:48.975 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T17:51:49.066 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T17:51:49.121 INFO:teuthology.orchestra.run.smithi122.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T17:51:49.147 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T17:51:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T17:51:49.173 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:51:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:51:49.249 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:51:49.324 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:51:49.349 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T17:51:49.354 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:51:49.355 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:51:49.384 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T17:51:49.413 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:51:49.496 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T17:51:49.524 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T17:51:49.535 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:51:49.535 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:51:49.610 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:51:49.673 INFO:teuthology.orchestra.run.smithi122.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:51:51.961 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:51:52.042 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:51:52.692 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T17:51:52.741 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:51:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T17:51:52.877 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T17:51:52.877 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T17:51:52.877 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:51:52.916 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:51:54.987 INFO:teuthology.orchestra.run.smithi122.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T17:51:54.988 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T17:51:54.989 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T17:51:54.990 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T17:51:54.991 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T17:51:54.992 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T17:51:54.993 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T17:51:54.994 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T17:51:54.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T17:51:54.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T17:51:54.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T17:51:54.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T17:51:54.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T17:51:54.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T17:51:54.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T17:51:54.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T17:51:54.995 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T17:51:54.996 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T17:51:54.997 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T17:51:54.998 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T17:51:54.998 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T17:51:54.998 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T17:51:54.998 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T17:51:54.998 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T17:51:54.998 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T17:51:54.999 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T17:51:55.000 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T17:51:55.000 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T17:51:55.000 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T17:51:55.000 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T17:51:55.000 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T17:51:55.000 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T17:51:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:51:56.620 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /sys 2024-09-13T17:51:56.620 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /proc 2024-09-13T17:51:56.620 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /mnt 2024-09-13T17:51:56.620 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /var/tmp 2024-09-13T17:51:56.620 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /home 2024-09-13T17:51:56.620 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /root 2024-09-13T17:51:56.620 INFO:teuthology.orchestra.run.smithi143.stdout:skipping the directory /tmp 2024-09-13T17:51:56.620 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:51:56.789 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:51:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:51:56.808 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:56.808 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T17:51:56.808 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:51:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:51:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:57.571 INFO:teuthology.orchestra.run.smithi122.stdout:Upgraded: 2024-09-13T17:51:57.571 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout:Installed: 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T17:51:57.572 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.573 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T17:51:57.574 INFO:teuthology.orchestra.run.smithi122.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T17:51:57.575 INFO:teuthology.orchestra.run.smithi122.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T17:51:57.576 INFO:teuthology.orchestra.run.smithi122.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T17:51:57.577 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T17:51:57.578 INFO:teuthology.orchestra.run.smithi122.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T17:51:57.579 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T17:51:57.580 INFO:teuthology.orchestra.run.smithi122.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T17:51:57.581 INFO:teuthology.orchestra.run.smithi122.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T17:51:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T17:51:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T17:51:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T17:51:57.582 INFO:teuthology.orchestra.run.smithi122.stdout: 2024-09-13T17:51:57.582 INFO:teuthology.orchestra.run.smithi122.stdout:Complete! 2024-09-13T17:51:57.990 DEBUG:teuthology.parallel:result is None 2024-09-13T17:51:58.252 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:51:58.277 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:51:58.278 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:58.278 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T17:51:58.278 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:51:58.278 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:51:58.278 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:51:58.477 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:51:58.500 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:51:58.500 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:58.500 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T17:51:58.500 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:51:58.500 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:51:58.500 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:51:58.936 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:51:58.958 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:51:58.958 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:51:58.958 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T17:51:58.958 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:51:58.958 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:51:58.959 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:51:59.069 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T17:51:59.115 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T17:51:59.169 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T17:51:59.352 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T17:51:59.403 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T17:51:59.473 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T17:51:59.560 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T17:51:59.699 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T17:51:59.753 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T17:51:59.785 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T17:51:59.813 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T17:52:00.144 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:52:00.170 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:52:00.199 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T17:52:00.262 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T17:52:00.296 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:52:01.327 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:52:01.362 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:52:02.327 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:52:02.353 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:52:02.454 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:52:02.610 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T17:52:02.648 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:52:02.672 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:52:02.672 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:02.672 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T17:52:02.672 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:52:02.672 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:52:02.672 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:52:02.715 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:52:02.726 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:52:02.812 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T17:52:02.855 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T17:52:03.567 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T17:52:03.601 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:52:03.624 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:52:03.624 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:03.625 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T17:52:03.625 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:52:03.625 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:52:03.625 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:52:03.668 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:52:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:52:03.691 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:03.691 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T17:52:03.691 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:52:03.736 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:52:03.759 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:52:03.759 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:03.759 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T17:52:03.759 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:52:03.759 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:52:03.759 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:52:04.053 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:52:04.076 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:52:04.076 INFO:teuthology.orchestra.run.smithi143.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:04.076 INFO:teuthology.orchestra.run.smithi143.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T17:52:04.076 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:52:04.076 INFO:teuthology.orchestra.run.smithi143.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:52:04.077 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:52:06.787 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T17:52:06.787 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /sys 2024-09-13T17:52:06.787 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /proc 2024-09-13T17:52:06.787 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /mnt 2024-09-13T17:52:06.787 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /var/tmp 2024-09-13T17:52:06.787 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /home 2024-09-13T17:52:06.787 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /root 2024-09-13T17:52:06.788 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /tmp 2024-09-13T17:52:06.788 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:07.013 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:52:07.051 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T17:52:07.051 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:07.051 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T17:52:07.051 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:07.740 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T17:52:07.782 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T17:52:07.822 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T17:52:07.854 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T17:52:08.030 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T17:52:08.078 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T17:52:08.099 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T17:52:08.129 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T17:52:08.167 INFO:teuthology.orchestra.run.smithi143.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T17:52:08.691 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:52:08.751 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T17:52:08.751 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:08.751 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T17:52:08.751 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:52:08.752 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T17:52:08.752 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:08.771 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:52:08.816 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:52:08.836 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:52:08.991 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:52:09.044 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T17:52:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T17:52:09.044 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:52:09.045 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T17:52:09.045 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:09.550 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:52:09.604 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T17:52:09.604 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:09.605 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T17:52:09.605 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:52:09.605 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T17:52:09.605 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:09.658 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T17:52:09.746 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T17:52:09.751 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T17:52:09.787 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T17:52:09.813 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T17:52:09.869 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T17:52:09.887 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T17:52:09.900 INFO:teuthology.orchestra.run.smithi143.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T17:52:09.917 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T17:52:09.951 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T17:52:09.951 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:52:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:52:10.035 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:52:10.119 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:52:10.134 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T17:52:10.144 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T17:52:10.149 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:52:10.149 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:52:10.197 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T17:52:10.287 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T17:52:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:52:10.329 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:52:10.421 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T17:52:10.422 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:52:10.485 INFO:teuthology.orchestra.run.smithi143.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:52:10.596 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T17:52:10.671 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T17:52:10.712 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T17:52:10.744 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T17:52:11.262 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:52:11.313 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T17:52:11.348 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T17:52:11.421 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T17:52:11.465 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:52:12.777 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T17:52:12.817 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:52:13.974 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T17:52:14.026 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:52:14.172 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T17:52:14.362 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T17:52:14.395 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:52:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T17:52:14.449 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:14.449 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T17:52:14.449 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:52:14.449 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T17:52:14.449 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:14.504 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:52:14.531 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T17:52:14.629 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T17:52:14.717 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T17:52:15.497 INFO:teuthology.orchestra.run.smithi143.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T17:52:15.498 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T17:52:15.499 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T17:52:15.500 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T17:52:15.501 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T17:52:15.502 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T17:52:15.503 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T17:52:15.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:52:15.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:52:15.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T17:52:15.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T17:52:15.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T17:52:15.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T17:52:15.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T17:52:15.504 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T17:52:15.505 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T17:52:15.505 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T17:52:15.505 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T17:52:15.505 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T17:52:15.506 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T17:52:15.507 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T17:52:15.508 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T17:52:15.509 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T17:52:15.510 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T17:52:15.510 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T17:52:15.510 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T17:52:15.510 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T17:52:15.510 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T17:52:15.510 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T17:52:15.510 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T17:52:15.555 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T17:52:15.760 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:52:15.815 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T17:52:15.815 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:15.816 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T17:52:15.816 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:52:15.816 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T17:52:15.816 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:15.982 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:52:16.036 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T17:52:16.036 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:16.036 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T17:52:16.036 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:16.107 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:52:16.161 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T17:52:16.161 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:16.161 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T17:52:16.161 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:52:16.161 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T17:52:16.161 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:16.641 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:52:16.696 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T17:52:16.696 INFO:teuthology.orchestra.run.smithi027.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T17:52:16.696 INFO:teuthology.orchestra.run.smithi027.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T17:52:16.696 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:52:16.696 INFO:teuthology.orchestra.run.smithi027.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T17:52:16.696 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:17.908 INFO:teuthology.orchestra.run.smithi143.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout:Upgraded: 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout:Installed: 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T17:52:17.909 INFO:teuthology.orchestra.run.smithi143.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.910 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.911 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T17:52:17.912 INFO:teuthology.orchestra.run.smithi143.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T17:52:17.913 INFO:teuthology.orchestra.run.smithi143.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T17:52:17.914 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi143.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi143.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi143.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi143.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.915 INFO:teuthology.orchestra.run.smithi143.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T17:52:17.916 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T17:52:17.917 INFO:teuthology.orchestra.run.smithi143.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T17:52:17.918 INFO:teuthology.orchestra.run.smithi143.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.919 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi143.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi143.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi143.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi143.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi143.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi143.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T17:52:17.920 INFO:teuthology.orchestra.run.smithi143.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T17:52:17.921 INFO:teuthology.orchestra.run.smithi143.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T17:52:17.921 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:52:17.921 INFO:teuthology.orchestra.run.smithi143.stdout:Complete! 2024-09-13T17:52:18.289 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:20.939 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T17:52:20.981 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T17:52:21.025 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T17:52:21.078 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T17:52:21.354 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T17:52:21.424 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T17:52:21.456 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T17:52:21.487 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T17:52:21.522 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T17:52:22.306 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:52:22.354 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:52:22.397 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T17:52:23.796 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T17:52:23.902 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T17:52:24.355 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T17:52:24.355 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T17:52:24.356 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T17:52:24.356 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T17:52:24.356 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T17:52:24.356 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:52:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T17:52:24.456 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:52:24.557 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T17:52:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T17:52:24.598 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:52:24.598 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:52:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T17:52:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:52:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T17:52:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:52:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:52:25.416 INFO:teuthology.orchestra.run.smithi027.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T17:52:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:30.643 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T17:52:30.644 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T17:52:30.645 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T17:52:30.646 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T17:52:30.647 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T17:52:30.648 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T17:52:30.649 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T17:52:30.650 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T17:52:30.651 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T17:52:30.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T17:52:30.653 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T17:52:30.654 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T17:52:30.655 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T17:52:30.655 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T17:52:30.655 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T17:52:30.655 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T17:52:32.832 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout:Upgraded: 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T17:52:32.833 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.834 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.835 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T17:52:32.836 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T17:52:32.837 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T17:52:32.838 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T17:52:32.839 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T17:52:32.840 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T17:52:32.841 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T17:52:32.842 INFO:teuthology.orchestra.run.smithi027.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T17:52:32.843 INFO:teuthology.orchestra.run.smithi027.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T17:52:32.844 INFO:teuthology.orchestra.run.smithi027.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T17:52:32.844 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T17:52:32.844 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T17:52:32.844 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:52:32.844 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2024-09-13T17:52:33.396 DEBUG:teuthology.parallel:result is None 2024-09-13T17:52:33.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:52:33.548 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T17:52:33.595 INFO:teuthology.orchestra.run.smithi027.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T17:52:33.596 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T17:52:33.596 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T17:52:33.598 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:52:33.749 DEBUG:teuthology.orchestra.run.smithi122:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T17:52:33.775 INFO:teuthology.orchestra.run.smithi122.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T17:52:33.775 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T17:52:33.775 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T17:52:33.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:52:33.931 DEBUG:teuthology.orchestra.run.smithi143:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T17:52:33.957 INFO:teuthology.orchestra.run.smithi143.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T17:52:33.958 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T17:52:33.958 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T17:52:33.960 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T17:52:33.960 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:52:33.960 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:52:34.021 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:52:34.021 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:52:34.054 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:52:34.054 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T17:52:34.085 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T17:52:34.086 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:52:34.086 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:52:34.149 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:52:34.253 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:52:34.253 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:52:34.284 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:52:34.355 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:52:34.356 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T17:52:34.382 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T17:52:34.450 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T17:52:34.450 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:52:34.450 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:52:34.509 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:52:34.612 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:52:34.612 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:52:34.638 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:52:34.707 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:52:34.707 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T17:52:34.733 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T17:52:34.799 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T17:52:34.799 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:52:34.800 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:52:34.863 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:52:34.962 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:52:34.962 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:52:34.988 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:52:35.054 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:52:35.054 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T17:52:35.079 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T17:52:35.143 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T17:52:35.342 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-13T17:52:35.342 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:52:35.342 INFO:tasks.cephadm:Cluster fsid is f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:52:35.342 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T17:52:35.343 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.27', 'mon.b': '172.21.15.122', 'mon.c': '172.21.15.143'} 2024-09-13T17:52:35.343 INFO:tasks.cephadm:First mon is mon.a on smithi027 2024-09-13T17:52:35.343 INFO:tasks.cephadm:First mgr is x 2024-09-13T17:52:35.343 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T17:52:35.343 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname $(hostname -s) 2024-09-13T17:52:35.407 DEBUG:teuthology.orchestra.run.smithi122:> sudo hostname $(hostname -s) 2024-09-13T17:52:35.431 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname $(hostname -s) 2024-09-13T17:52:35.460 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-13T17:52:35.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:52:35.617 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.4.58+omani008', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 17:57:22.919627', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['arm64', 'x86_64', 'source'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82954/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.4-860-g6c6b083f', 'node_name': '172.21.5.40+adami10', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.4-860.g6c6b083f'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 13:55:29.568955', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240910.100730-reef', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-13T17:52:35.767 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-rishabh-testing-20240910.100730-reef, sha1 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:52:35.768 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm 2024-09-13T17:52:35.769 DEBUG:teuthology.orchestra.run.smithi027:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T17:52:36.158 INFO:teuthology.orchestra.run.smithi027.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 17:52 /home/ubuntu/cephtest/cephadm 2024-09-13T17:52:36.159 DEBUG:teuthology.orchestra.run.smithi122:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T17:52:36.492 INFO:teuthology.orchestra.run.smithi122.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 17:52 /home/ubuntu/cephtest/cephadm 2024-09-13T17:52:36.492 DEBUG:teuthology.orchestra.run.smithi143:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T17:52:37.108 INFO:teuthology.orchestra.run.smithi143.stdout:-rw-r--r--. 1 ubuntu ubuntu 217223 Sep 13 17:52 /home/ubuntu/cephtest/cephadm 2024-09-13T17:52:37.108 DEBUG:teuthology.orchestra.run.smithi027:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T17:52:37.151 DEBUG:teuthology.orchestra.run.smithi122:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T17:52:37.171 DEBUG:teuthology.orchestra.run.smithi143:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T17:52:37.207 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 on all hosts... 2024-09-13T17:52:37.207 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 pull 2024-09-13T17:52:37.211 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 pull 2024-09-13T17:52:37.214 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 pull 2024-09-13T17:52:38.748 INFO:teuthology.orchestra.run.smithi122.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:52:38.763 INFO:teuthology.orchestra.run.smithi143.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:52:39.239 INFO:teuthology.orchestra.run.smithi027.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:53:11.889 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T17:53:11.889 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:53:11.889 INFO:teuthology.orchestra.run.smithi027.stdout: "image_id": "8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61", 2024-09-13T17:53:11.889 INFO:teuthology.orchestra.run.smithi027.stdout: "repo_digests": [ 2024-09-13T17:53:11.889 INFO:teuthology.orchestra.run.smithi027.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256" 2024-09-13T17:53:11.889 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T17:53:11.890 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T17:53:13.350 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-13T17:53:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:53:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: "image_id": "8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61", 2024-09-13T17:53:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: "repo_digests": [ 2024-09-13T17:53:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256" 2024-09-13T17:53:13.350 INFO:teuthology.orchestra.run.smithi122.stdout: ] 2024-09-13T17:53:13.350 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-13T17:53:29.182 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-13T17:53:29.182 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T17:53:29.182 INFO:teuthology.orchestra.run.smithi143.stdout: "image_id": "8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61", 2024-09-13T17:53:29.182 INFO:teuthology.orchestra.run.smithi143.stdout: "repo_digests": [ 2024-09-13T17:53:29.183 INFO:teuthology.orchestra.run.smithi143.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256" 2024-09-13T17:53:29.183 INFO:teuthology.orchestra.run.smithi143.stdout: ] 2024-09-13T17:53:29.183 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-13T17:53:29.201 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph 2024-09-13T17:53:29.269 DEBUG:teuthology.orchestra.run.smithi122:> sudo mkdir -p /etc/ceph 2024-09-13T17:53:29.301 DEBUG:teuthology.orchestra.run.smithi143:> sudo mkdir -p /etc/ceph 2024-09-13T17:53:29.330 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /etc/ceph 2024-09-13T17:53:29.390 DEBUG:teuthology.orchestra.run.smithi122:> sudo chmod 777 /etc/ceph 2024-09-13T17:53:29.420 DEBUG:teuthology.orchestra.run.smithi143:> sudo chmod 777 /etc/ceph 2024-09-13T17:53:29.446 INFO:tasks.cephadm:Writing seed config... 2024-09-13T17:53:29.447 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-13T17:53:29.447 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T17:53:29.447 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T17:53:29.447 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T17:53:29.447 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T17:53:29.447 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T17:53:29.447 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-13T17:53:29.448 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T17:53:29.449 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T17:53:29.450 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T17:53:29.451 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T17:53:29.451 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-13T17:53:29.451 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-13T17:53:29.451 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:53:29.452 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T17:53:29.489 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f5527e2e-71f8-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T17:53:29.489 DEBUG:teuthology.orchestra.run.smithi027:mon.a> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.a.service 2024-09-13T17:53:29.535 DEBUG:teuthology.orchestra.run.smithi027:mgr.x> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.x.service 2024-09-13T17:53:29.580 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T17:53:29.580 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 -v bootstrap --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.27 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:53:29.796 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2024-09-13T17:53:29.796 INFO:teuthology.orchestra.run.smithi027.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', '-v', 'bootstrap', '--fsid', 'f5527e2e-71f8-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.27', '--skip-admin-label'] 2024-09-13T17:53:29.843 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout 5.2.2 2024-09-13T17:53:29.843 INFO:teuthology.orchestra.run.smithi027.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T17:53:29.843 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying podman|docker is present... 2024-09-13T17:53:29.888 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout 5.2.2 2024-09-13T17:53:29.889 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying lvm2 is present... 2024-09-13T17:53:29.889 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying time synchronization is in place... 2024-09-13T17:53:29.903 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T17:53:29.903 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T17:53:29.915 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T17:53:29.916 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-13T17:53:29.930 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout enabled 2024-09-13T17:53:29.943 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout active 2024-09-13T17:53:29.943 INFO:teuthology.orchestra.run.smithi027.stdout:Unit chronyd.service is enabled and running 2024-09-13T17:53:29.943 INFO:teuthology.orchestra.run.smithi027.stdout:Repeating the final host check... 2024-09-13T17:53:29.987 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout 5.2.2 2024-09-13T17:53:29.987 INFO:teuthology.orchestra.run.smithi027.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T17:53:29.988 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl is present 2024-09-13T17:53:29.988 INFO:teuthology.orchestra.run.smithi027.stdout:lvcreate is present 2024-09-13T17:53:30.000 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T17:53:30.001 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T17:53:30.013 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T17:53:30.013 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-13T17:53:30.027 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout enabled 2024-09-13T17:53:30.039 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout active 2024-09-13T17:53:30.039 INFO:teuthology.orchestra.run.smithi027.stdout:Unit chronyd.service is enabled and running 2024-09-13T17:53:30.040 INFO:teuthology.orchestra.run.smithi027.stdout:Host looks OK 2024-09-13T17:53:30.040 INFO:teuthology.orchestra.run.smithi027.stdout:Cluster fsid: f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:53:30.040 INFO:teuthology.orchestra.run.smithi027.stdout:Acquiring lock 140544816968464 on /run/cephadm/f5527e2e-71f8-11ef-bceb-c7b262605968.lock 2024-09-13T17:53:30.040 INFO:teuthology.orchestra.run.smithi027.stdout:Lock 140544816968464 acquired on /run/cephadm/f5527e2e-71f8-11ef-bceb-c7b262605968.lock 2024-09-13T17:53:30.040 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying IP 172.21.15.27 port 3300 ... 2024-09-13T17:53:30.041 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying IP 172.21.15.27 port 6789 ... 2024-09-13T17:53:30.041 INFO:teuthology.orchestra.run.smithi027.stdout:Base mon IP(s) is [172.21.15.27:3300, 172.21.15.27:6789], mon addrv is [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-09-13T17:53:30.048 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.27 metric 100 2024-09-13T17:53:30.048 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.27 metric 100 2024-09-13T17:53:30.054 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T17:53:30.054 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-13T17:53:30.055 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-09-13T17:53:30.060 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T17:53:30.060 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T17:53:30.061 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T17:53:30.061 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-13T17:53:30.061 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-09-13T17:53:30.061 INFO:teuthology.orchestra.run.smithi027.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T17:53:30.061 INFO:teuthology.orchestra.run.smithi027.stdout:Mon IP `172.21.15.27` is in CIDR network `172.21.0.0/20` 2024-09-13T17:53:30.061 INFO:teuthology.orchestra.run.smithi027.stdout:Mon IP `172.21.15.27` is in CIDR network `172.21.0.0/20` 2024-09-13T17:53:30.061 INFO:teuthology.orchestra.run.smithi027.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T17:53:30.062 INFO:teuthology.orchestra.run.smithi027.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T17:53:30.063 INFO:teuthology.orchestra.run.smithi027.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:53:30.607 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stdout 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 2024-09-13T17:53:30.607 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3... 2024-09-13T17:53:30.607 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T17:53:30.607 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Copying blob sha256:cdfdf789b01393b98d7733e02a8d993977e2aa05d922747269d27c845cd4920c 2024-09-13T17:53:30.607 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T17:53:30.607 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Copying config sha256:8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 2024-09-13T17:53:30.607 INFO:teuthology.orchestra.run.smithi027.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T17:53:31.819 INFO:teuthology.orchestra.run.smithi027.stdout:ceph: stdout ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable) 2024-09-13T17:53:31.820 INFO:teuthology.orchestra.run.smithi027.stdout:Ceph version: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable) 2024-09-13T17:53:31.820 INFO:teuthology.orchestra.run.smithi027.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T17:53:32.977 INFO:teuthology.orchestra.run.smithi027.stdout:stat: stdout 167 167 2024-09-13T17:53:32.977 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial keys... 2024-09-13T17:53:34.104 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQAdfORmIG02GBAAdKm+6jmdFclc5gyNJA7BGg== 2024-09-13T17:53:35.151 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQAefORmrMToHBAA3UKH6nL6eDRwnqCexnsQIg== 2024-09-13T17:53:36.148 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph-authtool: stdout AQAffORmX+87HRAANquf+9KShNND5SDnC++qZA== 2024-09-13T17:53:36.149 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial monmap... 2024-09-13T17:53:37.213 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T17:53:37.213 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-09-13T17:53:37.214 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:53:37.214 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T17:53:37.214 INFO:teuthology.orchestra.run.smithi027.stdout:monmaptool for a [v2:172.21.15.27:3300,v1:172.21.15.27:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T17:53:37.214 INFO:teuthology.orchestra.run.smithi027.stdout:setting min_mon_release = pacific 2024-09-13T17:53:37.214 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: set fsid to f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:53:37.214 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T17:53:37.214 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:53:37.214 INFO:teuthology.orchestra.run.smithi027.stdout:Creating mon... 2024-09-13T17:53:38.201 INFO:teuthology.orchestra.run.smithi027.stdout:create mon.a on 2024-09-13T17:53:38.502 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T17:53:38.727 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T17:53:38.998 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968.target. 2024-09-13T17:53:38.998 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968.target. 2024-09-13T17:53:39.373 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.a 2024-09-13T17:53:39.374 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-13T17:53:39.649 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968.target.wants/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@.service. 2024-09-13T17:53:40.288 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:40 smithi027 podman[30221]: 2024-09-13 17:53:40.221971462 +0000 UTC m=+0.323769377 container start b405d3d376e4246b51dfb7b3f3fc7ed1231ca3fa5eca7e8e752e7d424770e99e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T17:53:40.318 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T17:53:40.318 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-13T17:53:40.332 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T17:53:40.332 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-13T17:53:40.333 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-13T17:53:40.333 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T17:53:40.333 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mon to start... 2024-09-13T17:53:40.333 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mon... 2024-09-13T17:53:40.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:40 smithi027 ceph-mon[30239]: mkfs f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:53:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:40 smithi027 ceph-mon[30239]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T17:53:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:40 smithi027 bash[30221]: b405d3d376e4246b51dfb7b3f3fc7ed1231ca3fa5eca7e8e752e7d424770e99e 2024-09-13T17:53:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:40 smithi027 systemd[1]: Started Ceph mon.a for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T17:53:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:41 smithi027 ceph-mon[30239]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T17:53:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:41 smithi027 ceph-mon[30239]: monmap e1: 1 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:53:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:41 smithi027 ceph-mon[30239]: fsmap 2024-09-13T17:53:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:41 smithi027 ceph-mon[30239]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T17:53:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:41 smithi027 ceph-mon[30239]: mgrmap e1: no daemons active 2024-09-13T17:53:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:41 smithi027 ceph-mon[30239]: from='client.? 172.21.15.27:0/4175516501' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T17:53:42.152 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T17:53:42.152 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout id: f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:53:42.152 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T17:53:42.152 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:42.152 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout services: 2024-09-13T17:53:42.152 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.667018s) 2024-09-13T17:53:42.152 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout data: 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.870+0000 7f6b68000640 1 Processor -- start 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.870+0000 7f6b68000640 1 -- start start 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.871+0000 7f6b68000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6007fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:42.153 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.871+0000 7f6b68000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60080390 con 0x7f6b6007f9c0 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.872+0000 7f6b65600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6007fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.872+0000 7f6b65600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6007fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52458/0 (socket says 172.21.15.27:52458) 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.872+0000 7f6b65600640 1 -- 172.21.15.27:0/8129286 learned_addr learned my addr 172.21.15.27:0/8129286 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.873+0000 7f6b65600640 1 -- 172.21.15.27:0/8129286 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6010d1b0 con 0x7f6b6007f9c0 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.875+0000 7f6b65600640 1 --2- 172.21.15.27:0/8129286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6007fdc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009820 tx=0x7f6b5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcf3f1abf3477ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.876+0000 7f6b5fe00640 1 -- 172.21.15.27:0/8129286 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b5402ae70 con 0x7f6b6007f9c0 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.876+0000 7f6b5fe00640 1 -- 172.21.15.27:0/8129286 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b54032440 con 0x7f6b6007f9c0 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.876+0000 7f6b5fe00640 1 -- 172.21.15.27:0/8129286 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b54032700 con 0x7f6b6007f9c0 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.876+0000 7f6b68000640 1 -- 172.21.15.27:0/8129286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 msgr2=0x7f6b6007fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.876+0000 7f6b68000640 1 --2- 172.21.15.27:0/8129286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6007fdc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009820 tx=0x7f6b5402a270 comp rx=0 tx=0).stop 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.876+0000 7f6b68000640 1 -- 172.21.15.27:0/8129286 shutdown_connections 2024-09-13T17:53:42.154 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.876+0000 7f6b68000640 1 --2- 172.21.15.27:0/8129286 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6007fdc0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.876+0000 7f6b68000640 1 -- 172.21.15.27:0/8129286 >> 172.21.15.27:0/8129286 conn(0x7f6b6007b1e0 msgr2=0x7f6b6007d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.877+0000 7f6b68000640 1 -- 172.21.15.27:0/8129286 shutdown_connections 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.877+0000 7f6b68000640 1 -- 172.21.15.27:0/8129286 wait complete. 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.878+0000 7f6b68000640 1 Processor -- start 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.878+0000 7f6b68000640 1 -- start start 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.878+0000 7f6b68000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.878+0000 7f6b68000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019f9c0 con 0x7f6b6007f9c0 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.878+0000 7f6b65600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.878+0000 7f6b65600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6019f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52472/0 (socket says 172.21.15.27:52472) 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.878+0000 7f6b65600640 1 -- 172.21.15.27:0/4175516501 learned_addr learned my addr 172.21.15.27:0/4175516501 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.879+0000 7f6b65600640 1 -- 172.21.15.27:0/4175516501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540094d0 con 0x7f6b6007f9c0 2024-09-13T17:53:42.155 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.879+0000 7f6b65600640 1 --2- 172.21.15.27:0/4175516501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6019f480 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6b540090b0 tx=0x7f6b540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.879+0000 7f6b5e000640 1 -- 172.21.15.27:0/4175516501 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b540308d0 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.879+0000 7f6b5e000640 1 -- 172.21.15.27:0/4175516501 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b54030a30 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.879+0000 7f6b5e000640 1 -- 172.21.15.27:0/4175516501 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6b54030cf0 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.879+0000 7f6b68000640 1 -- 172.21.15.27:0/4175516501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6019fbc0 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.879+0000 7f6b68000640 1 -- 172.21.15.27:0/4175516501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b601a0060 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.880+0000 7f6b5e000640 1 -- 172.21.15.27:0/4175516501 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6b54039040 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.880+0000 7f6b5e000640 1 -- 172.21.15.27:0/4175516501 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6b540468c0 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.881+0000 7f6b68000640 1 -- 172.21.15.27:0/4175516501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6010dd80 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.884+0000 7f6b5e000640 1 -- 172.21.15.27:0/4175516501 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f6b54037070 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.947+0000 7f6b68000640 1 -- 172.21.15.27:0/4175516501 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f6b6010d680 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.948+0000 7f6b5e000640 1 -- 172.21.15.27:0/4175516501 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f6b54046a80 con 0x7f6b6007f9c0 2024-09-13T17:53:42.156 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.948+0000 7f6b68000640 1 -- 172.21.15.27:0/4175516501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 msgr2=0x7f6b6019f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:42.157 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.948+0000 7f6b68000640 1 --2- 172.21.15.27:0/4175516501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6019f480 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6b540090b0 tx=0x7f6b540046c0 comp rx=0 tx=0).stop 2024-09-13T17:53:42.157 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.949+0000 7f6b68000640 1 -- 172.21.15.27:0/4175516501 shutdown_connections 2024-09-13T17:53:42.157 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.949+0000 7f6b68000640 1 --2- 172.21.15.27:0/4175516501 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6b6007f9c0 0x7f6b6019f480 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:42.157 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.949+0000 7f6b68000640 1 -- 172.21.15.27:0/4175516501 >> 172.21.15.27:0/4175516501 conn(0x7f6b6007b1e0 msgr2=0x7f6b601939b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:42.157 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.949+0000 7f6b68000640 1 -- 172.21.15.27:0/4175516501 shutdown_connections 2024-09-13T17:53:42.157 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:40.949+0000 7f6b68000640 1 -- 172.21.15.27:0/4175516501 wait complete. 2024-09-13T17:53:42.157 INFO:teuthology.orchestra.run.smithi027.stdout:mon is available 2024-09-13T17:53:42.157 INFO:teuthology.orchestra.run.smithi027.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T17:53:43.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:42 smithi027 ceph-mon[30239]: from='client.? 172.21.15.27:0/3548348521' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T17:53:43.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:42 smithi027 ceph-mon[30239]: from='client.? 172.21.15.27:0/3548348521' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout fsid = f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.27:3300,v1:172.21.15.27:6789] 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:43.512 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.754+0000 7f9665800640 1 Processor -- start 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.754+0000 7f9665800640 1 -- start start 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.754+0000 7f9665800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f9660108010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.513 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.754+0000 7f9665800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96601085e0 con 0x7f9660107c10 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.754+0000 7f965ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f9660108010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.755+0000 7f965ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f9660108010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52488/0 (socket says 172.21.15.27:52488) 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.755+0000 7f965ea00640 1 -- 172.21.15.27:0/3143303074 learned_addr learned my addr 172.21.15.27:0/3143303074 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.755+0000 7f965ea00640 1 -- 172.21.15.27:0/3143303074 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9660108d70 con 0x7f9660107c10 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.756+0000 7f965ea00640 1 --2- 172.21.15.27:0/3143303074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f9660108010 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9650009820 tx=0x7f965002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dd2a2acc83ed72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.756+0000 7f965d600640 1 -- 172.21.15.27:0/3143303074 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f965002ae70 con 0x7f9660107c10 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.757+0000 7f965d600640 1 -- 172.21.15.27:0/3143303074 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650032440 con 0x7f9660107c10 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.757+0000 7f965d600640 1 -- 172.21.15.27:0/3143303074 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9650032700 con 0x7f9660107c10 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.757+0000 7f9665800640 1 -- 172.21.15.27:0/3143303074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 msgr2=0x7f9660108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.757+0000 7f9665800640 1 --2- 172.21.15.27:0/3143303074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f9660108010 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9650009820 tx=0x7f965002a270 comp rx=0 tx=0).stop 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.757+0000 7f9665800640 1 -- 172.21.15.27:0/3143303074 shutdown_connections 2024-09-13T17:53:43.514 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.757+0000 7f9665800640 1 --2- 172.21.15.27:0/3143303074 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f9660108010 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.757+0000 7f9665800640 1 -- 172.21.15.27:0/3143303074 >> 172.21.15.27:0/3143303074 conn(0x7f966007b1f0 msgr2=0x7f966007b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.757+0000 7f9665800640 1 -- 172.21.15.27:0/3143303074 shutdown_connections 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.757+0000 7f9665800640 1 -- 172.21.15.27:0/3143303074 wait complete. 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.758+0000 7f9665800640 1 Processor -- start 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.759+0000 7f9665800640 1 -- start start 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.759+0000 7f9665800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f966007fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.759+0000 7f9665800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96600800b0 con 0x7f9660107c10 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.759+0000 7f965ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f966007fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.759+0000 7f965ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f966007fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52492/0 (socket says 172.21.15.27:52492) 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.759+0000 7f965ea00640 1 -- 172.21.15.27:0/3548348521 learned_addr learned my addr 172.21.15.27:0/3548348521 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.760+0000 7f965ea00640 1 -- 172.21.15.27:0/3548348521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500094d0 con 0x7f9660107c10 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.760+0000 7f965ea00640 1 --2- 172.21.15.27:0/3548348521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f966007fb70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f96500090b0 tx=0x7f96500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:43.515 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.760+0000 7f9657400640 1 -- 172.21.15.27:0/3548348521 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96500308d0 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.760+0000 7f9657400640 1 -- 172.21.15.27:0/3548348521 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650030a30 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.760+0000 7f9657400640 1 -- 172.21.15.27:0/3548348521 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9650030cf0 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.761+0000 7f9665800640 1 -- 172.21.15.27:0/3548348521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96600802b0 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.761+0000 7f9665800640 1 -- 172.21.15.27:0/3548348521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966007c6b0 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.761+0000 7f9657400640 1 -- 172.21.15.27:0/3548348521 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9650039040 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.761+0000 7f9657400640 1 -- 172.21.15.27:0/3548348521 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f96500468c0 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.762+0000 7f9665800640 1 -- 172.21.15.27:0/3548348521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9660109150 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.765+0000 7f9657400640 1 -- 172.21.15.27:0/3548348521 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f9650037070 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.827+0000 7f9665800640 1 -- 172.21.15.27:0/3548348521 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f96601092e0 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.831+0000 7f9657400640 1 -- 172.21.15.27:0/3548348521 <== mon.0 v2:172.21.15.27:3300/0 7 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f965004e840 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.831+0000 7f9657400640 1 -- 172.21.15.27:0/3548348521 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f9650046b80 con 0x7f9660107c10 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.833+0000 7f9665800640 1 -- 172.21.15.27:0/3548348521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 msgr2=0x7f966007fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:43.516 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.833+0000 7f9665800640 1 --2- 172.21.15.27:0/3548348521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f966007fb70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f96500090b0 tx=0x7f96500046c0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.833+0000 7f9665800640 1 -- 172.21.15.27:0/3548348521 shutdown_connections 2024-09-13T17:53:43.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.833+0000 7f9665800640 1 --2- 172.21.15.27:0/3548348521 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9660107c10 0x7f966007fb70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:43.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.833+0000 7f9665800640 1 -- 172.21.15.27:0/3548348521 >> 172.21.15.27:0/3548348521 conn(0x7f966007b1f0 msgr2=0x7f9660191ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:43.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.833+0000 7f9665800640 1 -- 172.21.15.27:0/3548348521 shutdown_connections 2024-09-13T17:53:43.517 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:42.833+0000 7f9665800640 1 -- 172.21.15.27:0/3548348521 wait complete. 2024-09-13T17:53:43.517 INFO:teuthology.orchestra.run.smithi027.stdout:Generating new minimal ceph.conf... 2024-09-13T17:53:44.492 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:44 smithi027 ceph-mon[30239]: from='client.? 172.21.15.27:0/1661079224' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:53:44.789 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.083+0000 7f562f200640 1 Processor -- start 2024-09-13T17:53:44.789 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.083+0000 7f562f200640 1 -- start start 2024-09-13T17:53:44.789 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.083+0000 7f562f200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f5630107dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.789 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.083+0000 7f562f200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5630108390 con 0x7f56301079c0 2024-09-13T17:53:44.789 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.084+0000 7f562de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f5630107dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.789 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.084+0000 7f562de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f5630107dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52508/0 (socket says 172.21.15.27:52508) 2024-09-13T17:53:44.789 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.084+0000 7f562de00640 1 -- 172.21.15.27:0/3453099382 learned_addr learned my addr 172.21.15.27:0/3453099382 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:44.789 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.084+0000 7f562de00640 1 -- 172.21.15.27:0/3453099382 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630108bc0 con 0x7f56301079c0 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.085+0000 7f562de00640 1 --2- 172.21.15.27:0/3453099382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f5630107dc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5620009820 tx=0x7f562002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f37799b897cd7e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.086+0000 7f562ca00640 1 -- 172.21.15.27:0/3453099382 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f562002ae70 con 0x7f56301079c0 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.086+0000 7f562ca00640 1 -- 172.21.15.27:0/3453099382 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f5620032900 con 0x7f56301079c0 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.086+0000 7f562ca00640 1 -- 172.21.15.27:0/3453099382 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56200309d0 con 0x7f56301079c0 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.086+0000 7f562f200640 1 -- 172.21.15.27:0/3453099382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 msgr2=0x7f5630107dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.086+0000 7f562f200640 1 --2- 172.21.15.27:0/3453099382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f5630107dc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5620009820 tx=0x7f562002a270 comp rx=0 tx=0).stop 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.086+0000 7f562f200640 1 -- 172.21.15.27:0/3453099382 shutdown_connections 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.086+0000 7f562f200640 1 --2- 172.21.15.27:0/3453099382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f5630107dc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.086+0000 7f562f200640 1 -- 172.21.15.27:0/3453099382 >> 172.21.15.27:0/3453099382 conn(0x7f56301033a0 msgr2=0x7f5630105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.086+0000 7f562f200640 1 -- 172.21.15.27:0/3453099382 shutdown_connections 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.087+0000 7f562f200640 1 -- 172.21.15.27:0/3453099382 wait complete. 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.087+0000 7f562f200640 1 Processor -- start 2024-09-13T17:53:44.790 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.088+0000 7f562f200640 1 -- start start 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.088+0000 7f562f200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f563019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.088+0000 7f562f200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563019bd10 con 0x7f56301079c0 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.088+0000 7f562de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f563019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.088+0000 7f562de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f563019b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52518/0 (socket says 172.21.15.27:52518) 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.088+0000 7f562de00640 1 -- 172.21.15.27:0/1661079224 learned_addr learned my addr 172.21.15.27:0/1661079224 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.089+0000 7f562de00640 1 -- 172.21.15.27:0/1661079224 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56200094d0 con 0x7f56301079c0 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.089+0000 7f562de00640 1 --2- 172.21.15.27:0/1661079224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f563019b7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f562002a790 tx=0x7f5620032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.089+0000 7f5626a00640 1 -- 172.21.15.27:0/1661079224 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5620032db0 con 0x7f56301079c0 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.089+0000 7f5626a00640 1 -- 172.21.15.27:0/1661079224 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f562003b8f0 con 0x7f56301079c0 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.089+0000 7f5626a00640 1 -- 172.21.15.27:0/1661079224 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f562003a6f0 con 0x7f56301079c0 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.089+0000 7f562f200640 1 -- 172.21.15.27:0/1661079224 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563019bf10 con 0x7f56301079c0 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.089+0000 7f562f200640 1 -- 172.21.15.27:0/1661079224 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f563019c3b0 con 0x7f56301079c0 2024-09-13T17:53:44.791 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.090+0000 7f5626a00640 1 -- 172.21.15.27:0/1661079224 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5620039040 con 0x7f56301079c0 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.090+0000 7f5626a00640 1 -- 172.21.15.27:0/1661079224 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5620044c10 con 0x7f56301079c0 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.091+0000 7f562f200640 1 -- 172.21.15.27:0/1661079224 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563010bdf0 con 0x7f56301079c0 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.093+0000 7f5626a00640 1 -- 172.21.15.27:0/1661079224 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f562003f020 con 0x7f56301079c0 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.155+0000 7f562f200640 1 -- 172.21.15.27:0/1661079224 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f563010bfb0 con 0x7f56301079c0 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.155+0000 7f5626a00640 1 -- 172.21.15.27:0/1661079224 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f5620037070 con 0x7f56301079c0 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.156+0000 7f562f200640 1 -- 172.21.15.27:0/1661079224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 msgr2=0x7f563019b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.156+0000 7f562f200640 1 --2- 172.21.15.27:0/1661079224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f563019b7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f562002a790 tx=0x7f5620032670 comp rx=0 tx=0).stop 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.157+0000 7f562f200640 1 -- 172.21.15.27:0/1661079224 shutdown_connections 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.157+0000 7f562f200640 1 --2- 172.21.15.27:0/1661079224 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56301079c0 0x7f563019b7d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.157+0000 7f562f200640 1 -- 172.21.15.27:0/1661079224 >> 172.21.15.27:0/1661079224 conn(0x7f56301033a0 msgr2=0x7f5630104fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.157+0000 7f562f200640 1 -- 172.21.15.27:0/1661079224 shutdown_connections 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:44.157+0000 7f562f200640 1 -- 172.21.15.27:0/1661079224 wait complete. 2024-09-13T17:53:44.792 INFO:teuthology.orchestra.run.smithi027.stdout:Restarting the monitor... 2024-09-13T17:53:45.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:44 smithi027 systemd[1]: Stopping Ceph mon.a for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T17:53:45.424 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:45 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a[30235]: 2024-09-13T17:53:45.166+0000 7fccc3000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T17:53:45.424 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:45 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a[30235]: 2024-09-13T17:53:45.166+0000 7fccc3000640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T17:53:45.745 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:45 smithi027 podman[30487]: 2024-09-13 17:53:45.423242642 +0000 UTC m=+0.396402718 container died b405d3d376e4246b51dfb7b3f3fc7ed1231ca3fa5eca7e8e752e7d424770e99e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-13T17:53:46.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:45 smithi027 podman[30487]: 2024-09-13 17:53:45.837845502 +0000 UTC m=+0.811005577 container cleanup b405d3d376e4246b51dfb7b3f3fc7ed1231ca3fa5eca7e8e752e7d424770e99e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-13T17:53:46.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:45 smithi027 bash[30487]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a 2024-09-13T17:53:46.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 podman[30499]: 2024-09-13 17:53:46.113969625 +0000 UTC m=+0.672808957 container remove b405d3d376e4246b51dfb7b3f3fc7ed1231ca3fa5eca7e8e752e7d424770e99e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T17:53:46.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 systemd[1]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-13T17:53:46.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 systemd[1]: Stopped Ceph mon.a for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T17:53:46.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 systemd[1]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.a.service: Consumed 1.245s CPU time. 2024-09-13T17:53:46.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 systemd[1]: Starting Ceph mon.a for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T17:53:46.886 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 podman[30592]: 2024-09-13 17:53:46.506513434 +0000 UTC m=+0.028359184 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:53:46.886 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 podman[30592]: 2024-09-13 17:53:46.628827172 +0000 UTC m=+0.150672922 container create 29c954fa87cfe000e7caf8e15b6200c66f19afb8b5c73bbb4eac4254553d7271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:53:46.968 INFO:teuthology.orchestra.run.smithi027.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T17:53:47.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 podman[30592]: 2024-09-13 17:53:46.884847127 +0000 UTC m=+0.406692888 container init 29c954fa87cfe000e7caf8e15b6200c66f19afb8b5c73bbb4eac4254553d7271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T17:53:47.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 podman[30592]: 2024-09-13 17:53:46.892484816 +0000 UTC m=+0.414330567 container start 29c954fa87cfe000e7caf8e15b6200c66f19afb8b5c73bbb4eac4254553d7271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2) 2024-09-13T17:53:47.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T17:53:47.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T17:53:47.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: pidfile_write: ignore empty --pid-file 2024-09-13T17:53:47.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: load: jerasure load: lrc 2024-09-13T17:53:47.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: RocksDB version: 7.9.2 2024-09-13T17:53:47.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Git sha 0 2024-09-13T17:53:47.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: DB SUMMARY 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: DB Session ID: Y8D78HTK9RXQBPM9QWE3 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: CURRENT file: CURRENT 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 101789 ; 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.error_if_exists: 0 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.create_if_missing: 0 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.paranoid_checks: 1 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T17:53:47.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.env: 0x55fc0349ebc0 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.info_log: 0x55fc342c2b40 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.statistics: (nil) 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.use_fsync: 0 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_log_file_size: 0 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T17:53:47.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.allow_fallocate: 1 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.use_direct_reads: 0 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.db_log_dir: 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.wal_dir: 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T17:53:47.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.write_buffer_manager: 0x55fc342d0320 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T17:53:47.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.unordered_write: 0 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.row_cache: None 2024-09-13T17:53:47.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.wal_filter: None 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.two_write_queues: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.wal_compression: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.atomic_flush: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.log_readahead_size: 0 2024-09-13T17:53:47.233 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_background_jobs: 2 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_background_compactions: -1 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_subcompactions: 1 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T17:53:47.234 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_open_files: -1 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_background_flushes: -1 2024-09-13T17:53:47.235 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Compression algorithms supported: 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: kZSTD supported: 0 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: kXpressCompression supported: 0 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: kBZip2Compression supported: 0 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: kLZ4Compression supported: 1 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: kZlibCompression supported: 1 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: kSnappyCompression supported: 1 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T17:53:47.236 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.merge_operator: 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_filter: None 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fc342c2760) 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout: cache_index_and_filter_blocks: 1 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T17:53:47.237 INFO:journalctl@ceph.mon.a.smithi027.stdout: pin_top_level_index_and_filter: 1 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: index_type: 0 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: data_block_index_type: 0 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: index_shortening: 1 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: checksum: 4 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: no_block_cache: 0 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_cache: 0x55fc342b7350 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_cache_name: BinnedLRUCache 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_cache_options: 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: capacity : 536870912 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: num_shard_bits : 4 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: strict_capacity_limit : 0 2024-09-13T17:53:47.238 INFO:journalctl@ceph.mon.a.smithi027.stdout: high_pri_pool_ratio: 0.000 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_cache_compressed: (nil) 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: persistent_cache: (nil) 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_size: 4096 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_size_deviation: 10 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_restart_interval: 16 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: index_block_restart_interval: 1 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: metadata_block_size: 4096 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: partition_filters: 0 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: use_delta_encoding: 1 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: filter_policy: bloomfilter 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: whole_key_filtering: 1 2024-09-13T17:53:47.239 INFO:journalctl@ceph.mon.a.smithi027.stdout: verify_compression: 0 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout: read_amp_bytes_per_bit: 0 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout: format_version: 5 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout: enable_index_compression: 1 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout: block_align: 0 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout: max_auto_readahead_size: 262144 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout: prepopulate_block_cache: 0 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout: initial_auto_readahead_size: 8192 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T17:53:47.240 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression: NoCompression 2024-09-13T17:53:47.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T17:53:47.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T17:53:47.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T17:53:47.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.num_levels: 7 2024-09-13T17:53:47.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T17:53:47.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:53:47.245 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T17:53:47.246 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T17:53:47.247 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T17:53:47.248 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T17:53:47.249 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T17:53:47.249 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T17:53:47.249 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T17:53:47.249 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T17:53:47.249 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T17:53:47.249 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T17:53:47.249 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.inplace_update_support: 0 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.bloom_locality: 0 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.max_successive_merges: 0 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.ttl: 2592000 2024-09-13T17:53:47.250 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.enable_blob_files: false 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.min_blob_size: 0 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T17:53:47.251 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f0831293-7d3d-4f2c-b723-006495cfef9b 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250026936219, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250026938322, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 96783, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 326, "table_properties": {"data_size": 94682, "index_size": 293, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14376, "raw_average_key_size": 50, "raw_value_size": 86924, "raw_average_value_size": 304, "num_data_blocks": 11, "num_entries": 285, "num_filter_entries": 285, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726250026, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f0831293-7d3d-4f2c-b723-006495cfef9b", "db_session_id": "Y8D78HTK9RXQBPM9QWE3", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250026938525, "job": 1, "event": "recovery_finished"} 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fc342e4e00 2024-09-13T17:53:47.252 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: DB pointer 0x55fc343d8000 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout: ** DB Stats ** 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:53:47.253 INFO:journalctl@ceph.mon.a.smithi027.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: ** Compaction Stats [default] ** 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: L0 2/0 96.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 65.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: Sum 2/0 96.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 65.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 65.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: ** Compaction Stats [default] ** 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 65.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-13T17:53:47.254 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: Cumulative compaction: 0.00 GB write, 14.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: Interval compaction: 0.00 GB write, 14.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T17:53:47.255 INFO:journalctl@ceph.mon.a.smithi027.stdout: Block cache BinnedLRUCache@0x55fc342b7350#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: starting mon.a rank 0 at public addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] at bind addrs [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: mon.a@-1(???) e1 preinit fsid f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: mon.a@-1(???).mds e1 new map 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: mon.a@-1(???).mds e1 print_map 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout: e1 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:53:47.256 INFO:journalctl@ceph.mon.a.smithi027.stdout: legacy client fscid: -1 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout: 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout: No filesystems configured 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 ceph-mon[30611]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 bash[30592]: 29c954fa87cfe000e7caf8e15b6200c66f19afb8b5c73bbb4eac4254553d7271 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:46 smithi027 systemd[1]: Started Ceph mon.a for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:47 smithi027 ceph-mon[30611]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-13T17:53:47.257 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:47 smithi027 ceph-mon[30611]: monmap e1: 1 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:53:47.258 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:47 smithi027 ceph-mon[30611]: fsmap 2024-09-13T17:53:47.258 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:47 smithi027 ceph-mon[30611]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T17:53:47.258 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:47 smithi027 ceph-mon[30611]: mgrmap e1: no daemons active 2024-09-13T17:53:48.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.481+0000 7f38a6e00640 1 Processor -- start 2024-09-13T17:53:48.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.481+0000 7f38a6e00640 1 -- start start 2024-09-13T17:53:48.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.482+0000 7f38a6e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a007fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.482+0000 7f38a6e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a0080390 con 0x7f38a007f9c0 2024-09-13T17:53:48.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.482+0000 7f389fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a007fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.482+0000 7f389fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a007fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52522/0 (socket says 172.21.15.27:52522) 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.482+0000 7f389fe00640 1 -- 172.21.15.27:0/4246207430 learned_addr learned my addr 172.21.15.27:0/4246207430 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.483+0000 7f389fe00640 1 -- 172.21.15.27:0/4246207430 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a010d1b0 con 0x7f38a007f9c0 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.486+0000 7f389fe00640 1 --2- 172.21.15.27:0/4246207430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a007fdc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3890009820 tx=0x7f389002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b336b910ceaa53e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.486+0000 7f389f400640 1 -- 172.21.15.27:0/4246207430 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f389002ae70 con 0x7f38a007f9c0 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.486+0000 7f389f400640 1 -- 172.21.15.27:0/4246207430 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f3890032900 con 0x7f38a007f9c0 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.486+0000 7f389f400640 1 -- 172.21.15.27:0/4246207430 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38900309d0 con 0x7f38a007f9c0 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.487+0000 7f38a6e00640 1 -- 172.21.15.27:0/4246207430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 msgr2=0x7f38a007fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.487+0000 7f38a6e00640 1 --2- 172.21.15.27:0/4246207430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a007fdc0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3890009820 tx=0x7f389002a270 comp rx=0 tx=0).stop 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.487+0000 7f38a6e00640 1 -- 172.21.15.27:0/4246207430 shutdown_connections 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.487+0000 7f38a6e00640 1 --2- 172.21.15.27:0/4246207430 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a007fdc0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.487+0000 7f38a6e00640 1 -- 172.21.15.27:0/4246207430 >> 172.21.15.27:0/4246207430 conn(0x7f38a007b1e0 msgr2=0x7f38a007d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:48.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.487+0000 7f38a6e00640 1 -- 172.21.15.27:0/4246207430 shutdown_connections 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.487+0000 7f38a6e00640 1 -- 172.21.15.27:0/4246207430 wait complete. 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.488+0000 7f38a6e00640 1 Processor -- start 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.488+0000 7f38a6e00640 1 -- start start 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.489+0000 7f38a6e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.489+0000 7f38a6e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01a0260 con 0x7f38a007f9c0 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.489+0000 7f389fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.489+0000 7f389fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52528/0 (socket says 172.21.15.27:52528) 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.489+0000 7f389fe00640 1 -- 172.21.15.27:0/2496253989 learned_addr learned my addr 172.21.15.27:0/2496253989 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.489+0000 7f389fe00640 1 -- 172.21.15.27:0/2496253989 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900094d0 con 0x7f38a007f9c0 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.490+0000 7f389fe00640 1 --2- 172.21.15.27:0/2496253989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a019fd20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f38900306e0 tx=0x7f3890032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.490+0000 7f389d600640 1 -- 172.21.15.27:0/2496253989 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3890032db0 con 0x7f38a007f9c0 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.490+0000 7f389d600640 1 -- 172.21.15.27:0/2496253989 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f389003b8f0 con 0x7f38a007f9c0 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.490+0000 7f38a6e00640 1 -- 172.21.15.27:0/2496253989 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a01a0460 con 0x7f38a007f9c0 2024-09-13T17:53:48.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.490+0000 7f389d600640 1 -- 172.21.15.27:0/2496253989 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f389003a800 con 0x7f38a007f9c0 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.490+0000 7f38a6e00640 1 -- 172.21.15.27:0/2496253989 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a01a0900 con 0x7f38a007f9c0 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.490+0000 7f389d600640 1 -- 172.21.15.27:0/2496253989 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3890039040 con 0x7f38a007f9c0 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.490+0000 7f389d600640 1 -- 172.21.15.27:0/2496253989 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3890044cb0 con 0x7f38a007f9c0 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.491+0000 7f38a6e00640 1 -- 172.21.15.27:0/2496253989 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a01103e0 con 0x7f38a007f9c0 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.494+0000 7f389d600640 1 -- 172.21.15.27:0/2496253989 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f389003f020 con 0x7f38a007f9c0 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.555+0000 7f38a6e00640 1 -- 172.21.15.27:0/2496253989 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f38a01105f0 con 0x7f38a007f9c0 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.558+0000 7f389d600640 1 -- 172.21.15.27:0/2496253989 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3890037070 con 0x7f38a007f9c0 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.559+0000 7f38a6e00640 1 -- 172.21.15.27:0/2496253989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 msgr2=0x7f38a019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.559+0000 7f38a6e00640 1 --2- 172.21.15.27:0/2496253989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a019fd20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f38900306e0 tx=0x7f3890032670 comp rx=0 tx=0).stop 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.559+0000 7f38a6e00640 1 -- 172.21.15.27:0/2496253989 shutdown_connections 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.559+0000 7f38a6e00640 1 --2- 172.21.15.27:0/2496253989 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f38a007f9c0 0x7f38a019fd20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.559+0000 7f38a6e00640 1 -- 172.21.15.27:0/2496253989 >> 172.21.15.27:0/2496253989 conn(0x7f38a007b1e0 msgr2=0x7f38a007bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.559+0000 7f38a6e00640 1 -- 172.21.15.27:0/2496253989 shutdown_connections 2024-09-13T17:53:48.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:47.559+0000 7f38a6e00640 1 -- 172.21.15.27:0/2496253989 wait complete. 2024-09-13T17:53:48.222 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T17:53:48.240 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:53:48.240 INFO:teuthology.orchestra.run.smithi027.stdout:Creating mgr... 2024-09-13T17:53:48.241 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T17:53:48.241 INFO:teuthology.orchestra.run.smithi027.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T17:53:48.596 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.x 2024-09-13T17:53:48.596 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-13T17:53:48.859 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968.target.wants/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@.service. 2024-09-13T17:53:48.886 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:48 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2496253989' entity='client.admin' 2024-09-13T17:53:49.204 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:48 smithi027 systemd[1]: Starting Ceph mgr.x for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T17:53:49.460 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:49 smithi027 podman[30821]: 2024-09-13 17:53:49.106819893 +0000 UTC m=+0.028166644 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:53:49.461 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:49 smithi027 podman[30821]: 2024-09-13 17:53:49.208663618 +0000 UTC m=+0.130010365 container create 5049dcf0971f6353f18900dfbf60fbc5226c0a3f0ba68ea80640dd8158649808 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T17:53:49.461 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:49 smithi027 podman[30821]: 2024-09-13 17:53:49.452926151 +0000 UTC m=+0.374272903 container init 5049dcf0971f6353f18900dfbf60fbc5226c0a3f0ba68ea80640dd8158649808 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T17:53:49.461 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:49 smithi027 podman[30821]: 2024-09-13 17:53:49.459178816 +0000 UTC m=+0.380525568 container start 5049dcf0971f6353f18900dfbf60fbc5226c0a3f0ba68ea80640dd8158649808 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T17:53:49.565 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T17:53:49.565 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-13T17:53:49.580 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T17:53:49.580 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-13T17:53:49.580 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-13T17:53:49.581 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T17:53:49.597 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T17:53:49.597 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-13T17:53:49.612 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T17:53:49.612 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-13T17:53:49.613 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-13T17:53:49.613 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-13T17:53:49.613 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr to start... 2024-09-13T17:53:49.613 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr... 2024-09-13T17:53:49.720 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:49 smithi027 bash[30821]: 5049dcf0971f6353f18900dfbf60fbc5226c0a3f0ba68ea80640dd8158649808 2024-09-13T17:53:49.721 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:49 smithi027 systemd[1]: Started Ceph mgr.x for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T17:53:49.721 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:49 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:49.634+0000 7f3888171040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:53:49.721 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:49 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:49.718+0000 7f3888171040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:53:50.005 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:49 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:49.919+0000 7f3888171040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:53:50.005 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:50 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:50.003+0000 7f3888171040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:53:50.266 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:50 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:50.181+0000 7f3888171040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:53:50.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:50 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3707506862' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T17:53:50.557 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:50 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:50.359+0000 7f3888171040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:53:50.929 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:50 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:50.748+0000 7f3888171040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:53:50.929 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:50 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:50.823+0000 7f3888171040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:53:50.933 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:50.934 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:53:50.934 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T17:53:50.934 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T17:53:50.934 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T17:53:50.934 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T17:53:50.934 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T17:53:50.934 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:50.935 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T17:53:50.936 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T17:53:50.936 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-09-13T17:53:50.936 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:53:50.936 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T17:53:50.937 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T17:53:50.945 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T17:53:50.946 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T17:53:40.283463+0000", 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:53:50.947 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.187+0000 7f56f1000640 1 Processor -- start 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.188+0000 7f56f1000640 1 -- start start 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.188+0000 7f56f1000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec108020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.188+0000 7f56f1000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec1085f0 con 0x7f56ec107c20 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.189+0000 7f56e9e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.189+0000 7f56e9e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:32910/0 (socket says 172.21.15.27:32910) 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.189+0000 7f56e9e00640 1 -- 172.21.15.27:0/183035019 learned_addr learned my addr 172.21.15.27:0/183035019 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.189+0000 7f56e9e00640 1 -- 172.21.15.27:0/183035019 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec108dd0 con 0x7f56ec107c20 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.190+0000 7f56e9e00640 1 --2- 172.21.15.27:0/183035019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec108020 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009820 tx=0x7f56dc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d010e66ecad3e2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.191+0000 7f56e8a00640 1 -- 172.21.15.27:0/183035019 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56dc02ae70 con 0x7f56ec107c20 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.191+0000 7f56e8a00640 1 -- 172.21.15.27:0/183035019 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f56dc032900 con 0x7f56ec107c20 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.191+0000 7f56e8a00640 1 -- 172.21.15.27:0/183035019 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56dc0309d0 con 0x7f56ec107c20 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.191+0000 7f56f1000640 1 -- 172.21.15.27:0/183035019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 msgr2=0x7f56ec108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.948 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.191+0000 7f56f1000640 1 --2- 172.21.15.27:0/183035019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec108020 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009820 tx=0x7f56dc02a270 comp rx=0 tx=0).stop 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.192+0000 7f56f1000640 1 -- 172.21.15.27:0/183035019 shutdown_connections 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.192+0000 7f56f1000640 1 --2- 172.21.15.27:0/183035019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec108020 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.192+0000 7f56f1000640 1 -- 172.21.15.27:0/183035019 >> 172.21.15.27:0/183035019 conn(0x7f56ec07b250 msgr2=0x7f56ec07b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.192+0000 7f56f1000640 1 -- 172.21.15.27:0/183035019 shutdown_connections 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.192+0000 7f56f1000640 1 -- 172.21.15.27:0/183035019 wait complete. 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.193+0000 7f56f1000640 1 Processor -- start 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.193+0000 7f56f1000640 1 -- start start 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.193+0000 7f56f1000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec19b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.193+0000 7f56f1000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ec19bea0 con 0x7f56ec107c20 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.193+0000 7f56e9e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec19b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.194+0000 7f56e9e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec19b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:32924/0 (socket says 172.21.15.27:32924) 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.194+0000 7f56e9e00640 1 -- 172.21.15.27:0/3707506862 learned_addr learned my addr 172.21.15.27:0/3707506862 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.194+0000 7f56e9e00640 1 -- 172.21.15.27:0/3707506862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0094d0 con 0x7f56ec107c20 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.194+0000 7f56e9e00640 1 --2- 172.21.15.27:0/3707506862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec19b960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f56dc02a790 tx=0x7f56dc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:50.949 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.194+0000 7f56e2a00640 1 -- 172.21.15.27:0/3707506862 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56dc032db0 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.194+0000 7f56e2a00640 1 -- 172.21.15.27:0/3707506862 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f56dc03b8f0 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.195+0000 7f56f1000640 1 -- 172.21.15.27:0/3707506862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ec19c0a0 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.195+0000 7f56e2a00640 1 -- 172.21.15.27:0/3707506862 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56dc03a6f0 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.195+0000 7f56f1000640 1 -- 172.21.15.27:0/3707506862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ec19c540 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.195+0000 7f56e2a00640 1 -- 172.21.15.27:0/3707506862 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f56dc039040 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.195+0000 7f56e2a00640 1 -- 172.21.15.27:0/3707506862 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f56dc044cb0 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.196+0000 7f56f1000640 1 -- 172.21.15.27:0/3707506862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ec10c000 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.198+0000 7f56e2a00640 1 -- 172.21.15.27:0/3707506862 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f56dc03f020 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.263+0000 7f56f1000640 1 -- 172.21.15.27:0/3707506862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f56ec10c1c0 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.264+0000 7f56e2a00640 1 -- 172.21.15.27:0/3707506862 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f56dc037070 con 0x7f56ec107c20 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.265+0000 7f56f1000640 1 -- 172.21.15.27:0/3707506862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 msgr2=0x7f56ec19b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.265+0000 7f56f1000640 1 --2- 172.21.15.27:0/3707506862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec19b960 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f56dc02a790 tx=0x7f56dc032670 comp rx=0 tx=0).stop 2024-09-13T17:53:50.950 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.265+0000 7f56f1000640 1 -- 172.21.15.27:0/3707506862 shutdown_connections 2024-09-13T17:53:50.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.265+0000 7f56f1000640 1 --2- 172.21.15.27:0/3707506862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56ec107c20 0x7f56ec19b960 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:50.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.265+0000 7f56f1000640 1 -- 172.21.15.27:0/3707506862 >> 172.21.15.27:0/3707506862 conn(0x7f56ec07b250 msgr2=0x7f56ec105680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:50.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.265+0000 7f56f1000640 1 -- 172.21.15.27:0/3707506862 shutdown_connections 2024-09-13T17:53:50.951 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:50.266+0000 7f56f1000640 1 -- 172.21.15.27:0/3707506862 wait complete. 2024-09-13T17:53:50.951 INFO:teuthology.orchestra.run.smithi027.stdout:mgr not available, waiting (1/15)... 2024-09-13T17:53:51.306 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:51.047+0000 7f3888171040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:53:52.556 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:52 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:52.189+0000 7f3888171040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:53:52.556 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:52 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:52.271+0000 7f3888171040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:53:53.274 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:53 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:53.265+0000 7f3888171040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:53:53.662 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:53 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1182563040' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T17:53:53.662 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:53 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:53.409+0000 7f3888171040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:53:53.662 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:53 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:53.585+0000 7f3888171040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:53:53.935 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:53 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:53.668+0000 7f3888171040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:53:53.935 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:53 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:53.845+0000 7f3888171040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:53:53.935 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:53 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:53.932+0000 7f3888171040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:53:54.198 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:54.007+0000 7f3888171040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:53:54.391 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T17:53:54.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T17:53:54.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T17:53:54.401 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:53:54.402 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T17:53:40.283463+0000", 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.469+0000 7f6685200640 1 Processor -- start 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.469+0000 7f6685200640 1 -- start start 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.469+0000 7f6685200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f6680108010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.469+0000 7f6685200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66801085e0 con 0x7f6680107c10 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.470+0000 7f667de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f6680108010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.403 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.470+0000 7f667de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f6680108010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:32936/0 (socket says 172.21.15.27:32936) 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.470+0000 7f667de00640 1 -- 172.21.15.27:0/585772047 learned_addr learned my addr 172.21.15.27:0/585772047 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.470+0000 7f667de00640 1 -- 172.21.15.27:0/585772047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680108d70 con 0x7f6680107c10 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.471+0000 7f667de00640 1 --2- 172.21.15.27:0/585772047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f6680108010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6670009820 tx=0x7f667002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0fe6e713c2fef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.472+0000 7f667ca00640 1 -- 172.21.15.27:0/585772047 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f667002ae70 con 0x7f6680107c10 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.472+0000 7f667ca00640 1 -- 172.21.15.27:0/585772047 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f6670032900 con 0x7f6680107c10 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.472+0000 7f667ca00640 1 -- 172.21.15.27:0/585772047 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66700309d0 con 0x7f6680107c10 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.472+0000 7f6685200640 1 -- 172.21.15.27:0/585772047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 msgr2=0x7f6680108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.472+0000 7f6685200640 1 --2- 172.21.15.27:0/585772047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f6680108010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6670009820 tx=0x7f667002a270 comp rx=0 tx=0).stop 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.472+0000 7f6685200640 1 -- 172.21.15.27:0/585772047 shutdown_connections 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.472+0000 7f6685200640 1 --2- 172.21.15.27:0/585772047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f6680108010 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.472+0000 7f6685200640 1 -- 172.21.15.27:0/585772047 >> 172.21.15.27:0/585772047 conn(0x7f668007b1f0 msgr2=0x7f668007b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.473+0000 7f6685200640 1 -- 172.21.15.27:0/585772047 shutdown_connections 2024-09-13T17:53:54.404 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.473+0000 7f6685200640 1 -- 172.21.15.27:0/585772047 wait complete. 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.473+0000 7f6685200640 1 Processor -- start 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.474+0000 7f6685200640 1 -- start start 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.474+0000 7f6685200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f668019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.474+0000 7f6685200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668019bf60 con 0x7f6680107c10 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.474+0000 7f667de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f668019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.474+0000 7f667de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f668019ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:32946/0 (socket says 172.21.15.27:32946) 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.474+0000 7f667de00640 1 -- 172.21.15.27:0/1182563040 learned_addr learned my addr 172.21.15.27:0/1182563040 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.475+0000 7f667de00640 1 -- 172.21.15.27:0/1182563040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66700094d0 con 0x7f6680107c10 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.475+0000 7f667de00640 1 --2- 172.21.15.27:0/1182563040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f668019ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f667002a790 tx=0x7f6670032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.475+0000 7f6676a00640 1 -- 172.21.15.27:0/1182563040 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6670032db0 con 0x7f6680107c10 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.475+0000 7f6685200640 1 -- 172.21.15.27:0/1182563040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668019c160 con 0x7f6680107c10 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.475+0000 7f6676a00640 1 -- 172.21.15.27:0/1182563040 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f667003b8f0 con 0x7f6680107c10 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.475+0000 7f6676a00640 1 -- 172.21.15.27:0/1182563040 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f667003a6f0 con 0x7f6680107c10 2024-09-13T17:53:54.405 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.475+0000 7f6685200640 1 -- 172.21.15.27:0/1182563040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668019c600 con 0x7f6680107c10 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.476+0000 7f6676a00640 1 -- 172.21.15.27:0/1182563040 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6670039040 con 0x7f6680107c10 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.476+0000 7f6676a00640 1 -- 172.21.15.27:0/1182563040 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6670044c60 con 0x7f6680107c10 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.476+0000 7f6685200640 1 -- 172.21.15.27:0/1182563040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668010bfa0 con 0x7f6680107c10 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.479+0000 7f6676a00640 1 -- 172.21.15.27:0/1182563040 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f667003f020 con 0x7f6680107c10 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.544+0000 7f6685200640 1 -- 172.21.15.27:0/1182563040 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f668010c160 con 0x7f6680107c10 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.545+0000 7f6676a00640 1 -- 172.21.15.27:0/1182563040 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f6670037070 con 0x7f6680107c10 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.546+0000 7f6685200640 1 -- 172.21.15.27:0/1182563040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 msgr2=0x7f668019ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.546+0000 7f6685200640 1 --2- 172.21.15.27:0/1182563040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f668019ba20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f667002a790 tx=0x7f6670032670 comp rx=0 tx=0).stop 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.546+0000 7f6685200640 1 -- 172.21.15.27:0/1182563040 shutdown_connections 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.546+0000 7f6685200640 1 --2- 172.21.15.27:0/1182563040 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6680107c10 0x7f668019ba20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.546+0000 7f6685200640 1 -- 172.21.15.27:0/1182563040 >> 172.21.15.27:0/1182563040 conn(0x7f668007b1f0 msgr2=0x7f6680105700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.546+0000 7f6685200640 1 -- 172.21.15.27:0/1182563040 shutdown_connections 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:53.546+0000 7f6685200640 1 -- 172.21.15.27:0/1182563040 wait complete. 2024-09-13T17:53:54.406 INFO:teuthology.orchestra.run.smithi027.stdout:mgr not available, waiting (2/15)... 2024-09-13T17:53:54.463 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:54.195+0000 7f3888171040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:53:54.463 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:54.275+0000 7f3888171040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:53:54.464 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:54.358+0000 7f3888171040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:53:54.464 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:54.460+0000 7f3888171040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:53:54.806 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:54.534+0000 7f3888171040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:53:54.807 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:54.607+0000 7f3888171040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:53:55.807 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:53:55.549+0000 7f3888171040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:53:55.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: Activating manager daemon x 2024-09-13T17:53:55.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: mgrmap e2: x(active, starting, since 0.00424107s) 2024-09-13T17:53:55.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:53:55.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:53:55.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:53:55.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:53:55.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T17:53:55.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: Manager daemon x is now available 2024-09-13T17:53:55.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:53:55.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:53:55.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' 2024-09-13T17:53:55.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' 2024-09-13T17:53:55.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:55 smithi027 ceph-mon[30611]: from='mgr.14100 172.21.15.27:0/3949063904' entity='mgr.x' 2024-09-13T17:53:57.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:57 smithi027 ceph-mon[30611]: mgrmap e3: x(active, since 1.00884s) 2024-09-13T17:53:57.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:57 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/241557081' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T17:53:57.864 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 0 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:53:57.865 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "a" 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T17:53:57.866 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T17:53:57.874 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T17:53:57.875 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T17:53:57.876 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ], 2024-09-13T17:53:57.877 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:53:57.877 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:57.877 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T17:53:57.877 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T17:53:57.877 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T17:53:40.283463+0000", 2024-09-13T17:53:57.877 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T17:53:57.877 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout }, 2024-09-13T17:53:57.877 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T17:53:57.877 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.959+0000 7f56bce00640 1 Processor -- start 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.959+0000 7f56bce00640 1 -- start start 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.959+0000 7f56bce00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b8107da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.959+0000 7f56bce00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b8108370 con 0x7f56b81079a0 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.959+0000 7f56b7400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b8107da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.960+0000 7f56b7400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b8107da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33014/0 (socket says 172.21.15.27:33014) 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.960+0000 7f56b7400640 1 -- 172.21.15.27:0/139379882 learned_addr learned my addr 172.21.15.27:0/139379882 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.960+0000 7f56b7400640 1 -- 172.21.15.27:0/139379882 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8108b90 con 0x7f56b81079a0 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.961+0000 7f56b7400640 1 --2- 172.21.15.27:0/139379882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b8107da0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009e80 tx=0x7f56a802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857e995c5f14bd11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.961+0000 7f56b6a00640 1 -- 172.21.15.27:0/139379882 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56a8031400 con 0x7f56b81079a0 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.962+0000 7f56b6a00640 1 -- 172.21.15.27:0/139379882 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f56a802d050 con 0x7f56b81079a0 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.962+0000 7f56b6a00640 1 -- 172.21.15.27:0/139379882 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56a8007a00 con 0x7f56b81079a0 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.962+0000 7f56bce00640 1 -- 172.21.15.27:0/139379882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 msgr2=0x7f56b8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.878 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.962+0000 7f56bce00640 1 --2- 172.21.15.27:0/139379882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b8107da0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009e80 tx=0x7f56a802a7a0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.962+0000 7f56bce00640 1 -- 172.21.15.27:0/139379882 shutdown_connections 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.962+0000 7f56bce00640 1 --2- 172.21.15.27:0/139379882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b8107da0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.962+0000 7f56bce00640 1 -- 172.21.15.27:0/139379882 >> 172.21.15.27:0/139379882 conn(0x7f56b807afb0 msgr2=0x7f56b807b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.962+0000 7f56bce00640 1 -- 172.21.15.27:0/139379882 shutdown_connections 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.962+0000 7f56bce00640 1 -- 172.21.15.27:0/139379882 wait complete. 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.963+0000 7f56bce00640 1 Processor -- start 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.964+0000 7f56bce00640 1 -- start start 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.964+0000 7f56bce00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.964+0000 7f56bce00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b819bcb0 con 0x7f56b81079a0 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.964+0000 7f56b7400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.879 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.964+0000 7f56b7400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b819b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33030/0 (socket says 172.21.15.27:33030) 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.964+0000 7f56b7400640 1 -- 172.21.15.27:0/241557081 learned_addr learned my addr 172.21.15.27:0/241557081 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.965+0000 7f56b7400640 1 -- 172.21.15.27:0/241557081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a8009b30 con 0x7f56b81079a0 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.965+0000 7f56b7400640 1 --2- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b819b770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f56a80319a0 tx=0x7f56a80319d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.965+0000 7f56b4c00640 1 -- 172.21.15.27:0/241557081 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56a803d450 con 0x7f56b81079a0 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.965+0000 7f56b4c00640 1 -- 172.21.15.27:0/241557081 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f56a803da70 con 0x7f56b81079a0 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.965+0000 7f56b4c00640 1 -- 172.21.15.27:0/241557081 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56a803ba00 con 0x7f56b81079a0 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.965+0000 7f56bce00640 1 -- 172.21.15.27:0/241557081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b819beb0 con 0x7f56b81079a0 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.965+0000 7f56bce00640 1 -- 172.21.15.27:0/241557081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b819c3b0 con 0x7f56b81079a0 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.966+0000 7f56b4c00640 1 -- 172.21.15.27:0/241557081 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7f56a803bc70 con 0x7f56b81079a0 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.967+0000 7f56ad600640 1 -- 172.21.15.27:0/241557081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b810bdc0 con 0x7f56b81079a0 2024-09-13T17:53:57.880 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.967+0000 7f56b4c00640 1 --2- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f569c038500 0x7f569c03a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.967+0000 7f56b4c00640 1 -- 172.21.15.27:0/241557081 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f56a806c1f0 con 0x7f56b81079a0 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.967+0000 7f56aea00640 1 --2- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f569c038500 0x7f569c03a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.968+0000 7f56aea00640 1 --2- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f569c038500 0x7f569c03a9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f56a00098c0 tx=0x7f56a0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:56.973+0000 7f56b4c00640 1 -- 172.21.15.27:0/241557081 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f56a804eab0 con 0x7f56b81079a0 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.223+0000 7f56ad600640 1 -- 172.21.15.27:0/241557081 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f56b810c000 con 0x7f56b81079a0 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.223+0000 7f56b4c00640 1 -- 172.21.15.27:0/241557081 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f56a8041020 con 0x7f56b81079a0 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.225+0000 7f56ad600640 1 -- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f569c038500 msgr2=0x7f569c03a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.225+0000 7f56ad600640 1 --2- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f569c038500 0x7f569c03a9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f56a00098c0 tx=0x7f56a0006db0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.225+0000 7f56ad600640 1 -- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 msgr2=0x7f56b819b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.225+0000 7f56ad600640 1 --2- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b819b770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f56a80319a0 tx=0x7f56a80319d0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.226+0000 7f56ad600640 1 -- 172.21.15.27:0/241557081 shutdown_connections 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.226+0000 7f56ad600640 1 --2- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f569c038500 0x7f569c03a9c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.226+0000 7f56ad600640 1 --2- 172.21.15.27:0/241557081 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f56b81079a0 0x7f56b819b770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:57.881 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.226+0000 7f56ad600640 1 -- 172.21.15.27:0/241557081 >> 172.21.15.27:0/241557081 conn(0x7f56b807afb0 msgr2=0x7f56b81055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:57.882 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.226+0000 7f56ad600640 1 -- 172.21.15.27:0/241557081 shutdown_connections 2024-09-13T17:53:57.885 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:57.226+0000 7f56ad600640 1 -- 172.21.15.27:0/241557081 wait complete. 2024-09-13T17:53:57.885 INFO:teuthology.orchestra.run.smithi027.stdout:mgr is available 2024-09-13T17:53:58.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:58 smithi027 ceph-mon[30611]: mgrmap e4: x(active, since 2s) 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout fsid = f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T17:53:59.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.381+0000 7fabca600640 1 Processor -- start 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.382+0000 7fabca600640 1 -- start start 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.382+0000 7fabca600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc4107d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.382+0000 7fabca600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc4108350 con 0x7fabc4107980 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.382+0000 7fabc9200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc4107d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.382+0000 7fabc9200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc4107d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33042/0 (socket says 172.21.15.27:33042) 2024-09-13T17:53:59.243 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.382+0000 7fabc9200640 1 -- 172.21.15.27:0/335822520 learned_addr learned my addr 172.21.15.27:0/335822520 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.383+0000 7fabc9200640 1 -- 172.21.15.27:0/335822520 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc4108b80 con 0x7fabc4107980 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.384+0000 7fabc9200640 1 --2- 172.21.15.27:0/335822520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc4107d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009820 tx=0x7fabb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2bb74a7d6e51936 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.384+0000 7fabc3e00640 1 -- 172.21.15.27:0/335822520 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabb402ae70 con 0x7fabc4107980 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.384+0000 7fabc3e00640 1 -- 172.21.15.27:0/335822520 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fabb4032900 con 0x7fabc4107980 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.384+0000 7fabc3e00640 1 -- 172.21.15.27:0/335822520 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabb40309d0 con 0x7fabc4107980 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.385+0000 7fabca600640 1 -- 172.21.15.27:0/335822520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 msgr2=0x7fabc4107d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.385+0000 7fabca600640 1 --2- 172.21.15.27:0/335822520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc4107d80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009820 tx=0x7fabb402a270 comp rx=0 tx=0).stop 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.385+0000 7fabca600640 1 -- 172.21.15.27:0/335822520 shutdown_connections 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.385+0000 7fabca600640 1 --2- 172.21.15.27:0/335822520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc4107d80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.385+0000 7fabca600640 1 -- 172.21.15.27:0/335822520 >> 172.21.15.27:0/335822520 conn(0x7fabc407af60 msgr2=0x7fabc407b370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:59.244 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.385+0000 7fabca600640 1 -- 172.21.15.27:0/335822520 shutdown_connections 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.385+0000 7fabca600640 1 -- 172.21.15.27:0/335822520 wait complete. 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.386+0000 7fabca600640 1 Processor -- start 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.386+0000 7fabca600640 1 -- start start 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.386+0000 7fabca600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc419b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.386+0000 7fabca600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc419bc70 con 0x7fabc4107980 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.386+0000 7fabc9200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc419b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.386+0000 7fabc9200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc419b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33050/0 (socket says 172.21.15.27:33050) 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.386+0000 7fabc9200640 1 -- 172.21.15.27:0/2524707344 learned_addr learned my addr 172.21.15.27:0/2524707344 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.387+0000 7fabc9200640 1 -- 172.21.15.27:0/2524707344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb40094d0 con 0x7fabc4107980 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.387+0000 7fabc9200640 1 --2- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc419b730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fabb40097f0 tx=0x7fabb4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.387+0000 7fabc2000640 1 -- 172.21.15.27:0/2524707344 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabb4032db0 con 0x7fabc4107980 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.387+0000 7fabc2000640 1 -- 172.21.15.27:0/2524707344 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fabb403b8f0 con 0x7fabc4107980 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.387+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc419be70 con 0x7fabc4107980 2024-09-13T17:53:59.245 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.387+0000 7fabc2000640 1 -- 172.21.15.27:0/2524707344 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fabb403a6e0 con 0x7fabc4107980 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.388+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc419c310 con 0x7fabc4107980 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.389+0000 7fabc2000640 1 -- 172.21.15.27:0/2524707344 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7fabb4039040 con 0x7fabc4107980 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.389+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc410bdb0 con 0x7fabc4107980 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.389+0000 7fabc2000640 1 --2- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7faba8038620 0x7faba803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.389+0000 7fabc2000640 1 -- 172.21.15.27:0/2524707344 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fabb406b4c0 con 0x7fabc4107980 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.389+0000 7fabbbe00640 1 --2- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7faba8038620 0x7faba803aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.390+0000 7fabbbe00640 1 --2- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7faba8038620 0x7faba803aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabac0098c0 tx=0x7fabac006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.395+0000 7fabc2000640 1 -- 172.21.15.27:0/2524707344 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fabb4031580 con 0x7fabc4107980 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.577+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fabc410bff0 con 0x7fabc4107980 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.578+0000 7fabc2000640 1 -- 172.21.15.27:0/2524707344 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fabb403f030 con 0x7fabc4107980 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7faba8038620 msgr2=0x7faba803aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 --2- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7faba8038620 0x7faba803aae0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fabac0098c0 tx=0x7fabac006db0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.246 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 msgr2=0x7fabc419b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:53:59.247 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 --2- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc419b730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fabb40097f0 tx=0x7fabb4032670 comp rx=0 tx=0).stop 2024-09-13T17:53:59.247 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 shutdown_connections 2024-09-13T17:53:59.247 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 --2- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7faba8038620 0x7faba803aae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.247 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 --2- 172.21.15.27:0/2524707344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabc4107980 0x7fabc419b730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:53:59.247 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 >> 172.21.15.27:0/2524707344 conn(0x7fabc407af60 msgr2=0x7fabc41055e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:53:59.247 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 shutdown_connections 2024-09-13T17:53:59.247 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:58.581+0000 7fabca600640 1 -- 172.21.15.27:0/2524707344 wait complete. 2024-09-13T17:53:59.247 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling cephadm module... 2024-09-13T17:53:59.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:53:59 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2524707344' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T17:54:00.884 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:00 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2261508291' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T17:54:00.884 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: ignoring --setuser ceph since I am not root 2024-09-13T17:54:00.885 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: ignoring --setgroup ceph since I am not root 2024-09-13T17:54:00.885 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:00.807+0000 7f2ce928d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:54:00.885 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:00.882+0000 7f2ce928d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:54:01.166 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:01.080+0000 7f2ce928d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:54:01.166 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:01.163+0000 7f2ce928d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:54:01.407 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.715+0000 7f1a0a000640 1 Processor -- start 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.715+0000 7f1a0a000640 1 -- start start 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.715+0000 7f1a0a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a04105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.715+0000 7f1a0a000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a04106390 con 0x7f1a041059c0 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.715+0000 7f1a03400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a04105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.715+0000 7f1a03400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a04105dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33054/0 (socket says 172.21.15.27:33054) 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.715+0000 7f1a03400640 1 -- 172.21.15.27:0/370925865 learned_addr learned my addr 172.21.15.27:0/370925865 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.715+0000 7f1a03400640 1 -- 172.21.15.27:0/370925865 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04106bc0 con 0x7f1a041059c0 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.716+0000 7f1a03400640 1 --2- 172.21.15.27:0/370925865 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a04105dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009820 tx=0x7f19f402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f7ef058cfdb1fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.716+0000 7f1a02000640 1 -- 172.21.15.27:0/370925865 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19f402ae70 con 0x7f1a041059c0 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.716+0000 7f1a02000640 1 -- 172.21.15.27:0/370925865 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f19f4032900 con 0x7f1a041059c0 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.716+0000 7f1a02000640 1 -- 172.21.15.27:0/370925865 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19f40309d0 con 0x7f1a041059c0 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.717+0000 7f1a0a000640 1 -- 172.21.15.27:0/370925865 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 msgr2=0x7f1a04105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:01.408 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.717+0000 7f1a0a000640 1 --2- 172.21.15.27:0/370925865 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a04105dc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f19f4009820 tx=0x7f19f402a270 comp rx=0 tx=0).stop 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.717+0000 7f1a0a000640 1 -- 172.21.15.27:0/370925865 shutdown_connections 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.717+0000 7f1a0a000640 1 --2- 172.21.15.27:0/370925865 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a04105dc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.717+0000 7f1a0a000640 1 -- 172.21.15.27:0/370925865 >> 172.21.15.27:0/370925865 conn(0x7f1a04101130 msgr2=0x7f1a04103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.717+0000 7f1a0a000640 1 -- 172.21.15.27:0/370925865 shutdown_connections 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.717+0000 7f1a0a000640 1 -- 172.21.15.27:0/370925865 wait complete. 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.718+0000 7f1a0a000640 1 Processor -- start 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.718+0000 7f1a0a000640 1 -- start start 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.718+0000 7f1a0a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a041997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.718+0000 7f1a0a000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a04199d10 con 0x7f1a041059c0 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.719+0000 7f1a03400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a041997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.719+0000 7f1a03400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a041997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33064/0 (socket says 172.21.15.27:33064) 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.719+0000 7f1a03400640 1 -- 172.21.15.27:0/2261508291 learned_addr learned my addr 172.21.15.27:0/2261508291 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:01.409 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.719+0000 7f1a03400640 1 -- 172.21.15.27:0/2261508291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f40094d0 con 0x7f1a041059c0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.719+0000 7f1a03400640 1 --2- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a041997d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f19f402a790 tx=0x7f19f4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.720+0000 7f19fbe00640 1 -- 172.21.15.27:0/2261508291 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19f4032db0 con 0x7f1a041059c0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.720+0000 7f19fbe00640 1 -- 172.21.15.27:0/2261508291 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f19f403b8f0 con 0x7f1a041059c0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.720+0000 7f19fbe00640 1 -- 172.21.15.27:0/2261508291 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19f403a6f0 con 0x7f1a041059c0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.720+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a04199f10 con 0x7f1a041059c0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.720+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0419a3b0 con 0x7f1a041059c0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.721+0000 7f19fbe00640 1 -- 172.21.15.27:0/2261508291 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f19f4039040 con 0x7f1a041059c0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.721+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a04109df0 con 0x7f1a041059c0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.721+0000 7f19fbe00640 1 --2- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f19e8038620 0x7f19e803aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.722+0000 7f19fbe00640 1 -- 172.21.15.27:0/2261508291 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f19f406b4e0 con 0x7f1a041059c0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.722+0000 7f1a02a00640 1 --2- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f19e8038620 0x7f19e803aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.722+0000 7f1a02a00640 1 --2- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f19e8038620 0x7f19e803aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19f00098c0 tx=0x7f19f0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:01.410 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.726+0000 7f19fbe00640 1 -- 172.21.15.27:0/2261508291 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f19f4031580 con 0x7f1a041059c0 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:53:59.952+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f1a0410a030 con 0x7f1a041059c0 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.567+0000 7f19fbe00640 1 -- 172.21.15.27:0/2261508291 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f19f403ba60 con 0x7f1a041059c0 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.569+0000 7f19fbe00640 1 -- 172.21.15.27:0/2261508291 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f19f4031760 con 0x7f1a041059c0 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f19e8038620 msgr2=0x7f19e803aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 --2- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f19e8038620 0x7f19e803aae0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f19f00098c0 tx=0x7f19f0006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 msgr2=0x7f1a041997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 --2- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a041997d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f19f402a790 tx=0x7f19f4032670 comp rx=0 tx=0).stop 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 shutdown_connections 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 --2- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7f19e8038620 0x7f19e803aae0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 --2- 172.21.15.27:0/2261508291 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1a041059c0 0x7f1a041997d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 >> 172.21.15.27:0/2261508291 conn(0x7f1a04101130 msgr2=0x7f1a04101d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 shutdown_connections 2024-09-13T17:54:01.411 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:00.572+0000 7f1a0a000640 1 -- 172.21.15.27:0/2261508291 wait complete. 2024-09-13T17:54:01.519 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:01.341+0000 7f2ce928d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:54:01.520 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:01.517+0000 7f2ce928d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:54:01.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:01 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2261508291' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T17:54:01.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:01 smithi027 ceph-mon[30611]: mgrmap e5: x(active, since 5s) 2024-09-13T17:54:02.207 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:01.907+0000 7f2ce928d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:54:02.207 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:01.984+0000 7f2ce928d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:54:02.207 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:02 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:02.205+0000 7f2ce928d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:54:02.824 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:02 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/574790344' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.020+0000 7fa2faa00640 1 Processor -- start 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.020+0000 7fa2faa00640 1 -- start start 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.021+0000 7fa2faa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f4105e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:02.954 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.021+0000 7fa2faa00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f41063e0 con 0x7fa2f4105a10 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.021+0000 7fa2f3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f4105e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.021+0000 7fa2f3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f4105e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52482/0 (socket says 172.21.15.27:52482) 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.021+0000 7fa2f3e00640 1 -- 172.21.15.27:0/531105927 learned_addr learned my addr 172.21.15.27:0/531105927 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.021+0000 7fa2f3e00640 1 -- 172.21.15.27:0/531105927 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4106b70 con 0x7fa2f4105a10 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.022+0000 7fa2f3e00640 1 --2- 172.21.15.27:0/531105927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f4105e10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009820 tx=0x7fa2e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adabd775a2f027cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.023+0000 7fa2f2a00640 1 -- 172.21.15.27:0/531105927 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2e402ae70 con 0x7fa2f4105a10 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.023+0000 7fa2f2a00640 1 -- 172.21.15.27:0/531105927 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa2e4032900 con 0x7fa2f4105a10 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.023+0000 7fa2f2a00640 1 -- 172.21.15.27:0/531105927 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2e40309d0 con 0x7fa2f4105a10 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.023+0000 7fa2faa00640 1 -- 172.21.15.27:0/531105927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 msgr2=0x7fa2f4105e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.023+0000 7fa2faa00640 1 --2- 172.21.15.27:0/531105927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f4105e10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009820 tx=0x7fa2e402a270 comp rx=0 tx=0).stop 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.023+0000 7fa2faa00640 1 -- 172.21.15.27:0/531105927 shutdown_connections 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.023+0000 7fa2faa00640 1 --2- 172.21.15.27:0/531105927 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f4105e10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.023+0000 7fa2faa00640 1 -- 172.21.15.27:0/531105927 >> 172.21.15.27:0/531105927 conn(0x7fa2f4101200 msgr2=0x7fa2f4103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:02.955 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.024+0000 7fa2faa00640 1 -- 172.21.15.27:0/531105927 shutdown_connections 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.024+0000 7fa2faa00640 1 -- 172.21.15.27:0/531105927 wait complete. 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.024+0000 7fa2faa00640 1 Processor -- start 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.025+0000 7fa2faa00640 1 -- start start 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.025+0000 7fa2faa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f407bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.025+0000 7fa2faa00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f407c050 con 0x7fa2f4105a10 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.025+0000 7fa2f3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f407bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.025+0000 7fa2f3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f407bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52494/0 (socket says 172.21.15.27:52494) 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.025+0000 7fa2f3e00640 1 -- 172.21.15.27:0/574790344 learned_addr learned my addr 172.21.15.27:0/574790344 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.026+0000 7fa2f3e00640 1 -- 172.21.15.27:0/574790344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e40094d0 con 0x7fa2f4105a10 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.026+0000 7fa2f3e00640 1 --2- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f407bb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40306e0 tx=0x7fa2e4032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.026+0000 7fa2f0c00640 1 -- 172.21.15.27:0/574790344 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2e4032c80 con 0x7fa2f4105a10 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.026+0000 7fa2f0c00640 1 -- 172.21.15.27:0/574790344 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa2e4032de0 con 0x7fa2f4105a10 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.026+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f407a290 con 0x7fa2f4105a10 2024-09-13T17:54:02.956 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.026+0000 7fa2f0c00640 1 -- 172.21.15.27:0/574790344 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2e403a780 con 0x7fa2f4105a10 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.026+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f407a730 con 0x7fa2f4105a10 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.027+0000 7fa2f0c00640 1 -- 172.21.15.27:0/574790344 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa2e4039040 con 0x7fa2f4105a10 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.028+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f4109da0 con 0x7fa2f4105a10 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.028+0000 7fa2f0c00640 1 --2- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fa2d8038670 0x7fa2d803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.028+0000 7fa2f0c00640 1 -- 172.21.15.27:0/574790344 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa2e406b690 con 0x7fa2f4105a10 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.028+0000 7fa2f3400640 1 -- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fa2d8038670 msgr2=0x7fa2d803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/2456729013 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.028+0000 7fa2f3400640 1 --2- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fa2d8038670 0x7fa2d803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.033+0000 7fa2f0c00640 1 -- 172.21.15.27:0/574790344 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa2e4031580 con 0x7fa2f4105a10 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.229+0000 7fa2f3400640 1 -- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fa2d8038670 msgr2=0x7fa2d803ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/2456729013 2024-09-13T17:54:02.957 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.229+0000 7fa2f3400640 1 --2- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fa2d8038670 0x7fa2d803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:54:02.958 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.257+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa2f407ae70 con 0x7fa2f4105a10 2024-09-13T17:54:02.958 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.257+0000 7fa2f0c00640 1 -- 172.21.15.27:0/574790344 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fa2e4037070 con 0x7fa2f4105a10 2024-09-13T17:54:02.958 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fa2d8038670 msgr2=0x7fa2d803ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:54:02.958 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 --2- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fa2d8038670 0x7fa2d803ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.958 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 msgr2=0x7fa2f407bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:02.958 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 --2- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f407bb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40306e0 tx=0x7fa2e4032670 comp rx=0 tx=0).stop 2024-09-13T17:54:02.959 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 shutdown_connections 2024-09-13T17:54:02.959 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 --2- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fa2d8038670 0x7fa2d803ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.959 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 --2- 172.21.15.27:0/574790344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2f4105a10 0x7fa2f407bb10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:02.959 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 >> 172.21.15.27:0/574790344 conn(0x7fa2f4101200 msgr2=0x7fa2f4101e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:02.959 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 shutdown_connections 2024-09-13T17:54:02.960 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:02.260+0000 7fa2faa00640 1 -- 172.21.15.27:0/574790344 wait complete. 2024-09-13T17:54:02.960 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for the mgr to restart... 2024-09-13T17:54:02.960 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr epoch 5... 2024-09-13T17:54:03.682 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:03.370+0000 7f2ce928d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:54:03.682 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:03.454+0000 7f2ce928d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:54:04.736 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:04.422+0000 7f2ce928d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:54:04.736 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:04.564+0000 7f2ce928d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:54:04.736 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:04.733+0000 7f2ce928d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:54:04.987 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:04.809+0000 7f2ce928d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:54:05.306 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:04.985+0000 7f2ce928d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:54:05.307 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:05.070+0000 7f2ce928d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:54:05.307 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:05.144+0000 7f2ce928d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:54:05.594 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:05.329+0000 7f2ce928d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:54:05.594 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:05.410+0000 7f2ce928d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:54:05.594 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:05.491+0000 7f2ce928d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:54:05.594 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:05.592+0000 7f2ce928d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:54:06.056 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:05.665+0000 7f2ce928d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:54:06.056 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:05.738+0000 7f2ce928d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:54:06.735 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:06.679+0000 7f2ce928d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: Active manager daemon x restarted 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: Activating manager daemon x 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: mgrmap e6: x(active, starting, since 0.00415141s) 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: Manager daemon x is now available 2024-09-13T17:54:07.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:07.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:07.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:54:07.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:06 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:54:08.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:07 smithi027 ceph-mon[30611]: Found migration_current of "None". Setting to last migration. 2024-09-13T17:54:08.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:07 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:54:08.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:07 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:54:08.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:07 smithi027 ceph-mon[30611]: mgrmap e7: x(active, since 1.00675s) 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.470+0000 7fc111800640 1 Processor -- start 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.470+0000 7fc111800640 1 -- start start 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.470+0000 7fc111800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c108010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.471+0000 7fc111800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c1085e0 con 0x7fc10c107c10 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.471+0000 7fc10aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c108010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.471+0000 7fc10aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c108010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52506/0 (socket says 172.21.15.27:52506) 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.471+0000 7fc10aa00640 1 -- 172.21.15.27:0/2744015287 learned_addr learned my addr 172.21.15.27:0/2744015287 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:08.427 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.471+0000 7fc10aa00640 1 -- 172.21.15.27:0/2744015287 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c108d70 con 0x7fc10c107c10 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.472+0000 7fc10aa00640 1 --2- 172.21.15.27:0/2744015287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c108010 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009820 tx=0x7fc0fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa047cc4712759e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.473+0000 7fc109600640 1 -- 172.21.15.27:0/2744015287 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0fc02ae70 con 0x7fc10c107c10 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.473+0000 7fc109600640 1 -- 172.21.15.27:0/2744015287 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fc0fc032900 con 0x7fc10c107c10 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.473+0000 7fc109600640 1 -- 172.21.15.27:0/2744015287 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0fc0309d0 con 0x7fc10c107c10 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.473+0000 7fc111800640 1 -- 172.21.15.27:0/2744015287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 msgr2=0x7fc10c108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.473+0000 7fc111800640 1 --2- 172.21.15.27:0/2744015287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c108010 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009820 tx=0x7fc0fc02a270 comp rx=0 tx=0).stop 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.473+0000 7fc111800640 1 -- 172.21.15.27:0/2744015287 shutdown_connections 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.473+0000 7fc111800640 1 --2- 172.21.15.27:0/2744015287 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c108010 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.473+0000 7fc111800640 1 -- 172.21.15.27:0/2744015287 >> 172.21.15.27:0/2744015287 conn(0x7fc10c07b1f0 msgr2=0x7fc10c07b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.474+0000 7fc111800640 1 -- 172.21.15.27:0/2744015287 shutdown_connections 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.474+0000 7fc111800640 1 -- 172.21.15.27:0/2744015287 wait complete. 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.475+0000 7fc111800640 1 Processor -- start 2024-09-13T17:54:08.428 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.475+0000 7fc111800640 1 -- start start 2024-09-13T17:54:08.429 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.475+0000 7fc111800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:08.429 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.475+0000 7fc111800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c19bf60 con 0x7fc10c107c10 2024-09-13T17:54:08.429 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.475+0000 7fc10aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:08.429 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.475+0000 7fc10aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c19ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52510/0 (socket says 172.21.15.27:52510) 2024-09-13T17:54:08.429 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.475+0000 7fc10aa00640 1 -- 172.21.15.27:0/1519670541 learned_addr learned my addr 172.21.15.27:0/1519670541 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:08.429 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.476+0000 7fc10aa00640 1 -- 172.21.15.27:0/1519670541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0fc0094d0 con 0x7fc10c107c10 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.476+0000 7fc10aa00640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c19ba20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc02a790 tx=0x7fc0fc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.476+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0fc032db0 con 0x7fc10c107c10 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.476+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fc0fc03b8f0 con 0x7fc10c107c10 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.476+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0fc03a6f0 con 0x7fc10c107c10 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.476+0000 7fc111800640 1 -- 172.21.15.27:0/1519670541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c19c160 con 0x7fc10c107c10 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.477+0000 7fc111800640 1 -- 172.21.15.27:0/1519670541 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c19c600 con 0x7fc10c107c10 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.478+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fc0fc039040 con 0x7fc10c107c10 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.479+0000 7fc103400640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 0x7fc0f003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.479+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 --> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f003b1f0 con 0x7fc0f0038620 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.479+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc0fc06b560 con 0x7fc10c107c10 2024-09-13T17:54:08.430 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.479+0000 7fc10a000640 1 -- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 msgr2=0x7fc0f003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/2456729013 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.479+0000 7fc10a000640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 0x7fc0f003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.680+0000 7fc10a000640 1 -- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 msgr2=0x7fc0f003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/2456729013 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:03.680+0000 7fc10a000640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 0x7fc0f003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:04.081+0000 7fc10a000640 1 -- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 msgr2=0x7fc0f003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/2456729013 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:04.081+0000 7fc10a000640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 0x7fc0f003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:04.882+0000 7fc10a000640 1 -- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 msgr2=0x7fc0f003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/2456729013 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:04.882+0000 7fc10a000640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 0x7fc0f003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:06.483+0000 7fc10a000640 1 -- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 msgr2=0x7fc0f003aae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/2456729013 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:06.483+0000 7fc10a000640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 0x7fc0f003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:06.684+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7fc0fc03a930 con 0x7fc10c107c10 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:06.684+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 msgr2=0x7fc0f003aae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:06.684+0000 7fc103400640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 0x7fc0f003aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.686+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7fc0fc06d3d0 con 0x7fc10c107c10 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.686+0000 7fc103400640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fc0f003bf50 0x7fc0f003e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:08.431 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.686+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0f003b1f0 con 0x7fc0f003bf50 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.687+0000 7fc10a000640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fc0f003bf50 0x7fc0f003e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.688+0000 7fc10a000640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fc0f003bf50 0x7fc0f003e340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8003980 tx=0x7fc0f8009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.689+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 <== mgr.14118 v2:172.21.15.27:6800/1083878216 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fc0f003b1f0 con 0x7fc0f003bf50 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.699+0000 7fc111800640 1 -- 172.21.15.27:0/1519670541 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc10c10bfa0 con 0x7fc0f003bf50 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.699+0000 7fc103400640 1 -- 172.21.15.27:0/1519670541 <== mgr.14118 v2:172.21.15.27:6800/1083878216 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fc10c10bfa0 con 0x7fc0f003bf50 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 -- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fc0f003bf50 msgr2=0x7fc0f003e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fc0f003bf50 0x7fc0f003e340 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8003980 tx=0x7fc0f8009290 comp rx=0 tx=0).stop 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 -- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 msgr2=0x7fc10c19ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c19ba20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc02a790 tx=0x7fc0fc032670 comp rx=0 tx=0).stop 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 -- 172.21.15.27:0/1519670541 shutdown_connections 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fc0f003bf50 0x7fc0f003e340 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:6800/2456729013,v1:172.21.15.27:6801/2456729013] conn(0x7fc0f0038620 0x7fc0f003aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 --2- 172.21.15.27:0/1519670541 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc10c107c10 0x7fc10c19ba20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:08.432 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 -- 172.21.15.27:0/1519670541 >> 172.21.15.27:0/1519670541 conn(0x7fc10c07b1f0 msgr2=0x7fc10c105700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:08.433 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 -- 172.21.15.27:0/1519670541 shutdown_connections 2024-09-13T17:54:08.433 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:07.700+0000 7fc111800640 1 -- 172.21.15.27:0/1519670541 wait complete. 2024-09-13T17:54:08.433 INFO:teuthology.orchestra.run.smithi027.stdout:mgr epoch 5 is available 2024-09-13T17:54:08.433 INFO:teuthology.orchestra.run.smithi027.stdout:Setting orchestrator backend to cephadm... 2024-09-13T17:54:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:08 smithi027 ceph-mon[30611]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T17:54:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:08 smithi027 ceph-mon[30611]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T17:54:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:08 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:08.978 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:08 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:09.822 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.976+0000 7f1592e00640 1 Processor -- start 2024-09-13T17:54:09.822 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.976+0000 7f1592e00640 1 -- start start 2024-09-13T17:54:09.822 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.977+0000 7f1592e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c108010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.822 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.977+0000 7f1592e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c1085e0 con 0x7f158c107c10 2024-09-13T17:54:09.822 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.977+0000 7f158be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c108010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.822 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.977+0000 7f158be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c108010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52578/0 (socket says 172.21.15.27:52578) 2024-09-13T17:54:09.822 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.977+0000 7f158be00640 1 -- 172.21.15.27:0/1815700783 learned_addr learned my addr 172.21.15.27:0/1815700783 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:09.822 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.978+0000 7f158be00640 1 -- 172.21.15.27:0/1815700783 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c108d70 con 0x7f158c107c10 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.979+0000 7f158be00640 1 --2- 172.21.15.27:0/1815700783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c108010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f157c009820 tx=0x7f157c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5876900a3e35938 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.979+0000 7f158aa00640 1 -- 172.21.15.27:0/1815700783 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f157c02ae70 con 0x7f158c107c10 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.979+0000 7f158aa00640 1 -- 172.21.15.27:0/1815700783 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f157c032900 con 0x7f158c107c10 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.979+0000 7f158aa00640 1 -- 172.21.15.27:0/1815700783 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f157c0309d0 con 0x7f158c107c10 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.979+0000 7f1592e00640 1 -- 172.21.15.27:0/1815700783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 msgr2=0x7f158c108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.979+0000 7f1592e00640 1 --2- 172.21.15.27:0/1815700783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c108010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f157c009820 tx=0x7f157c02a270 comp rx=0 tx=0).stop 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.980+0000 7f1592e00640 1 -- 172.21.15.27:0/1815700783 shutdown_connections 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.980+0000 7f1592e00640 1 --2- 172.21.15.27:0/1815700783 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c108010 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.980+0000 7f1592e00640 1 -- 172.21.15.27:0/1815700783 >> 172.21.15.27:0/1815700783 conn(0x7f158c07b1f0 msgr2=0x7f158c07b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.980+0000 7f1592e00640 1 -- 172.21.15.27:0/1815700783 shutdown_connections 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.980+0000 7f1592e00640 1 -- 172.21.15.27:0/1815700783 wait complete. 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.981+0000 7f1592e00640 1 Processor -- start 2024-09-13T17:54:09.823 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.981+0000 7f1592e00640 1 -- start start 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.981+0000 7f1592e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c19b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.981+0000 7f1592e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158c19bed0 con 0x7f158c107c10 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.981+0000 7f158be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c19b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.981+0000 7f158be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c19b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52584/0 (socket says 172.21.15.27:52584) 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.981+0000 7f158be00640 1 -- 172.21.15.27:0/3419730031 learned_addr learned my addr 172.21.15.27:0/3419730031 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.982+0000 7f158be00640 1 -- 172.21.15.27:0/3419730031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c0094d0 con 0x7f158c107c10 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.982+0000 7f158be00640 1 --2- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c19b990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f157c02a790 tx=0x7f157c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.982+0000 7f1588c00640 1 -- 172.21.15.27:0/3419730031 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f157c032db0 con 0x7f158c107c10 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.982+0000 7f1588c00640 1 -- 172.21.15.27:0/3419730031 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f157c03b8f0 con 0x7f158c107c10 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.982+0000 7f1588c00640 1 -- 172.21.15.27:0/3419730031 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f157c03a6f0 con 0x7f158c107c10 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.982+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158c19c0d0 con 0x7f158c107c10 2024-09-13T17:54:09.824 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.982+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158c19c570 con 0x7f158c107c10 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.983+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158c10bfa0 con 0x7f158c107c10 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.984+0000 7f1588c00640 1 -- 172.21.15.27:0/3419730031 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f157c039040 con 0x7f158c107c10 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.984+0000 7f1588c00640 1 --2- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1570038670 0x7f157003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.984+0000 7f1588c00640 1 -- 172.21.15.27:0/3419730031 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f157c06b940 con 0x7f158c107c10 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.984+0000 7f158b400640 1 --2- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1570038670 0x7f157003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.985+0000 7f158b400640 1 --2- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1570038670 0x7f157003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15780098c0 tx=0x7f1578006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:08.989+0000 7f1588c00640 1 -- 172.21.15.27:0/3419730031 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f157c031580 con 0x7f158c107c10 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.186+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f158c105dd0 con 0x7f1570038670 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.198+0000 7f1588c00640 1 -- 172.21.15.27:0/3419730031 <== mgr.14118 v2:172.21.15.27:6800/1083878216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f158c105dd0 con 0x7f1570038670 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1570038670 msgr2=0x7f157003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 --2- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1570038670 0x7f157003ab30 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f15780098c0 tx=0x7f1578006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 msgr2=0x7f158c19b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:09.825 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 --2- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c19b990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f157c02a790 tx=0x7f157c032670 comp rx=0 tx=0).stop 2024-09-13T17:54:09.826 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 shutdown_connections 2024-09-13T17:54:09.826 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 --2- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1570038670 0x7f157003ab30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.826 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 --2- 172.21.15.27:0/3419730031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f158c107c10 0x7f158c19b990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:09.826 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 >> 172.21.15.27:0/3419730031 conn(0x7f158c07b1f0 msgr2=0x7f158c1056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:09.826 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 shutdown_connections 2024-09-13T17:54:09.826 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:09.200+0000 7f1592e00640 1 -- 172.21.15.27:0/3419730031 wait complete. 2024-09-13T17:54:10.121 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-mon[30611]: mgrmap e8: x(active, since 2s) 2024-09-13T17:54:10.121 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-mon[30611]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:10.121 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:10.121 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:54:10.121 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:09.965+0000 7f2c49600640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:17:54:09] ENGINE Error in HTTPServer.serve 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: Traceback (most recent call last): 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: self._connections.run(self.expiration_interval) 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: self._run(expiration_interval) 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: s = self.context.wrap_socket( 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: return self.sslsocket_class._create( 2024-09-13T17:54:10.122 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:54:10.123 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: self.do_handshake() 2024-09-13T17:54:10.123 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:54:10.123 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: self._sslobj.do_handshake() 2024-09-13T17:54:10.123 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:54:10.123 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:11.226 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:10 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:09] ENGINE Bus STARTING 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:10 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:09] ENGINE Serving on https://172.21.15.27:7150 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:10 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:09] ENGINE Error in HTTPServer.serve 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: Traceback (most recent call last): 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._run(expiration_interval) 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:54:11.227 INFO:journalctl@ceph.mon.a.smithi027.stdout: s = self.context.wrap_socket( 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout: return self.sslsocket_class._create( 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout: self.do_handshake() 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._sslobj.do_handshake() 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:10 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:10] ENGINE Serving on http://172.21.15.27:8765 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:10 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:10] ENGINE Bus STARTED 2024-09-13T17:54:11.228 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:10 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:54:11.229 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:10 smithi027 ceph-mon[30611]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:11.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T17:54:11.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.398+0000 7f2100200640 1 Processor -- start 2024-09-13T17:54:11.237 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.398+0000 7f2100200640 1 -- start start 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.398+0000 7f2100200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f8108010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.398+0000 7f2100200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f81085e0 con 0x7f20f8107c10 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.399+0000 7f20fd800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f8108010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.399+0000 7f20fd800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f8108010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47440/0 (socket says 172.21.15.27:47440) 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.399+0000 7f20fd800640 1 -- 172.21.15.27:0/166361175 learned_addr learned my addr 172.21.15.27:0/166361175 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.399+0000 7f20fd800640 1 -- 172.21.15.27:0/166361175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f8108d70 con 0x7f20f8107c10 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.400+0000 7f20fd800640 1 --2- 172.21.15.27:0/166361175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f8108010 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009820 tx=0x7f20ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9741511a2596ab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f20f7e00640 1 -- 172.21.15.27:0/166361175 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20ec02ae70 con 0x7f20f8107c10 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f20f7e00640 1 -- 172.21.15.27:0/166361175 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f20ec032900 con 0x7f20f8107c10 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f20f7e00640 1 -- 172.21.15.27:0/166361175 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20ec0309d0 con 0x7f20f8107c10 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f2100200640 1 -- 172.21.15.27:0/166361175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 msgr2=0x7f20f8108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f2100200640 1 --2- 172.21.15.27:0/166361175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f8108010 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009820 tx=0x7f20ec02a270 comp rx=0 tx=0).stop 2024-09-13T17:54:11.238 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f2100200640 1 -- 172.21.15.27:0/166361175 shutdown_connections 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f2100200640 1 --2- 172.21.15.27:0/166361175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f8108010 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f2100200640 1 -- 172.21.15.27:0/166361175 >> 172.21.15.27:0/166361175 conn(0x7f20f807b1f0 msgr2=0x7f20f807b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f2100200640 1 -- 172.21.15.27:0/166361175 shutdown_connections 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.401+0000 7f2100200640 1 -- 172.21.15.27:0/166361175 wait complete. 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.402+0000 7f2100200640 1 Processor -- start 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.403+0000 7f2100200640 1 -- start start 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.403+0000 7f2100200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f819ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.403+0000 7f2100200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f819bf60 con 0x7f20f8107c10 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.403+0000 7f20fd800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f819ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.239 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.403+0000 7f20fd800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f819ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47450/0 (socket says 172.21.15.27:47450) 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.403+0000 7f20fd800640 1 -- 172.21.15.27:0/2047746451 learned_addr learned my addr 172.21.15.27:0/2047746451 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.403+0000 7f20fd800640 1 -- 172.21.15.27:0/2047746451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0094d0 con 0x7f20f8107c10 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.404+0000 7f20fd800640 1 --2- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f819ba20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f20ec02a790 tx=0x7f20ec032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.404+0000 7f20f6000640 1 -- 172.21.15.27:0/2047746451 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20ec032db0 con 0x7f20f8107c10 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.404+0000 7f20f6000640 1 -- 172.21.15.27:0/2047746451 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f20ec03b8f0 con 0x7f20f8107c10 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.404+0000 7f20f6000640 1 -- 172.21.15.27:0/2047746451 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f20ec03a6f0 con 0x7f20f8107c10 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.404+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f819c160 con 0x7f20f8107c10 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.404+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f819c600 con 0x7f20f8107c10 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.405+0000 7f20f6000640 1 -- 172.21.15.27:0/2047746451 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f20ec039040 con 0x7f20f8107c10 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.405+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f810bfa0 con 0x7f20f8107c10 2024-09-13T17:54:11.240 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.406+0000 7f20f6000640 1 --2- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f20e0038670 0x7f20e003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.406+0000 7f20f6000640 1 -- 172.21.15.27:0/2047746451 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f20ec06b940 con 0x7f20f8107c10 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.406+0000 7f20fce00640 1 --2- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f20e0038670 0x7f20e003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.407+0000 7f20fce00640 1 --2- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f20e0038670 0x7f20e003ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20e40098c0 tx=0x7f20e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.410+0000 7f20f6000640 1 -- 172.21.15.27:0/2047746451 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f20ec031580 con 0x7f20f8107c10 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.594+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f20f8105e10 con 0x7f20e0038670 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.595+0000 7f20f6000640 1 -- 172.21.15.27:0/2047746451 <== mgr.14118 v2:172.21.15.27:6800/1083878216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f20f8105e10 con 0x7f20e0038670 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.597+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f20e0038670 msgr2=0x7f20e003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.597+0000 7f2100200640 1 --2- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f20e0038670 0x7f20e003ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f20e40098c0 tx=0x7f20e4006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.597+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 msgr2=0x7f20f819ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.597+0000 7f2100200640 1 --2- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f819ba20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f20ec02a790 tx=0x7f20ec032670 comp rx=0 tx=0).stop 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.598+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 shutdown_connections 2024-09-13T17:54:11.241 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.598+0000 7f2100200640 1 --2- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f20e0038670 0x7f20e003ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.598+0000 7f2100200640 1 --2- 172.21.15.27:0/2047746451 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20f8107c10 0x7f20f819ba20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:11.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.598+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 >> 172.21.15.27:0/2047746451 conn(0x7f20f807b1f0 msgr2=0x7f20f8105700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:11.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.598+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 shutdown_connections 2024-09-13T17:54:11.242 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:10.598+0000 7f2100200640 1 -- 172.21.15.27:0/2047746451 wait complete. 2024-09-13T17:54:11.242 INFO:teuthology.orchestra.run.smithi027.stdout:Generating ssh key... 2024-09-13T17:54:12.405 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: Generating public/private rsa key pair. 2024-09-13T17:54:12.405 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: Your identification has been saved in /tmp/tmpispjilkb/key 2024-09-13T17:54:12.405 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: Your public key has been saved in /tmp/tmpispjilkb/key.pub 2024-09-13T17:54:12.405 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: The key fingerprint is: 2024-09-13T17:54:12.405 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: SHA256:U0lVBvwFteXTKbGsEgnDlXUHq0RM/HOzWGjv1URGdAs ceph-f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:54:12.405 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: The key's randomart image is: 2024-09-13T17:54:12.405 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: +---[RSA 3072]----+ 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: | .o..B*oE=**| 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: | .ooo++.*.@| 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: | oo..*.Oo| 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: | .o o=o+o| 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: | S. o. *.+| 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: | .. . oo| 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: | . .| 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: | . | 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: | | 2024-09-13T17:54:12.406 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: +----[SHA256]-----+ 2024-09-13T17:54:13.088 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.728+0000 7f8450e00640 1 Processor -- start 2024-09-13T17:54:13.093 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.728+0000 7f8450e00640 1 -- start start 2024-09-13T17:54:13.093 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.729+0000 7f8450e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.093 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.729+0000 7f8450e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c07a870 con 0x7f844c07bdc0 2024-09-13T17:54:13.093 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.729+0000 7f8449e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.093 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.729+0000 7f8449e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47460/0 (socket says 172.21.15.27:47460) 2024-09-13T17:54:13.093 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.729+0000 7f8449e00640 1 -- 172.21.15.27:0/1801449048 learned_addr learned my addr 172.21.15.27:0/1801449048 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:13.093 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.730+0000 7f8449e00640 1 -- 172.21.15.27:0/1801449048 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c07a9b0 con 0x7f844c07bdc0 2024-09-13T17:54:13.093 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.731+0000 7f8449e00640 1 --2- 172.21.15.27:0/1801449048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c07a330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f843c009820 tx=0x7f843c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cba2f47742fed1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.731+0000 7f8448a00640 1 -- 172.21.15.27:0/1801449048 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f843c02ae70 con 0x7f844c07bdc0 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.731+0000 7f8448a00640 1 -- 172.21.15.27:0/1801449048 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f843c032900 con 0x7f844c07bdc0 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.731+0000 7f8448a00640 1 -- 172.21.15.27:0/1801449048 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f843c0309d0 con 0x7f844c07bdc0 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.732+0000 7f8450e00640 1 -- 172.21.15.27:0/1801449048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 msgr2=0x7f844c07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.732+0000 7f8450e00640 1 --2- 172.21.15.27:0/1801449048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c07a330 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f843c009820 tx=0x7f843c02a270 comp rx=0 tx=0).stop 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.732+0000 7f8450e00640 1 -- 172.21.15.27:0/1801449048 shutdown_connections 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.732+0000 7f8450e00640 1 --2- 172.21.15.27:0/1801449048 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c07a330 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.732+0000 7f8450e00640 1 -- 172.21.15.27:0/1801449048 >> 172.21.15.27:0/1801449048 conn(0x7f844c101230 msgr2=0x7f844c103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.732+0000 7f8450e00640 1 -- 172.21.15.27:0/1801449048 shutdown_connections 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.732+0000 7f8450e00640 1 -- 172.21.15.27:0/1801449048 wait complete. 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.733+0000 7f8450e00640 1 Processor -- start 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.733+0000 7f8450e00640 1 -- start start 2024-09-13T17:54:13.094 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.734+0000 7f8450e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.734+0000 7f8450e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c19be90 con 0x7f844c07bdc0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.734+0000 7f8449e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.734+0000 7f8449e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47466/0 (socket says 172.21.15.27:47466) 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.734+0000 7f8449e00640 1 -- 172.21.15.27:0/3385230004 learned_addr learned my addr 172.21.15.27:0/3385230004 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.734+0000 7f8449e00640 1 -- 172.21.15.27:0/3385230004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c0094d0 con 0x7f844c07bdc0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.735+0000 7f8449e00640 1 --2- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c19b950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f843c0097f0 tx=0x7f843c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.735+0000 7f8442a00640 1 -- 172.21.15.27:0/3385230004 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f843c032db0 con 0x7f844c07bdc0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.735+0000 7f8442a00640 1 -- 172.21.15.27:0/3385230004 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f843c03b8f0 con 0x7f844c07bdc0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.735+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c19c090 con 0x7f844c07bdc0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.735+0000 7f8442a00640 1 -- 172.21.15.27:0/3385230004 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f843c03a6f0 con 0x7f844c07bdc0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.735+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c19c530 con 0x7f844c07bdc0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.736+0000 7f8442a00640 1 -- 172.21.15.27:0/3385230004 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f843c039040 con 0x7f844c07bdc0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.736+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c10bcc0 con 0x7f844c07bdc0 2024-09-13T17:54:13.095 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.737+0000 7f8442a00640 1 --2- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f8430038620 0x7f843003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.737+0000 7f8442a00640 1 -- 172.21.15.27:0/3385230004 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f843c06b970 con 0x7f844c07bdc0 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.737+0000 7f8449400640 1 --2- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f8430038620 0x7f843003aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.738+0000 7f8449400640 1 --2- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f8430038620 0x7f843003aae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84380098c0 tx=0x7f8438006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.746+0000 7f8442a00640 1 -- 172.21.15.27:0/3385230004 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f843c0319f0 con 0x7f844c07bdc0 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:11.928+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f844c1024b0 con 0x7f8430038620 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.402+0000 7f8442a00640 1 -- 172.21.15.27:0/3385230004 <== mgr.14118 v2:172.21.15.27:6800/1083878216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f844c1024b0 con 0x7f8430038620 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.404+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f8430038620 msgr2=0x7f843003aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.404+0000 7f8450e00640 1 --2- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f8430038620 0x7f843003aae0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f84380098c0 tx=0x7f8438006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.404+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 msgr2=0x7f844c19b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.404+0000 7f8450e00640 1 --2- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c19b950 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f843c0097f0 tx=0x7f843c032670 comp rx=0 tx=0).stop 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.404+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 shutdown_connections 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.404+0000 7f8450e00640 1 --2- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f8430038620 0x7f843003aae0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.096 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.404+0000 7f8450e00640 1 --2- 172.21.15.27:0/3385230004 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f844c07bdc0 0x7f844c19b950 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.404+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 >> 172.21.15.27:0/3385230004 conn(0x7f844c101230 msgr2=0x7f844c101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.405+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 shutdown_connections 2024-09-13T17:54:13.097 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:12.405+0000 7f8450e00640 1 -- 172.21.15.27:0/3385230004 wait complete. 2024-09-13T17:54:13.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:13 smithi027 ceph-mon[30611]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:13.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:13 smithi027 ceph-mon[30611]: Generating ssh key... 2024-09-13T17:54:13.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:13 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:13.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:13 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:14.491 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXFMjTTDYrQkF0iTc5HMDeCBrb5avb+NbiiIzZepDcrVrJJ2JD+ie4Tnszxx1nXEm+rxKw2lfcQhiwzG+D2xbr+zhwg97Uuka+uWi5yNMolJnJRj4Gn58/62DMR5r4mbFdNQN7BveO4GV+LayOxS05YCCGfaz+ikbCVJEZVAn8TNRs1GIljTNPDMTrBgu3gzYIFjGHLSNhipEX9KMgd69KrBP6G5S70CnDmzOOlsbidpCStgqEJV1JHDBJCzv48AIg3w2ZCdYJVodqD7d694ceiNuZk8l7OrhBsYQn2oBmsGjPj+Knc0qHabVAmSDMvm38qYbONLfCZpzIQA3UoKTz9s8NiC4Lg6Dmh0Uju9Zf2jOei07NUR7HCH2LY9tlfxcE0whY8PnTOJ3cd7ZJePuMPP2nOLBIyK0DSNl/co5jocLgI7L57EFPMcTh/H8XQCS/vC8SmKzzmOhHo8bXi3vP5eerwkyF2KuDK3Mr2SYp/UH4J4yt1GLw5IGxHTioJlc= ceph-f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:54:14.491 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.627+0000 7f1463400640 1 Processor -- start 2024-09-13T17:54:14.491 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.627+0000 7f1463400640 1 -- start start 2024-09-13T17:54:14.491 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.627+0000 7f1463400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c108020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:14.491 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.627+0000 7f1463400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c1085f0 con 0x7f145c107c20 2024-09-13T17:54:14.491 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.627+0000 7f1460a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:14.491 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.627+0000 7f1460a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47476/0 (socket says 172.21.15.27:47476) 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.627+0000 7f1460a00640 1 -- 172.21.15.27:0/1927218702 learned_addr learned my addr 172.21.15.27:0/1927218702 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.628+0000 7f1460a00640 1 -- 172.21.15.27:0/1927218702 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c108dd0 con 0x7f145c107c20 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.629+0000 7f1460a00640 1 --2- 172.21.15.27:0/1927218702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c108020 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f144c009820 tx=0x7f144c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0a6bbf3c283b59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.629+0000 7f145be00640 1 -- 172.21.15.27:0/1927218702 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f144c02ae70 con 0x7f145c107c20 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.629+0000 7f145be00640 1 -- 172.21.15.27:0/1927218702 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f144c032900 con 0x7f145c107c20 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.629+0000 7f145be00640 1 -- 172.21.15.27:0/1927218702 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f144c0309d0 con 0x7f145c107c20 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.630+0000 7f1463400640 1 -- 172.21.15.27:0/1927218702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 msgr2=0x7f145c108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.630+0000 7f1463400640 1 --2- 172.21.15.27:0/1927218702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c108020 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f144c009820 tx=0x7f144c02a270 comp rx=0 tx=0).stop 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.630+0000 7f1463400640 1 -- 172.21.15.27:0/1927218702 shutdown_connections 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.630+0000 7f1463400640 1 --2- 172.21.15.27:0/1927218702 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c108020 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.630+0000 7f1463400640 1 -- 172.21.15.27:0/1927218702 >> 172.21.15.27:0/1927218702 conn(0x7f145c07b250 msgr2=0x7f145c07b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.630+0000 7f1463400640 1 -- 172.21.15.27:0/1927218702 shutdown_connections 2024-09-13T17:54:14.492 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.630+0000 7f1463400640 1 -- 172.21.15.27:0/1927218702 wait complete. 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.631+0000 7f1463400640 1 Processor -- start 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.631+0000 7f1463400640 1 -- start start 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.631+0000 7f1463400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c19b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.631+0000 7f1463400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145c19bea0 con 0x7f145c107c20 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.632+0000 7f1460a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c19b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.632+0000 7f1460a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c19b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47484/0 (socket says 172.21.15.27:47484) 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.632+0000 7f1460a00640 1 -- 172.21.15.27:0/333514718 learned_addr learned my addr 172.21.15.27:0/333514718 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.632+0000 7f1460a00640 1 -- 172.21.15.27:0/333514718 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c0094d0 con 0x7f145c107c20 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.632+0000 7f1460a00640 1 --2- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c19b960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f144c0306e0 tx=0x7f144c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.633+0000 7f145a000640 1 -- 172.21.15.27:0/333514718 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f144c032c80 con 0x7f145c107c20 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.633+0000 7f145a000640 1 -- 172.21.15.27:0/333514718 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f144c032de0 con 0x7f145c107c20 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.633+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145c19c0a0 con 0x7f145c107c20 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.633+0000 7f145a000640 1 -- 172.21.15.27:0/333514718 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f144c03a780 con 0x7f145c107c20 2024-09-13T17:54:14.493 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.633+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145c19c540 con 0x7f145c107c20 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.634+0000 7f145a000640 1 -- 172.21.15.27:0/333514718 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f144c039040 con 0x7f145c107c20 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.634+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f145c10c000 con 0x7f145c107c20 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.634+0000 7f145a000640 1 --2- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1440038620 0x7f144003aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.634+0000 7f145a000640 1 -- 172.21.15.27:0/333514718 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f144c06bb90 con 0x7f145c107c20 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.635+0000 7f1453e00640 1 --2- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1440038620 0x7f144003aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.635+0000 7f1453e00640 1 --2- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1440038620 0x7f144003aae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14440098c0 tx=0x7f1444006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.639+0000 7f145a000640 1 -- 172.21.15.27:0/333514718 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f144c031580 con 0x7f145c107c20 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.823+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f145c105d90 con 0x7f1440038620 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.824+0000 7f145a000640 1 -- 172.21.15.27:0/333514718 <== mgr.14118 v2:172.21.15.27:6800/1083878216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f145c105d90 con 0x7f1440038620 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.826+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1440038620 msgr2=0x7f144003aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.826+0000 7f1463400640 1 --2- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1440038620 0x7f144003aae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14440098c0 tx=0x7f1444006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.826+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 msgr2=0x7f145c19b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.826+0000 7f1463400640 1 --2- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c19b960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f144c0306e0 tx=0x7f144c032670 comp rx=0 tx=0).stop 2024-09-13T17:54:14.494 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.826+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 shutdown_connections 2024-09-13T17:54:14.495 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.826+0000 7f1463400640 1 --2- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f1440038620 0x7f144003aae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:14.495 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.826+0000 7f1463400640 1 --2- 172.21.15.27:0/333514718 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f145c107c20 0x7f145c19b960 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:14.495 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.826+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 >> 172.21.15.27:0/333514718 conn(0x7f145c07b250 msgr2=0x7f145c105680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:14.495 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.826+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 shutdown_connections 2024-09-13T17:54:14.495 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:13.827+0000 7f1463400640 1 -- 172.21.15.27:0/333514718 wait complete. 2024-09-13T17:54:14.495 INFO:teuthology.orchestra.run.smithi027.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T17:54:14.495 INFO:teuthology.orchestra.run.smithi027.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T17:54:14.495 INFO:teuthology.orchestra.run.smithi027.stdout:Adding host smithi027... 2024-09-13T17:54:15.028 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:14 smithi027 ceph-mon[30611]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:16.028 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:15 smithi027 ceph-mon[30611]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi027", "addr": "172.21.15.27", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:17.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:16 smithi027 ceph-mon[30611]: Deploying cephadm binary to smithi027 2024-09-13T17:54:19.919 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Added host 'smithi027' with addr '172.21.15.27' 2024-09-13T17:54:19.919 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.026+0000 7f9415000640 1 Processor -- start 2024-09-13T17:54:19.919 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.026+0000 7f9415000640 1 -- start start 2024-09-13T17:54:19.919 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.027+0000 7f9415000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f9410105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:19.920 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.027+0000 7f9415000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9410106390 con 0x7f94101059c0 2024-09-13T17:54:19.920 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.027+0000 7f940de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f9410105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:19.920 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.027+0000 7f940de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f9410105dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47498/0 (socket says 172.21.15.27:47498) 2024-09-13T17:54:19.920 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.027+0000 7f940de00640 1 -- 172.21.15.27:0/4091805656 learned_addr learned my addr 172.21.15.27:0/4091805656 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:19.921 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.028+0000 7f940de00640 1 -- 172.21.15.27:0/4091805656 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9410106bc0 con 0x7f94101059c0 2024-09-13T17:54:19.921 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.028+0000 7f940de00640 1 --2- 172.21.15.27:0/4091805656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f9410105dc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9400009820 tx=0x7f940002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2366a1c3407232fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:19.921 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.029+0000 7f940ca00640 1 -- 172.21.15.27:0/4091805656 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f940002ae70 con 0x7f94101059c0 2024-09-13T17:54:19.921 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.029+0000 7f940ca00640 1 -- 172.21.15.27:0/4091805656 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f9400032900 con 0x7f94101059c0 2024-09-13T17:54:19.921 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.029+0000 7f940ca00640 1 -- 172.21.15.27:0/4091805656 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94000309d0 con 0x7f94101059c0 2024-09-13T17:54:19.921 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.029+0000 7f9415000640 1 -- 172.21.15.27:0/4091805656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 msgr2=0x7f9410105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:19.921 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.029+0000 7f9415000640 1 --2- 172.21.15.27:0/4091805656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f9410105dc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9400009820 tx=0x7f940002a270 comp rx=0 tx=0).stop 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.029+0000 7f9415000640 1 -- 172.21.15.27:0/4091805656 shutdown_connections 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.029+0000 7f9415000640 1 --2- 172.21.15.27:0/4091805656 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f9410105dc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.029+0000 7f9415000640 1 -- 172.21.15.27:0/4091805656 >> 172.21.15.27:0/4091805656 conn(0x7f9410101130 msgr2=0x7f9410103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.030+0000 7f9415000640 1 -- 172.21.15.27:0/4091805656 shutdown_connections 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.030+0000 7f9415000640 1 -- 172.21.15.27:0/4091805656 wait complete. 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.031+0000 7f9415000640 1 Processor -- start 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.031+0000 7f9415000640 1 -- start start 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.031+0000 7f9415000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f941019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.031+0000 7f9415000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941019bf30 con 0x7f94101059c0 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.031+0000 7f940de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f941019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.031+0000 7f940de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f941019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:47502/0 (socket says 172.21.15.27:47502) 2024-09-13T17:54:19.922 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.031+0000 7f940de00640 1 -- 172.21.15.27:0/2231059434 learned_addr learned my addr 172.21.15.27:0/2231059434 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.032+0000 7f940de00640 1 -- 172.21.15.27:0/2231059434 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94000094d0 con 0x7f94101059c0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.032+0000 7f940de00640 1 --2- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f941019b9f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f940002a790 tx=0x7f9400032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.032+0000 7f9406a00640 1 -- 172.21.15.27:0/2231059434 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9400032db0 con 0x7f94101059c0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.032+0000 7f9406a00640 1 -- 172.21.15.27:0/2231059434 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f940003b8f0 con 0x7f94101059c0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.032+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941019c130 con 0x7f94101059c0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.033+0000 7f9406a00640 1 -- 172.21.15.27:0/2231059434 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f940003a6f0 con 0x7f94101059c0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.033+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941019c5d0 con 0x7f94101059c0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.034+0000 7f9406a00640 1 -- 172.21.15.27:0/2231059434 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f9400039040 con 0x7f94101059c0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.034+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9410109df0 con 0x7f94101059c0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.034+0000 7f9406a00640 1 --2- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f93f4038670 0x7f93f403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.034+0000 7f9406a00640 1 -- 172.21.15.27:0/2231059434 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f940006b920 con 0x7f94101059c0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.034+0000 7f940d400640 1 --2- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f93f4038670 0x7f93f403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:19.923 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.035+0000 7f940d400640 1 --2- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f93f4038670 0x7f93f403ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0098c0 tx=0x7f93fc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.039+0000 7f9406a00640 1 -- 172.21.15.27:0/2231059434 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f94000319f0 con 0x7f94101059c0 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:15.226+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi027", "addr": "172.21.15.27", "target": ["mon-mgr", ""]}) v1 -- 0x7f94101023e0 con 0x7f93f4038670 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.182+0000 7f9406a00640 1 -- 172.21.15.27:0/2231059434 <== mgr.14118 v2:172.21.15.27:6800/1083878216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f94101023e0 con 0x7f93f4038670 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.185+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f93f4038670 msgr2=0x7f93f403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.185+0000 7f9415000640 1 --2- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f93f4038670 0x7f93f403ab30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0098c0 tx=0x7f93fc006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.185+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 msgr2=0x7f941019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.186+0000 7f9415000640 1 --2- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f941019b9f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f940002a790 tx=0x7f9400032670 comp rx=0 tx=0).stop 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.186+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 shutdown_connections 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.186+0000 7f9415000640 1 --2- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f93f4038670 0x7f93f403ab30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.186+0000 7f9415000640 1 --2- 172.21.15.27:0/2231059434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94101059c0 0x7f941019b9f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.186+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 >> 172.21.15.27:0/2231059434 conn(0x7f9410101130 msgr2=0x7f9410101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:19.924 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.186+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 shutdown_connections 2024-09-13T17:54:19.925 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:19.186+0000 7f9415000640 1 -- 172.21.15.27:0/2231059434 wait complete. 2024-09-13T17:54:19.925 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying unmanaged mon service... 2024-09-13T17:54:20.451 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:20 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:20.451 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:20 smithi027 ceph-mon[30611]: Added host smithi027 2024-09-13T17:54:20.451 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:20 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:54:21.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:21 smithi027 ceph-mon[30611]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:21.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:21 smithi027 ceph-mon[30611]: Saving service mon spec with placement count:5 2024-09-13T17:54:21.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:21 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:21.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T17:54:21.908 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.563+0000 7f3a67200640 1 Processor -- start 2024-09-13T17:54:21.908 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.563+0000 7f3a67200640 1 -- start start 2024-09-13T17:54:21.908 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.563+0000 7f3a67200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a60107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.563+0000 7f3a67200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a601085c0 con 0x7f3a60107bf0 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.564+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a60107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.564+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a60107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36682/0 (socket says 172.21.15.27:36682) 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.564+0000 7f3a5fe00640 1 -- 172.21.15.27:0/3374433475 learned_addr learned my addr 172.21.15.27:0/3374433475 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.564+0000 7f3a5fe00640 1 -- 172.21.15.27:0/3374433475 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a60108da0 con 0x7f3a60107bf0 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.565+0000 7f3a5fe00640 1 --2- 172.21.15.27:0/3374433475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a60107ff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009820 tx=0x7f3a5002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509564173d680ce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.565+0000 7f3a5ea00640 1 -- 172.21.15.27:0/3374433475 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a5002ae70 con 0x7f3a60107bf0 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.566+0000 7f3a5ea00640 1 -- 172.21.15.27:0/3374433475 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f3a50032900 con 0x7f3a60107bf0 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.566+0000 7f3a5ea00640 1 -- 172.21.15.27:0/3374433475 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a500309d0 con 0x7f3a60107bf0 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.566+0000 7f3a67200640 1 -- 172.21.15.27:0/3374433475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 msgr2=0x7f3a60107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:21.909 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.566+0000 7f3a67200640 1 --2- 172.21.15.27:0/3374433475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a60107ff0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009820 tx=0x7f3a5002a270 comp rx=0 tx=0).stop 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.566+0000 7f3a67200640 1 -- 172.21.15.27:0/3374433475 shutdown_connections 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.566+0000 7f3a67200640 1 --2- 172.21.15.27:0/3374433475 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a60107ff0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.566+0000 7f3a67200640 1 -- 172.21.15.27:0/3374433475 >> 172.21.15.27:0/3374433475 conn(0x7f3a6007b1e0 msgr2=0x7f3a6007b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.566+0000 7f3a67200640 1 -- 172.21.15.27:0/3374433475 shutdown_connections 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.566+0000 7f3a67200640 1 -- 172.21.15.27:0/3374433475 wait complete. 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.567+0000 7f3a67200640 1 Processor -- start 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.567+0000 7f3a67200640 1 -- start start 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.568+0000 7f3a67200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a6019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.568+0000 7f3a67200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6019bef0 con 0x7f3a60107bf0 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.568+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a6019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.568+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a6019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36692/0 (socket says 172.21.15.27:36692) 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.568+0000 7f3a5fe00640 1 -- 172.21.15.27:0/1651416583 learned_addr learned my addr 172.21.15.27:0/1651416583 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:21.910 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.568+0000 7f3a5fe00640 1 -- 172.21.15.27:0/1651416583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a500094d0 con 0x7f3a60107bf0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.569+0000 7f3a5fe00640 1 --2- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a6019b9b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3a500306e0 tx=0x7f3a50032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.569+0000 7f3a5cc00640 1 -- 172.21.15.27:0/1651416583 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a50032c80 con 0x7f3a60107bf0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.569+0000 7f3a5cc00640 1 -- 172.21.15.27:0/1651416583 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f3a50032de0 con 0x7f3a60107bf0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.569+0000 7f3a5cc00640 1 -- 172.21.15.27:0/1651416583 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a5003a780 con 0x7f3a60107bf0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.569+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6019c0f0 con 0x7f3a60107bf0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.569+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6019c590 con 0x7f3a60107bf0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.571+0000 7f3a5cc00640 1 -- 172.21.15.27:0/1651416583 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f3a50039040 con 0x7f3a60107bf0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.570+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6010bfd0 con 0x7f3a60107bf0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.571+0000 7f3a5cc00640 1 --2- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f3a44038670 0x7f3a4403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.571+0000 7f3a5cc00640 1 -- 172.21.15.27:0/1651416583 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3a5006b960 con 0x7f3a60107bf0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.571+0000 7f3a5f400640 1 --2- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f3a44038670 0x7f3a4403ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.572+0000 7f3a5f400640 1 --2- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f3a44038670 0x7f3a4403ab30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0098c0 tx=0x7f3a4c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:21.911 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.576+0000 7f3a5cc00640 1 -- 172.21.15.27:0/1651416583 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3a50031580 con 0x7f3a60107bf0 2024-09-13T17:54:21.912 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.773+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3a60105d50 con 0x7f3a44038670 2024-09-13T17:54:21.912 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.778+0000 7f3a5cc00640 1 -- 172.21.15.27:0/1651416583 <== mgr.14118 v2:172.21.15.27:6800/1083878216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3a60105d50 con 0x7f3a44038670 2024-09-13T17:54:21.912 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.780+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f3a44038670 msgr2=0x7f3a4403ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:21.912 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.780+0000 7f3a67200640 1 --2- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f3a44038670 0x7f3a4403ab30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0098c0 tx=0x7f3a4c006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:21.912 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.780+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 msgr2=0x7f3a6019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:21.912 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.780+0000 7f3a67200640 1 --2- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a6019b9b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3a500306e0 tx=0x7f3a50032670 comp rx=0 tx=0).stop 2024-09-13T17:54:21.912 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.781+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 shutdown_connections 2024-09-13T17:54:21.912 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.781+0000 7f3a67200640 1 --2- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f3a44038670 0x7f3a4403ab30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:21.913 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.781+0000 7f3a67200640 1 --2- 172.21.15.27:0/1651416583 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3a60107bf0 0x7f3a6019b9b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:21.913 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.781+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 >> 172.21.15.27:0/1651416583 conn(0x7f3a6007b1e0 msgr2=0x7f3a60105640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:21.913 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.781+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 shutdown_connections 2024-09-13T17:54:21.913 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:20.781+0000 7f3a67200640 1 -- 172.21.15.27:0/1651416583 wait complete. 2024-09-13T17:54:21.913 INFO:teuthology.orchestra.run.smithi027.stdout:Deploying unmanaged mgr service... 2024-09-13T17:54:23.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:23 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:23.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:23 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:23.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:23 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:23.901 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.938+0000 7fd3a5a00640 1 Processor -- start 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.938+0000 7fd3a5a00640 1 -- start start 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.939+0000 7fd3a5a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a007a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.939+0000 7fd3a5a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a007a900 con 0x7fd3a007bed0 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.939+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a007a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.939+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a007a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36698/0 (socket says 172.21.15.27:36698) 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.939+0000 7fd39ea00640 1 -- 172.21.15.27:0/1329189862 learned_addr learned my addr 172.21.15.27:0/1329189862 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.939+0000 7fd39ea00640 1 -- 172.21.15.27:0/1329189862 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a007aa40 con 0x7fd3a007bed0 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.940+0000 7fd39ea00640 1 --2- 172.21.15.27:0/1329189862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a007a330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd390009820 tx=0x7fd39002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8436fb0a5a8544e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.941+0000 7fd39e000640 1 -- 172.21.15.27:0/1329189862 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd39002ae70 con 0x7fd3a007bed0 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.941+0000 7fd39e000640 1 -- 172.21.15.27:0/1329189862 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd390032920 con 0x7fd3a007bed0 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.941+0000 7fd39e000640 1 -- 172.21.15.27:0/1329189862 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd390030920 con 0x7fd3a007bed0 2024-09-13T17:54:23.902 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.941+0000 7fd3a5a00640 1 -- 172.21.15.27:0/1329189862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 msgr2=0x7fd3a007a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.941+0000 7fd3a5a00640 1 --2- 172.21.15.27:0/1329189862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a007a330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd390009820 tx=0x7fd39002a270 comp rx=0 tx=0).stop 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.942+0000 7fd3a5a00640 1 -- 172.21.15.27:0/1329189862 shutdown_connections 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.942+0000 7fd3a5a00640 1 --2- 172.21.15.27:0/1329189862 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a007a330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.942+0000 7fd3a5a00640 1 -- 172.21.15.27:0/1329189862 >> 172.21.15.27:0/1329189862 conn(0x7fd3a0101130 msgr2=0x7fd3a0103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.942+0000 7fd3a5a00640 1 -- 172.21.15.27:0/1329189862 shutdown_connections 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.942+0000 7fd3a5a00640 1 -- 172.21.15.27:0/1329189862 wait complete. 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.943+0000 7fd3a5a00640 1 Processor -- start 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.943+0000 7fd3a5a00640 1 -- start start 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.943+0000 7fd3a5a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.943+0000 7fd3a5a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a019bee0 con 0x7fd3a007bed0 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.943+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.943+0000 7fd39ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a019b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36710/0 (socket says 172.21.15.27:36710) 2024-09-13T17:54:23.903 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.943+0000 7fd39ea00640 1 -- 172.21.15.27:0/4109344900 learned_addr learned my addr 172.21.15.27:0/4109344900 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.944+0000 7fd39ea00640 1 -- 172.21.15.27:0/4109344900 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900094d0 con 0x7fd3a007bed0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.944+0000 7fd39ea00640 1 --2- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a019b9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3900097f0 tx=0x7fd390032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.944+0000 7fd397e00640 1 -- 172.21.15.27:0/4109344900 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd390032dd0 con 0x7fd3a007bed0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.944+0000 7fd397e00640 1 -- 172.21.15.27:0/4109344900 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd39003b910 con 0x7fd3a007bed0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.944+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a019c0e0 con 0x7fd3a007bed0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.944+0000 7fd397e00640 1 -- 172.21.15.27:0/4109344900 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd39003a890 con 0x7fd3a007bed0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.944+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a019c580 con 0x7fd3a007bed0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.945+0000 7fd397e00640 1 -- 172.21.15.27:0/4109344900 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd390039040 con 0x7fd3a007bed0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.945+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a010be70 con 0x7fd3a007bed0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.946+0000 7fd397e00640 1 --2- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd384038620 0x7fd38403aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.946+0000 7fd397e00640 1 -- 172.21.15.27:0/4109344900 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd39006b9b0 con 0x7fd3a007bed0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.946+0000 7fd396000640 1 --2- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd384038620 0x7fd38403aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:23.904 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.947+0000 7fd396000640 1 --2- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd384038620 0x7fd38403aae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd3880098c0 tx=0x7fd388006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:22.951+0000 7fd397e00640 1 -- 172.21.15.27:0/4109344900 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd39003be10 con 0x7fd3a007bed0 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.146+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd3a019eec0 con 0x7fd384038620 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.151+0000 7fd397e00640 1 -- 172.21.15.27:0/4109344900 <== mgr.14118 v2:172.21.15.27:6800/1083878216 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd3a019eec0 con 0x7fd384038620 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.153+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd384038620 msgr2=0x7fd38403aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.153+0000 7fd3a5a00640 1 --2- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd384038620 0x7fd38403aae0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd3880098c0 tx=0x7fd388006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.153+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 msgr2=0x7fd3a019b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.153+0000 7fd3a5a00640 1 --2- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a019b9a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd3900097f0 tx=0x7fd390032670 comp rx=0 tx=0).stop 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.154+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 shutdown_connections 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.154+0000 7fd3a5a00640 1 --2- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd384038620 0x7fd38403aae0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.154+0000 7fd3a5a00640 1 --2- 172.21.15.27:0/4109344900 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd3a007bed0 0x7fd3a019b9a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.154+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 >> 172.21.15.27:0/4109344900 conn(0x7fd3a0101130 msgr2=0x7fd3a0101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.154+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 shutdown_connections 2024-09-13T17:54:23.905 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:23.154+0000 7fd3a5a00640 1 -- 172.21.15.27:0/4109344900 wait complete. 2024-09-13T17:54:24.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:24 smithi027 ceph-mon[30611]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:24.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:24 smithi027 ceph-mon[30611]: Saving service mgr spec with placement count:2 2024-09-13T17:54:26.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:25 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1881282838' entity='client.admin' 2024-09-13T17:54:26.088 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.386+0000 7ff412e00640 1 Processor -- start 2024-09-13T17:54:26.088 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.387+0000 7ff412e00640 1 -- start start 2024-09-13T17:54:26.088 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.387+0000 7ff412e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c07fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.387+0000 7ff412e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c080230 con 0x7ff40c07f8f0 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.387+0000 7ff40be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c07fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.387+0000 7ff40be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c07fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36718/0 (socket says 172.21.15.27:36718) 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.387+0000 7ff40be00640 1 -- 172.21.15.27:0/346613462 learned_addr learned my addr 172.21.15.27:0/346613462 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.388+0000 7ff40be00640 1 -- 172.21.15.27:0/346613462 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c080370 con 0x7ff40c07f8f0 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.388+0000 7ff40be00640 1 --2- 172.21.15.27:0/346613462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c07fcf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009820 tx=0x7ff3fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65195f0734f7bcf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.389+0000 7ff40aa00640 1 -- 172.21.15.27:0/346613462 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc02ae70 con 0x7ff40c07f8f0 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.389+0000 7ff40aa00640 1 -- 172.21.15.27:0/346613462 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff3fc032920 con 0x7ff40c07f8f0 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.389+0000 7ff40aa00640 1 -- 172.21.15.27:0/346613462 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc030920 con 0x7ff40c07f8f0 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.389+0000 7ff412e00640 1 -- 172.21.15.27:0/346613462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 msgr2=0x7ff40c07fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.389+0000 7ff412e00640 1 --2- 172.21.15.27:0/346613462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c07fcf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009820 tx=0x7ff3fc02a270 comp rx=0 tx=0).stop 2024-09-13T17:54:26.089 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.390+0000 7ff412e00640 1 -- 172.21.15.27:0/346613462 shutdown_connections 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.390+0000 7ff412e00640 1 --2- 172.21.15.27:0/346613462 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c07fcf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.390+0000 7ff412e00640 1 -- 172.21.15.27:0/346613462 >> 172.21.15.27:0/346613462 conn(0x7ff40c07b0b0 msgr2=0x7ff40c07d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.390+0000 7ff412e00640 1 -- 172.21.15.27:0/346613462 shutdown_connections 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.390+0000 7ff412e00640 1 -- 172.21.15.27:0/346613462 wait complete. 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.391+0000 7ff412e00640 1 Processor -- start 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.391+0000 7ff412e00640 1 -- start start 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.391+0000 7ff412e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.391+0000 7ff412e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c1a01a0 con 0x7ff40c07f8f0 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.391+0000 7ff40be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.392+0000 7ff40be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c19fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36722/0 (socket says 172.21.15.27:36722) 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.392+0000 7ff40be00640 1 -- 172.21.15.27:0/1881282838 learned_addr learned my addr 172.21.15.27:0/1881282838 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.392+0000 7ff40be00640 1 -- 172.21.15.27:0/1881282838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0094d0 con 0x7ff40c07f8f0 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.392+0000 7ff40be00640 1 --2- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c19fc60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0097f0 tx=0x7ff3fc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:26.090 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.392+0000 7ff408c00640 1 -- 172.21.15.27:0/1881282838 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc032dd0 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.393+0000 7ff408c00640 1 -- 172.21.15.27:0/1881282838 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff3fc03b910 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.393+0000 7ff408c00640 1 -- 172.21.15.27:0/1881282838 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc03a890 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.393+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c1a0400 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.393+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c1a3120 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.394+0000 7ff408c00640 1 -- 172.21.15.27:0/1881282838 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7ff3fc039040 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.394+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c07fd70 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.395+0000 7ff408c00640 1 --2- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff3f0038670 0x7ff3f003ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.395+0000 7ff408c00640 1 -- 172.21.15.27:0/1881282838 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff3fc06b980 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.395+0000 7ff40b400640 1 --2- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff3f0038670 0x7ff3f003ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.396+0000 7ff40b400640 1 --2- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff3f0038670 0x7ff3f003ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80098c0 tx=0x7ff3f8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.399+0000 7ff408c00640 1 -- 172.21.15.27:0/1881282838 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff3fc031580 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.631+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7ff40c1a3500 con 0x7ff40c07f8f0 2024-09-13T17:54:26.091 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.635+0000 7ff408c00640 1 -- 172.21.15.27:0/1881282838 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7ff3fc03f030 con 0x7ff40c07f8f0 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.637+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff3f0038670 msgr2=0x7ff3f003ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.637+0000 7ff412e00640 1 --2- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff3f0038670 0x7ff3f003ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80098c0 tx=0x7ff3f8006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.637+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 msgr2=0x7ff40c19fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.637+0000 7ff412e00640 1 --2- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c19fc60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0097f0 tx=0x7ff3fc032670 comp rx=0 tx=0).stop 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.637+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 shutdown_connections 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.637+0000 7ff412e00640 1 --2- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff3f0038670 0x7ff3f003ab30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.638+0000 7ff412e00640 1 --2- 172.21.15.27:0/1881282838 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff40c07f8f0 0x7ff40c19fc60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.638+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 >> 172.21.15.27:0/1881282838 conn(0x7ff40c07b0b0 msgr2=0x7ff40c07bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.638+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 shutdown_connections 2024-09-13T17:54:26.092 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:24.638+0000 7ff412e00640 1 -- 172.21.15.27:0/1881282838 wait complete. 2024-09-13T17:54:27.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:27 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:27.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:27 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2261310381' entity='client.admin' 2024-09-13T17:54:27.726 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.800+0000 7fd61d200640 1 Processor -- start 2024-09-13T17:54:27.726 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.800+0000 7fd61d200640 1 -- start start 2024-09-13T17:54:27.726 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.800+0000 7fd61d200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd618108020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.800+0000 7fd61d200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6181085f0 con 0x7fd618107c20 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.801+0000 7fd615e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd618108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.801+0000 7fd615e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd618108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36734/0 (socket says 172.21.15.27:36734) 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.801+0000 7fd615e00640 1 -- 172.21.15.27:0/332472349 learned_addr learned my addr 172.21.15.27:0/332472349 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.801+0000 7fd615e00640 1 -- 172.21.15.27:0/332472349 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd618108dd0 con 0x7fd618107c20 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.802+0000 7fd615e00640 1 --2- 172.21.15.27:0/332472349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd618108020 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd608009820 tx=0x7fd60802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c233afe2961b4c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.802+0000 7fd615400640 1 -- 172.21.15.27:0/332472349 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd60802ae70 con 0x7fd618107c20 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.802+0000 7fd615400640 1 -- 172.21.15.27:0/332472349 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd608032920 con 0x7fd618107c20 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.802+0000 7fd615400640 1 -- 172.21.15.27:0/332472349 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd608030920 con 0x7fd618107c20 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.803+0000 7fd61d200640 1 -- 172.21.15.27:0/332472349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 msgr2=0x7fd618108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.803+0000 7fd61d200640 1 --2- 172.21.15.27:0/332472349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd618108020 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd608009820 tx=0x7fd60802a270 comp rx=0 tx=0).stop 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.803+0000 7fd61d200640 1 -- 172.21.15.27:0/332472349 shutdown_connections 2024-09-13T17:54:27.727 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.803+0000 7fd61d200640 1 --2- 172.21.15.27:0/332472349 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd618108020 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.803+0000 7fd61d200640 1 -- 172.21.15.27:0/332472349 >> 172.21.15.27:0/332472349 conn(0x7fd61807b250 msgr2=0x7fd61807b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.803+0000 7fd61d200640 1 -- 172.21.15.27:0/332472349 shutdown_connections 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.803+0000 7fd61d200640 1 -- 172.21.15.27:0/332472349 wait complete. 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.804+0000 7fd61d200640 1 Processor -- start 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.804+0000 7fd61d200640 1 -- start start 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.804+0000 7fd61d200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd61819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.804+0000 7fd61d200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61819bef0 con 0x7fd618107c20 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.805+0000 7fd615e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd61819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.805+0000 7fd615e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd61819b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36736/0 (socket says 172.21.15.27:36736) 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.805+0000 7fd615e00640 1 -- 172.21.15.27:0/2261310381 learned_addr learned my addr 172.21.15.27:0/2261310381 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.805+0000 7fd615e00640 1 -- 172.21.15.27:0/2261310381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080094d0 con 0x7fd618107c20 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.805+0000 7fd615e00640 1 --2- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd61819b9b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6080097f0 tx=0x7fd608032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:27.728 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.806+0000 7fd60ea00640 1 -- 172.21.15.27:0/2261310381 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd608032dd0 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.806+0000 7fd60ea00640 1 -- 172.21.15.27:0/2261310381 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd60803b910 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.806+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61819c0f0 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.806+0000 7fd60ea00640 1 -- 172.21.15.27:0/2261310381 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd60803a890 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.806+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61819c590 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.807+0000 7fd60ea00640 1 -- 172.21.15.27:0/2261310381 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fd608039040 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.807+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61810c000 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.807+0000 7fd60ea00640 1 --2- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd5fc038620 0x7fd5fc03aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.807+0000 7fd60ea00640 1 -- 172.21.15.27:0/2261310381 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd60806b9b0 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.808+0000 7fd60fe00640 1 --2- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd5fc038620 0x7fd5fc03aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.808+0000 7fd60fe00640 1 --2- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd5fc038620 0x7fd5fc03aae0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd6000098c0 tx=0x7fd600006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:26.812+0000 7fd60ea00640 1 -- 172.21.15.27:0/2261310381 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd608031580 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.002+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fd61810c270 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.007+0000 7fd60ea00640 1 -- 172.21.15.27:0/2261310381 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fd60803f030 con 0x7fd618107c20 2024-09-13T17:54:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.010+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd5fc038620 msgr2=0x7fd5fc03aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.010+0000 7fd61d200640 1 --2- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd5fc038620 0x7fd5fc03aae0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd6000098c0 tx=0x7fd600006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.010+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 msgr2=0x7fd61819b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.010+0000 7fd61d200640 1 --2- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd61819b9b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd6080097f0 tx=0x7fd608032670 comp rx=0 tx=0).stop 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.010+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 shutdown_connections 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.010+0000 7fd61d200640 1 --2- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fd5fc038620 0x7fd5fc03aae0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.010+0000 7fd61d200640 1 --2- 172.21.15.27:0/2261310381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd618107c20 0x7fd61819b9b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.010+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 >> 172.21.15.27:0/2261310381 conn(0x7fd61807b250 msgr2=0x7fd6181056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.010+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 shutdown_connections 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:27.011+0000 7fd61d200640 1 -- 172.21.15.27:0/2261310381 wait complete. 2024-09-13T17:54:27.730 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling the dashboard module... 2024-09-13T17:54:28.345 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:28 smithi027 ceph-mon[30611]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:54:28.345 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:28 smithi027 ceph-mon[30611]: from='mgr.14118 172.21.15.27:0/1969861111' entity='mgr.x' 2024-09-13T17:54:29.396 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:29 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2046569364' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T17:54:29.397 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: ignoring --setuser ceph since I am not root 2024-09-13T17:54:29.397 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: ignoring --setgroup ceph since I am not root 2024-09-13T17:54:29.397 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:29.393+0000 7f4f29f74040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:54:29.664 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:29.468+0000 7f4f29f74040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:54:29.664 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:29.661+0000 7f4f29f74040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:54:29.917 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:29.745+0000 7f4f29f74040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:54:30.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:30 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2046569364' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T17:54:30.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:30 smithi027 ceph-mon[30611]: mgrmap e9: x(active, since 22s) 2024-09-13T17:54:30.307 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:29.925+0000 7f4f29f74040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:54:30.307 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:30.097+0000 7f4f29f74040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:54:30.633 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:30.475+0000 7f4f29f74040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:54:30.633 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:30.550+0000 7f4f29f74040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:54:30.645 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.457+0000 7f2f19e00640 1 Processor -- start 2024-09-13T17:54:30.645 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.457+0000 7f2f19e00640 1 -- start start 2024-09-13T17:54:30.645 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.457+0000 7f2f19e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f14105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:30.645 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.457+0000 7f2f19e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f14106390 con 0x7f2f141059c0 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.458+0000 7f2f12a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f14105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.458+0000 7f2f12a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f14105dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36740/0 (socket says 172.21.15.27:36740) 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.458+0000 7f2f12a00640 1 -- 172.21.15.27:0/2691491487 learned_addr learned my addr 172.21.15.27:0/2691491487 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.458+0000 7f2f12a00640 1 -- 172.21.15.27:0/2691491487 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f14106bc0 con 0x7f2f141059c0 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.459+0000 7f2f12a00640 1 --2- 172.21.15.27:0/2691491487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f14105dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009820 tx=0x7f2f0402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3510096f0b7740d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.459+0000 7f2f11600640 1 -- 172.21.15.27:0/2691491487 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f0402ae70 con 0x7f2f141059c0 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.460+0000 7f2f11600640 1 -- 172.21.15.27:0/2691491487 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2f04032920 con 0x7f2f141059c0 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.460+0000 7f2f11600640 1 -- 172.21.15.27:0/2691491487 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f04030920 con 0x7f2f141059c0 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.460+0000 7f2f19e00640 1 -- 172.21.15.27:0/2691491487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 msgr2=0x7f2f14105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.460+0000 7f2f19e00640 1 --2- 172.21.15.27:0/2691491487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f14105dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2f04009820 tx=0x7f2f0402a270 comp rx=0 tx=0).stop 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.460+0000 7f2f19e00640 1 -- 172.21.15.27:0/2691491487 shutdown_connections 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.460+0000 7f2f19e00640 1 --2- 172.21.15.27:0/2691491487 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f14105dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:30.646 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.460+0000 7f2f19e00640 1 -- 172.21.15.27:0/2691491487 >> 172.21.15.27:0/2691491487 conn(0x7f2f14101130 msgr2=0x7f2f14103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.460+0000 7f2f19e00640 1 -- 172.21.15.27:0/2691491487 shutdown_connections 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.460+0000 7f2f19e00640 1 -- 172.21.15.27:0/2691491487 wait complete. 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.461+0000 7f2f19e00640 1 Processor -- start 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.462+0000 7f2f19e00640 1 -- start start 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.462+0000 7f2f19e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f1419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.462+0000 7f2f19e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1419bf00 con 0x7f2f141059c0 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.462+0000 7f2f12a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f1419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.462+0000 7f2f12a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f1419b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36746/0 (socket says 172.21.15.27:36746) 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.462+0000 7f2f12a00640 1 -- 172.21.15.27:0/2046569364 learned_addr learned my addr 172.21.15.27:0/2046569364 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.462+0000 7f2f12a00640 1 -- 172.21.15.27:0/2046569364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040094d0 con 0x7f2f141059c0 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.463+0000 7f2f12a00640 1 --2- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f1419b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097f0 tx=0x7f2f04032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.463+0000 7f2f18a00640 1 -- 172.21.15.27:0/2046569364 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f04032dd0 con 0x7f2f141059c0 2024-09-13T17:54:30.647 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.463+0000 7f2f18a00640 1 -- 172.21.15.27:0/2046569364 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2f0403b910 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.463+0000 7f2f18a00640 1 -- 172.21.15.27:0/2046569364 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f0403a890 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.463+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1419c100 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.463+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1419c5a0 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.464+0000 7f2f18a00640 1 -- 172.21.15.27:0/2046569364 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f2f04039040 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.464+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f14109df0 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.465+0000 7f2f18a00640 1 --2- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f2ef8038670 0x7f2ef803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.465+0000 7f2f18a00640 1 -- 172.21.15.27:0/2046569364 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2f0406b950 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.465+0000 7f2f12000640 1 --2- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f2ef8038670 0x7f2ef803ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.466+0000 7f2f12000640 1 --2- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f2ef8038670 0x7f2ef803ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2f000098c0 tx=0x7f2f00006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.470+0000 7f2f18a00640 1 -- 172.21.15.27:0/2046569364 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2f0403be10 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:28.719+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f2f1410a060 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.142+0000 7f2f18a00640 1 -- 172.21.15.27:0/2046569364 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f2f0403b430 con 0x7f2f141059c0 2024-09-13T17:54:30.648 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.143+0000 7f2f18a00640 1 -- 172.21.15.27:0/2046569364 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f2f0406b2a0 con 0x7f2f141059c0 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f2ef8038670 msgr2=0x7f2ef803ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 --2- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f2ef8038670 0x7f2ef803ab30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2f000098c0 tx=0x7f2f00006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 msgr2=0x7f2f1419b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 --2- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f1419b9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2f040097f0 tx=0x7f2f04032670 comp rx=0 tx=0).stop 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 shutdown_connections 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 --2- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7f2ef8038670 0x7f2ef803ab30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 --2- 172.21.15.27:0/2046569364 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f141059c0 0x7f2f1419b9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 >> 172.21.15.27:0/2046569364 conn(0x7f2f14101130 msgr2=0x7f2f14101c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 shutdown_connections 2024-09-13T17:54:30.649 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:29.146+0000 7f2f19e00640 1 -- 172.21.15.27:0/2046569364 wait complete. 2024-09-13T17:54:30.906 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:30.774+0000 7f4f29f74040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:54:31.725 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:31 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1159056758' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T17:54:32.021 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:31 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:31.936+0000 7f4f29f74040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:54:32.021 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:32 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:32.018+0000 7f4f29f74040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.175+0000 7fe9f4800640 1 Processor -- start 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.175+0000 7fe9f4800640 1 -- start start 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.175+0000 7fe9f4800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec107c20 0x7fe9ec108020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:32.074 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.175+0000 7fe9f4800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec1085f0 con 0x7fe9ec107c20 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.175+0000 7fe9f1e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec107c20 0x7fe9ec108020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.176+0000 7fe9f1e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec107c20 0x7fe9ec108020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52938/0 (socket says 172.21.15.27:52938) 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.176+0000 7fe9f1e00640 1 -- 172.21.15.27:0/3916019250 learned_addr learned my addr 172.21.15.27:0/3916019250 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.176+0000 7fe9f1e00640 1 -- 172.21.15.27:0/3916019250 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec108dd0 con 0x7fe9ec107c20 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.178+0000 7fe9f1e00640 1 --2- 172.21.15.27:0/3916019250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec107c20 0x7fe9ec108020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009820 tx=0x7fe9e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293fc7ce0faed928 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.178+0000 7fe9f0a00640 1 -- 172.21.15.27:0/3916019250 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9e002ae70 con 0x7fe9ec107c20 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.178+0000 7fe9f0a00640 1 -- 172.21.15.27:0/3916019250 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe9e0032920 con 0x7fe9ec107c20 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.178+0000 7fe9f0a00640 1 -- 172.21.15.27:0/3916019250 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9e0030920 con 0x7fe9ec107c20 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.179+0000 7fe9f4800640 1 -- 172.21.15.27:0/3916019250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec107c20 msgr2=0x7fe9ec108020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.179+0000 7fe9f4800640 1 --2- 172.21.15.27:0/3916019250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec107c20 0x7fe9ec108020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009820 tx=0x7fe9e002a270 comp rx=0 tx=0).stop 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.179+0000 7fe9f4800640 1 -- 172.21.15.27:0/3916019250 shutdown_connections 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.179+0000 7fe9f4800640 1 --2- 172.21.15.27:0/3916019250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec107c20 0x7fe9ec108020 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.179+0000 7fe9f4800640 1 -- 172.21.15.27:0/3916019250 >> 172.21.15.27:0/3916019250 conn(0x7fe9ec07b250 msgr2=0x7fe9ec07b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:32.075 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.179+0000 7fe9f4800640 1 -- 172.21.15.27:0/3916019250 shutdown_connections 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.179+0000 7fe9f4800640 1 -- 172.21.15.27:0/3916019250 wait complete. 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.180+0000 7fe9f4800640 1 Processor -- start 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.180+0000 7fe9f4800640 1 -- start start 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.180+0000 7fe9f4800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec19bb60 0x7fe9ec19bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.180+0000 7fe9f4800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec19c4c0 con 0x7fe9ec19bb60 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.181+0000 7fe9f1e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec19bb60 0x7fe9ec19bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.181+0000 7fe9f1e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec19bb60 0x7fe9ec19bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52944/0 (socket says 172.21.15.27:52944) 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.181+0000 7fe9f1e00640 1 -- 172.21.15.27:0/1159056758 learned_addr learned my addr 172.21.15.27:0/1159056758 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.181+0000 7fe9f1e00640 1 -- 172.21.15.27:0/1159056758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00094d0 con 0x7fe9ec19bb60 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.181+0000 7fe9f1e00640 1 --2- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec19bb60 0x7fe9ec19bf80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009940 tx=0x7fe9e0032650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.182+0000 7fe9e6a00640 1 -- 172.21.15.27:0/1159056758 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9e0032ca0 con 0x7fe9ec19bb60 2024-09-13T17:54:32.076 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.182+0000 7fe9e6a00640 1 -- 172.21.15.27:0/1159056758 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe9e0032e00 con 0x7fe9ec19bb60 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.182+0000 7fe9e6a00640 1 -- 172.21.15.27:0/1159056758 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe9e003a5b0 con 0x7fe9ec19bb60 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.182+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec19c6c0 con 0x7fe9ec19bb60 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.182+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec19f230 con 0x7fe9ec19bb60 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.183+0000 7fe9e6a00640 1 -- 172.21.15.27:0/1159056758 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fe9e0039040 con 0x7fe9ec19bb60 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.183+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec10c000 con 0x7fe9ec19bb60 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.184+0000 7fe9e6a00640 1 --2- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fe9d4038670 0x7fe9d403ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.184+0000 7fe9e6a00640 1 -- 172.21.15.27:0/1159056758 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe9e006b700 con 0x7fe9ec19bb60 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.184+0000 7fe9f1400640 1 -- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fe9d4038670 msgr2=0x7fe9d403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/1083878216 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.184+0000 7fe9f1400640 1 --2- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fe9d4038670 0x7fe9d403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.188+0000 7fe9e6a00640 1 -- 172.21.15.27:0/1159056758 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe9e0031580 con 0x7fe9ec19bb60 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.385+0000 7fe9f1400640 1 -- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fe9d4038670 msgr2=0x7fe9d403ab30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/1083878216 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.385+0000 7fe9f1400640 1 --2- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fe9d4038670 0x7fe9d403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:54:32.077 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.417+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fe9ec19f3c0 con 0x7fe9ec19bb60 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.418+0000 7fe9e6a00640 1 -- 172.21.15.27:0/1159056758 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fe9e003f020 con 0x7fe9ec19bb60 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.420+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fe9d4038670 msgr2=0x7fe9d403ab30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.420+0000 7fe9f4800640 1 --2- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fe9d4038670 0x7fe9d403ab30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.420+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec19bb60 msgr2=0x7fe9ec19bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.420+0000 7fe9f4800640 1 --2- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec19bb60 0x7fe9ec19bf80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009940 tx=0x7fe9e0032650 comp rx=0 tx=0).stop 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.421+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 shutdown_connections 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.421+0000 7fe9f4800640 1 --2- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7fe9d4038670 0x7fe9d403ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.421+0000 7fe9f4800640 1 --2- 172.21.15.27:0/1159056758 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec19bb60 0x7fe9ec19bf80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.421+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 >> 172.21.15.27:0/1159056758 conn(0x7fe9ec07b250 msgr2=0x7fe9ec105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.421+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 shutdown_connections 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:31.421+0000 7fe9f4800640 1 -- 172.21.15.27:0/1159056758 wait complete. 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for the mgr to restart... 2024-09-13T17:54:32.078 INFO:teuthology.orchestra.run.smithi027.stdout:Waiting for mgr epoch 9... 2024-09-13T17:54:33.306 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:33.002+0000 7f4f29f74040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:54:33.307 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:33.144+0000 7f4f29f74040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:54:33.570 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:33.315+0000 7f4f29f74040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:54:33.570 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:33.390+0000 7f4f29f74040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:54:33.570 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:33.567+0000 7f4f29f74040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:54:33.917 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:33.652+0000 7f4f29f74040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:54:33.917 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:33.726+0000 7f4f29f74040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:54:33.917 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:33.913+0000 7f4f29f74040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:54:34.181 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:33.994+0000 7f4f29f74040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:54:34.181 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:34.076+0000 7f4f29f74040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:54:34.181 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:34.177+0000 7f4f29f74040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:54:34.556 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:34.251+0000 7f4f29f74040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:54:34.557 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:34.324+0000 7f4f29f74040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:54:35.552 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:35.272+0000 7f4f29f74040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:54:35.552 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: Active manager daemon x restarted 2024-09-13T17:54:35.552 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: Activating manager daemon x 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: mgrmap e10: x(active, starting, since 0.003671s) 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: Manager daemon x is now available 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:54:35.553 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-13T17:54:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-13T17:54:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:36 smithi027 ceph-mon[30611]: mgrmap e11: x(active, since 1.00759s) 2024-09-13T17:54:37.215 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout { 2024-09-13T17:54:37.215 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout } 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.622+0000 7ff6d2000640 1 Processor -- start 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.622+0000 7ff6d2000640 1 -- start start 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.622+0000 7ff6d2000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.622+0000 7ff6d2000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc07a900 con 0x7ff6cc07be80 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.623+0000 7ff6cb400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.623+0000 7ff6cb400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52958/0 (socket says 172.21.15.27:52958) 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.623+0000 7ff6cb400640 1 -- 172.21.15.27:0/3978945723 learned_addr learned my addr 172.21.15.27:0/3978945723 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.623+0000 7ff6cb400640 1 -- 172.21.15.27:0/3978945723 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc07aa40 con 0x7ff6cc07be80 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.624+0000 7ff6cb400640 1 --2- 172.21.15.27:0/3978945723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc07a330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009820 tx=0x7ff6bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8818274db350364 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:37.216 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.624+0000 7ff6ca000640 1 -- 172.21.15.27:0/3978945723 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc02ae70 con 0x7ff6cc07be80 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.625+0000 7ff6ca000640 1 -- 172.21.15.27:0/3978945723 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff6bc032920 con 0x7ff6cc07be80 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.625+0000 7ff6ca000640 1 -- 172.21.15.27:0/3978945723 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc030920 con 0x7ff6cc07be80 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.625+0000 7ff6d2000640 1 -- 172.21.15.27:0/3978945723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 msgr2=0x7ff6cc07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.625+0000 7ff6d2000640 1 --2- 172.21.15.27:0/3978945723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc07a330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009820 tx=0x7ff6bc02a270 comp rx=0 tx=0).stop 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.625+0000 7ff6d2000640 1 -- 172.21.15.27:0/3978945723 shutdown_connections 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.625+0000 7ff6d2000640 1 --2- 172.21.15.27:0/3978945723 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc07a330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.625+0000 7ff6d2000640 1 -- 172.21.15.27:0/3978945723 >> 172.21.15.27:0/3978945723 conn(0x7ff6cc101180 msgr2=0x7ff6cc1035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.625+0000 7ff6d2000640 1 -- 172.21.15.27:0/3978945723 shutdown_connections 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.625+0000 7ff6d2000640 1 -- 172.21.15.27:0/3978945723 wait complete. 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.626+0000 7ff6d2000640 1 Processor -- start 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.627+0000 7ff6d2000640 1 -- start start 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.627+0000 7ff6d2000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:37.217 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.627+0000 7ff6d2000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc1a0280 con 0x7ff6cc07be80 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.627+0000 7ff6cb400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.627+0000 7ff6cb400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:52968/0 (socket says 172.21.15.27:52968) 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.627+0000 7ff6cb400640 1 -- 172.21.15.27:0/3628999543 learned_addr learned my addr 172.21.15.27:0/3628999543 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.628+0000 7ff6cb400640 1 -- 172.21.15.27:0/3628999543 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc0094d0 con 0x7ff6cc07be80 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.628+0000 7ff6cb400640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc19fd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0097f0 tx=0x7ff6bc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.628+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc032dd0 con 0x7ff6cc07be80 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.628+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff6bc03b910 con 0x7ff6cc07be80 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.628+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6bc03a890 con 0x7ff6cc07be80 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.628+0000 7ff6d2000640 1 -- 172.21.15.27:0/3628999543 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc1a0480 con 0x7ff6cc07be80 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.628+0000 7ff6d2000640 1 -- 172.21.15.27:0/3628999543 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc1a0920 con 0x7ff6cc07be80 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.630+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7ff6bc039040 con 0x7ff6cc07be80 2024-09-13T17:54:37.218 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.630+0000 7ff6c3e00640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 0x7ff6b003ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.630+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 --> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b003b290 con 0x7ff6b00386c0 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.631+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff6bc06ba40 con 0x7ff6cc07be80 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.631+0000 7ff6caa00640 1 -- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 msgr2=0x7ff6b003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/1083878216 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.631+0000 7ff6caa00640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 0x7ff6b003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.832+0000 7ff6caa00640 1 -- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 msgr2=0x7ff6b003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/1083878216 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:32.832+0000 7ff6caa00640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 0x7ff6b003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:33.233+0000 7ff6caa00640 1 -- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 msgr2=0x7ff6b003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/1083878216 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:33.233+0000 7ff6caa00640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 0x7ff6b003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:34.034+0000 7ff6caa00640 1 -- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 msgr2=0x7ff6b003ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.27:6800/1083878216 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:34.034+0000 7ff6caa00640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 0x7ff6b003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:35.276+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7ff6bc06a7b0 con 0x7ff6cc07be80 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:35.276+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 msgr2=0x7ff6b003ab80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:54:37.219 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:35.276+0000 7ff6c3e00640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 0x7ff6b003ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.278+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7ff6bc02fd40 con 0x7ff6cc07be80 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.278+0000 7ff6c3e00640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6b003bfb0 0x7ff6b003e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.278+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6b003b290 con 0x7ff6b003bfb0 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.279+0000 7ff6caa00640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6b003bfb0 0x7ff6b003e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.281+0000 7ff6caa00640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6b003bfb0 0x7ff6b003e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8003980 tx=0x7ff6b80092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.281+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7ff6b003b290 con 0x7ff6b003bfb0 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.287+0000 7ff6d2000640 1 -- 172.21.15.27:0/3628999543 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff6cc107a10 con 0x7ff6b003bfb0 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6c3e00640 1 -- 172.21.15.27:0/3628999543 <== mgr.14150 v2:172.21.15.27:6800/3586663065 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7ff6cc107a10 con 0x7ff6b003bfb0 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 -- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6b003bfb0 msgr2=0x7ff6b003e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6b003bfb0 0x7ff6b003e3a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8003980 tx=0x7ff6b80092b0 comp rx=0 tx=0).stop 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 -- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 msgr2=0x7ff6cc19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc19fd40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0097f0 tx=0x7ff6bc032670 comp rx=0 tx=0).stop 2024-09-13T17:54:37.220 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 -- 172.21.15.27:0/3628999543 shutdown_connections 2024-09-13T17:54:37.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6b003bfb0 0x7ff6b003e3a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:37.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:6800/1083878216,v1:172.21.15.27:6801/1083878216] conn(0x7ff6b00386c0 0x7ff6b003ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:37.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 --2- 172.21.15.27:0/3628999543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff6cc07be80 0x7ff6cc19fd40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:37.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 -- 172.21.15.27:0/3628999543 >> 172.21.15.27:0/3628999543 conn(0x7ff6cc101180 msgr2=0x7ff6cc103570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:37.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.288+0000 7ff6d2000640 1 -- 172.21.15.27:0/3628999543 shutdown_connections 2024-09-13T17:54:37.221 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:36.289+0000 7ff6d2000640 1 -- 172.21.15.27:0/3628999543 wait complete. 2024-09-13T17:54:37.221 INFO:teuthology.orchestra.run.smithi027.stdout:mgr epoch 9 is available 2024-09-13T17:54:37.221 INFO:teuthology.orchestra.run.smithi027.stdout:Generating a dashboard self-signed certificate... 2024-09-13T17:54:37.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-mon[30611]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T17:54:37.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-mon[30611]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:37.562+0000 7f4e87400640 -1 log_channel(cephadm) log [ERR] : [13/Sep/2024:17:54:37] ENGINE Error in HTTPServer.serve 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: Traceback (most recent call last): 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: self._connections.run(self.expiration_interval) 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: self._run(expiration_interval) 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:54:37.836 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:54:37.837 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:54:37.837 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: s = self.context.wrap_socket( 2024-09-13T17:54:37.837 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:54:37.837 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: return self.sslsocket_class._create( 2024-09-13T17:54:37.837 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:54:37.837 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: self.do_handshake() 2024-09-13T17:54:37.837 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:54:37.837 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: self._sslobj.do_handshake() 2024-09-13T17:54:37.838 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:54:37.838 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:54:37 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:54:38.658 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:38 smithi027 ceph-mon[30611]: mgrmap e12: x(active, since 2s) 2024-09-13T17:54:38.658 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:38 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:37] ENGINE Bus STARTING 2024-09-13T17:54:38.658 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:38 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:37] ENGINE Serving on https://172.21.15.27:7150 2024-09-13T17:54:38.658 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:38 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:37] ENGINE Error in HTTPServer.serve 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: Traceback (most recent call last): 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._connections.run(self.expiration_interval) 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._run(expiration_interval) 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: s = self.context.wrap_socket( 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T17:54:38.659 INFO:journalctl@ceph.mon.a.smithi027.stdout: return self.sslsocket_class._create( 2024-09-13T17:54:38.660 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T17:54:38.660 INFO:journalctl@ceph.mon.a.smithi027.stdout: self.do_handshake() 2024-09-13T17:54:38.660 INFO:journalctl@ceph.mon.a.smithi027.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T17:54:38.660 INFO:journalctl@ceph.mon.a.smithi027.stdout: self._sslobj.do_handshake() 2024-09-13T17:54:38.660 INFO:journalctl@ceph.mon.a.smithi027.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T17:54:38.660 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:38 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:37] ENGINE Serving on http://172.21.15.27:8765 2024-09-13T17:54:38.660 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:38 smithi027 ceph-mon[30611]: [13/Sep/2024:17:54:37] ENGINE Bus STARTED 2024-09-13T17:54:38.660 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:38.983 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.074+0000 7f6dbf000640 1 Processor -- start 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.074+0000 7f6dbf000640 1 -- start start 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.074+0000 7f6dbf000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db8105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.074+0000 7f6dbf000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8106390 con 0x7f6db81059c0 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.075+0000 7f6db7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db8105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.075+0000 7f6db7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db8105dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53034/0 (socket says 172.21.15.27:53034) 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.075+0000 7f6db7e00640 1 -- 172.21.15.27:0/71417289 learned_addr learned my addr 172.21.15.27:0/71417289 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.075+0000 7f6db7e00640 1 -- 172.21.15.27:0/71417289 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8106bc0 con 0x7f6db81059c0 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.076+0000 7f6db7e00640 1 --2- 172.21.15.27:0/71417289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db8105dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009820 tx=0x7f6da802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d70891df8b4594c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.076+0000 7f6db6a00640 1 -- 172.21.15.27:0/71417289 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6da802ae70 con 0x7f6db81059c0 2024-09-13T17:54:38.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.077+0000 7f6db6a00640 1 -- 172.21.15.27:0/71417289 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6da8032920 con 0x7f6db81059c0 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.077+0000 7f6db6a00640 1 -- 172.21.15.27:0/71417289 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6da8030920 con 0x7f6db81059c0 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.077+0000 7f6dbf000640 1 -- 172.21.15.27:0/71417289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 msgr2=0x7f6db8105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.077+0000 7f6dbf000640 1 --2- 172.21.15.27:0/71417289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db8105dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009820 tx=0x7f6da802a270 comp rx=0 tx=0).stop 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.077+0000 7f6dbf000640 1 -- 172.21.15.27:0/71417289 shutdown_connections 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.077+0000 7f6dbf000640 1 --2- 172.21.15.27:0/71417289 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db8105dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.077+0000 7f6dbf000640 1 -- 172.21.15.27:0/71417289 >> 172.21.15.27:0/71417289 conn(0x7f6db8101130 msgr2=0x7f6db8103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.077+0000 7f6dbf000640 1 -- 172.21.15.27:0/71417289 shutdown_connections 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.077+0000 7f6dbf000640 1 -- 172.21.15.27:0/71417289 wait complete. 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.079+0000 7f6dbf000640 1 Processor -- start 2024-09-13T17:54:38.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.079+0000 7f6dbf000640 1 -- start start 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.079+0000 7f6dbf000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db807bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.079+0000 7f6dbf000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db807c0a0 con 0x7f6db81059c0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.080+0000 7f6db7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db807bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.080+0000 7f6db7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db807bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53038/0 (socket says 172.21.15.27:53038) 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.080+0000 7f6db7e00640 1 -- 172.21.15.27:0/2362576295 learned_addr learned my addr 172.21.15.27:0/2362576295 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.080+0000 7f6db7e00640 1 -- 172.21.15.27:0/2362576295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da80094d0 con 0x7f6db81059c0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.080+0000 7f6db7e00640 1 --2- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db807bb60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6da80097f0 tx=0x7f6da8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.081+0000 7f6db4c00640 1 -- 172.21.15.27:0/2362576295 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6da8032dd0 con 0x7f6db81059c0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.081+0000 7f6db4c00640 1 -- 172.21.15.27:0/2362576295 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6da803b910 con 0x7f6db81059c0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.081+0000 7f6db4c00640 1 -- 172.21.15.27:0/2362576295 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6da803a890 con 0x7f6db81059c0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.081+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db807a290 con 0x7f6db81059c0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.081+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db807a730 con 0x7f6db81059c0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.082+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db8109df0 con 0x7f6db81059c0 2024-09-13T17:54:38.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.082+0000 7f6db4c00640 1 -- 172.21.15.27:0/2362576295 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f6da8039040 con 0x7f6db81059c0 2024-09-13T17:54:38.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.083+0000 7f6db4c00640 1 --2- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6d9c0386c0 0x7f6d9c03ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:38.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.083+0000 7f6db4c00640 1 -- 172.21.15.27:0/2362576295 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6da806b9e0 con 0x7f6db81059c0 2024-09-13T17:54:38.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.083+0000 7f6db7400640 1 --2- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6d9c0386c0 0x7f6d9c03ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:38.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.084+0000 7f6db7400640 1 --2- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6d9c0386c0 0x7f6d9c03ab80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6da40098c0 tx=0x7f6da4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:38.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.088+0000 7f6db4c00640 1 -- 172.21.15.27:0/2362576295 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6da8031580 con 0x7f6db81059c0 2024-09-13T17:54:38.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.276+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f6db807af20 con 0x7f6d9c0386c0 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.344+0000 7f6db4c00640 1 -- 172.21.15.27:0/2362576295 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f6db807af20 con 0x7f6d9c0386c0 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6d9c0386c0 msgr2=0x7f6d9c03ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 --2- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6d9c0386c0 0x7f6d9c03ab80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6da40098c0 tx=0x7f6da4006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 msgr2=0x7f6db807bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 --2- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db807bb60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6da80097f0 tx=0x7f6da8032670 comp rx=0 tx=0).stop 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 shutdown_connections 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 --2- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6d9c0386c0 0x7f6d9c03ab80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 --2- 172.21.15.27:0/2362576295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6db81059c0 0x7f6db807bb60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 >> 172.21.15.27:0/2362576295 conn(0x7f6db8101130 msgr2=0x7f6db8101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 shutdown_connections 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:38.346+0000 7f6dbf000640 1 -- 172.21.15.27:0/2362576295 wait complete. 2024-09-13T17:54:38.988 INFO:teuthology.orchestra.run.smithi027.stdout:Creating initial admin user... 2024-09-13T17:54:39.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:39 smithi027 ceph-mon[30611]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:39.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:39 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:39.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:39 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:39.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:39 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:41.264 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:40 smithi027 ceph-mon[30611]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:41.265 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:41.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VjaCc7NM9zNxTk2BrwobVutPqN7QDkLJapBjV3K8bcpbhXcd78BXm", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726250079, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T17:54:41.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.503+0000 7f2137600640 1 Processor -- start 2024-09-13T17:54:41.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.503+0000 7f2137600640 1 -- start start 2024-09-13T17:54:41.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.503+0000 7f2137600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130105db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:41.610 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.503+0000 7f2137600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130106380 con 0x7f21301059b0 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.504+0000 7f2134c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130105db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.504+0000 7f2134c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130105db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53046/0 (socket says 172.21.15.27:53046) 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.504+0000 7f2134c00640 1 -- 172.21.15.27:0/120651194 learned_addr learned my addr 172.21.15.27:0/120651194 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.504+0000 7f2134c00640 1 -- 172.21.15.27:0/120651194 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130106bb0 con 0x7f21301059b0 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.505+0000 7f2134c00640 1 --2- 172.21.15.27:0/120651194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130105db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2124009820 tx=0x7f212402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f41385b48b37b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.506+0000 7f212f400640 1 -- 172.21.15.27:0/120651194 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212402ae70 con 0x7f21301059b0 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.506+0000 7f212f400640 1 -- 172.21.15.27:0/120651194 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2124032920 con 0x7f21301059b0 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.506+0000 7f212f400640 1 -- 172.21.15.27:0/120651194 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2124030920 con 0x7f21301059b0 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.506+0000 7f2137600640 1 -- 172.21.15.27:0/120651194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 msgr2=0x7f2130105db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.506+0000 7f2137600640 1 --2- 172.21.15.27:0/120651194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130105db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2124009820 tx=0x7f212402a270 comp rx=0 tx=0).stop 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.507+0000 7f2137600640 1 -- 172.21.15.27:0/120651194 shutdown_connections 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.507+0000 7f2137600640 1 --2- 172.21.15.27:0/120651194 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130105db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:41.611 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.507+0000 7f2137600640 1 -- 172.21.15.27:0/120651194 >> 172.21.15.27:0/120651194 conn(0x7f2130101140 msgr2=0x7f2130103580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.507+0000 7f2137600640 1 -- 172.21.15.27:0/120651194 shutdown_connections 2024-09-13T17:54:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.507+0000 7f2137600640 1 -- 172.21.15.27:0/120651194 wait complete. 2024-09-13T17:54:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.508+0000 7f2137600640 1 Processor -- start 2024-09-13T17:54:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.508+0000 7f2137600640 1 -- start start 2024-09-13T17:54:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.508+0000 7f2137600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.508+0000 7f2137600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130199d70 con 0x7f21301059b0 2024-09-13T17:54:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.508+0000 7f2134c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.508+0000 7f2134c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:53058/0 (socket says 172.21.15.27:53058) 2024-09-13T17:54:41.612 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.508+0000 7f2134c00640 1 -- 172.21.15.27:0/2126411068 learned_addr learned my addr 172.21.15.27:0/2126411068 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.509+0000 7f2134c00640 1 -- 172.21.15.27:0/2126411068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240094d0 con 0x7f21301059b0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.509+0000 7f2134c00640 1 --2- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130199830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2124030670 tx=0x7f2124032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.509+0000 7f212d600640 1 -- 172.21.15.27:0/2126411068 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2124032dd0 con 0x7f21301059b0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.509+0000 7f212d600640 1 -- 172.21.15.27:0/2126411068 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f212403b910 con 0x7f21301059b0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.509+0000 7f212d600640 1 -- 172.21.15.27:0/2126411068 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f212403a800 con 0x7f21301059b0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.510+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2130199f70 con 0x7f21301059b0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.510+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213019a410 con 0x7f21301059b0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.511+0000 7f212d600640 1 -- 172.21.15.27:0/2126411068 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f2124039040 con 0x7f21301059b0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.511+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2130109de0 con 0x7f21301059b0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.511+0000 7f212d600640 1 --2- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f21180386c0 0x7f211803ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.511+0000 7f212d600640 1 -- 172.21.15.27:0/2126411068 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f212406bc20 con 0x7f21301059b0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.512+0000 7f212fe00640 1 --2- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f21180386c0 0x7f211803ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.513+0000 7f212fe00640 1 --2- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f21180386c0 0x7f211803ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f211c0098c0 tx=0x7f211c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:41.613 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.517+0000 7f212d600640 1 -- 172.21.15.27:0/2126411068 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2124031580 con 0x7f21301059b0 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.724+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f2130073da0 con 0x7f21180386c0 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.974+0000 7f212d600640 1 -- 172.21.15.27:0/2126411068 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f2130073da0 con 0x7f21180386c0 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.976+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f21180386c0 msgr2=0x7f211803ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.976+0000 7f2137600640 1 --2- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f21180386c0 0x7f211803ab80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f211c0098c0 tx=0x7f211c006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.976+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 msgr2=0x7f2130199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.976+0000 7f2137600640 1 --2- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130199830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2124030670 tx=0x7f2124032670 comp rx=0 tx=0).stop 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.976+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 shutdown_connections 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.976+0000 7f2137600640 1 --2- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f21180386c0 0x7f211803ab80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.976+0000 7f2137600640 1 --2- 172.21.15.27:0/2126411068 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f21301059b0 0x7f2130199830 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.976+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 >> 172.21.15.27:0/2126411068 conn(0x7f2130101140 msgr2=0x7f2130101ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.977+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 shutdown_connections 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:39.977+0000 7f2137600640 1 -- 172.21.15.27:0/2126411068 wait complete. 2024-09-13T17:54:41.614 INFO:teuthology.orchestra.run.smithi027.stdout:Fetching dashboard port number... 2024-09-13T17:54:42.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T17:54:42.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.097+0000 7fd9ade00640 1 Processor -- start 2024-09-13T17:54:42.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.097+0000 7fd9ade00640 1 -- start start 2024-09-13T17:54:42.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.097+0000 7fd9ade00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a8105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:42.984 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.097+0000 7fd9ade00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a8106390 con 0x7fd9a81059c0 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.098+0000 7fd9a6a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a8105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.098+0000 7fd9a6a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a8105dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41548/0 (socket says 172.21.15.27:41548) 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.098+0000 7fd9a6a00640 1 -- 172.21.15.27:0/133255739 learned_addr learned my addr 172.21.15.27:0/133255739 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.098+0000 7fd9a6a00640 1 -- 172.21.15.27:0/133255739 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8106bc0 con 0x7fd9a81059c0 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.099+0000 7fd9a6a00640 1 --2- 172.21.15.27:0/133255739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a8105dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd998009820 tx=0x7fd99802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbff8bd6bc8349a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.099+0000 7fd9a5600640 1 -- 172.21.15.27:0/133255739 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd99802ae70 con 0x7fd9a81059c0 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.099+0000 7fd9a5600640 1 -- 172.21.15.27:0/133255739 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd998032920 con 0x7fd9a81059c0 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.099+0000 7fd9a5600640 1 -- 172.21.15.27:0/133255739 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd998030920 con 0x7fd9a81059c0 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.100+0000 7fd9ade00640 1 -- 172.21.15.27:0/133255739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 msgr2=0x7fd9a8105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.100+0000 7fd9ade00640 1 --2- 172.21.15.27:0/133255739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a8105dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd998009820 tx=0x7fd99802a270 comp rx=0 tx=0).stop 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.100+0000 7fd9ade00640 1 -- 172.21.15.27:0/133255739 shutdown_connections 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.100+0000 7fd9ade00640 1 --2- 172.21.15.27:0/133255739 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a8105dc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.100+0000 7fd9ade00640 1 -- 172.21.15.27:0/133255739 >> 172.21.15.27:0/133255739 conn(0x7fd9a8101130 msgr2=0x7fd9a8103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:42.985 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.100+0000 7fd9ade00640 1 -- 172.21.15.27:0/133255739 shutdown_connections 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.100+0000 7fd9ade00640 1 -- 172.21.15.27:0/133255739 wait complete. 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.101+0000 7fd9ade00640 1 Processor -- start 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.101+0000 7fd9ade00640 1 -- start start 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.101+0000 7fd9ade00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a819b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.102+0000 7fd9ade00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a819bf00 con 0x7fd9a81059c0 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.102+0000 7fd9a6a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a819b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.102+0000 7fd9a6a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a819b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41562/0 (socket says 172.21.15.27:41562) 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.102+0000 7fd9a6a00640 1 -- 172.21.15.27:0/3867584466 learned_addr learned my addr 172.21.15.27:0/3867584466 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.102+0000 7fd9a6a00640 1 -- 172.21.15.27:0/3867584466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980094d0 con 0x7fd9a81059c0 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.102+0000 7fd9a6a00640 1 --2- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a819b9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9980097f0 tx=0x7fd998032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.103+0000 7fd9aca00640 1 -- 172.21.15.27:0/3867584466 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd998032dd0 con 0x7fd9a81059c0 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.103+0000 7fd9aca00640 1 -- 172.21.15.27:0/3867584466 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd99803b910 con 0x7fd9a81059c0 2024-09-13T17:54:42.986 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.103+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a819c100 con 0x7fd9a81059c0 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.103+0000 7fd9aca00640 1 -- 172.21.15.27:0/3867584466 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd99803a890 con 0x7fd9a81059c0 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.103+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a819c5a0 con 0x7fd9a81059c0 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.104+0000 7fd9aca00640 1 -- 172.21.15.27:0/3867584466 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fd998039040 con 0x7fd9a81059c0 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.104+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a8109df0 con 0x7fd9a81059c0 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.104+0000 7fd9aca00640 1 --2- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd98c038760 0x7fd98c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.104+0000 7fd9aca00640 1 -- 172.21.15.27:0/3867584466 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd99806bb60 con 0x7fd9a81059c0 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.105+0000 7fd9a6000640 1 --2- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd98c038760 0x7fd98c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.105+0000 7fd9a6000640 1 --2- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd98c038760 0x7fd98c03ac20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9940098c0 tx=0x7fd994006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.110+0000 7fd9aca00640 1 -- 172.21.15.27:0/3867584466 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd99803be10 con 0x7fd9a81059c0 2024-09-13T17:54:42.987 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.290+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fd9a810a060 con 0x7fd9a81059c0 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.291+0000 7fd9aca00640 1 -- 172.21.15.27:0/3867584466 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fd99803f070 con 0x7fd9a81059c0 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd98c038760 msgr2=0x7fd98c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 --2- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd98c038760 0x7fd98c03ac20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd9940098c0 tx=0x7fd994006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 msgr2=0x7fd9a819b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 --2- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a819b9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd9980097f0 tx=0x7fd998032670 comp rx=0 tx=0).stop 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 shutdown_connections 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 --2- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd98c038760 0x7fd98c03ac20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 --2- 172.21.15.27:0/3867584466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd9a81059c0 0x7fd9a819b9c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 >> 172.21.15.27:0/3867584466 conn(0x7fd9a8101130 msgr2=0x7fd9a8101c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 shutdown_connections 2024-09-13T17:54:42.988 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:42.293+0000 7fd9ade00640 1 -- 172.21.15.27:0/3867584466 wait complete. 2024-09-13T17:54:43.003 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T17:54:43.003 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout disabled 2024-09-13T17:54:43.018 INFO:teuthology.orchestra.run.smithi027.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T17:54:43.018 INFO:teuthology.orchestra.run.smithi027.stdout:systemctl: stdout inactive 2024-09-13T17:54:43.018 INFO:teuthology.orchestra.run.smithi027.stdout:firewalld.service is not enabled 2024-09-13T17:54:43.018 INFO:teuthology.orchestra.run.smithi027.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T17:54:43.020 INFO:teuthology.orchestra.run.smithi027.stdout:Ceph Dashboard is now available at: 2024-09-13T17:54:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: URL: https://smithi027.front.sepia.ceph.com:8443/ 2024-09-13T17:54:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: User: admin 2024-09-13T17:54:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: Password: ksv9qt2c1g 2024-09-13T17:54:43.020 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:43.021 INFO:teuthology.orchestra.run.smithi027.stdout:Saving cluster configuration to /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config directory 2024-09-13T17:54:43.021 INFO:teuthology.orchestra.run.smithi027.stdout:Enabling autotune for osd_memory_target 2024-09-13T17:54:43.272 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:42 smithi027 ceph-mon[30611]: mgrmap e13: x(active, since 6s) 2024-09-13T17:54:43.272 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:42 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3867584466' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T17:54:44.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.566+0000 7f045e200640 1 Processor -- start 2024-09-13T17:54:44.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.566+0000 7f045e200640 1 -- start start 2024-09-13T17:54:44.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.567+0000 7f045e200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045807a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:44.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.567+0000 7f045e200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045807a900 con 0x7f045807be80 2024-09-13T17:54:44.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.567+0000 7f0457400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045807a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:44.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.567+0000 7f0457400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045807a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41572/0 (socket says 172.21.15.27:41572) 2024-09-13T17:54:44.392 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.567+0000 7f0457400640 1 -- 172.21.15.27:0/2172587785 learned_addr learned my addr 172.21.15.27:0/2172587785 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.567+0000 7f0457400640 1 -- 172.21.15.27:0/2172587785 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f045807aa40 con 0x7f045807be80 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.568+0000 7f0457400640 1 --2- 172.21.15.27:0/2172587785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045807a330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0448009820 tx=0x7f044802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d29b4a0a5b8ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.569+0000 7f0456a00640 1 -- 172.21.15.27:0/2172587785 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f044802ae70 con 0x7f045807be80 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.569+0000 7f0456a00640 1 -- 172.21.15.27:0/2172587785 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0448032920 con 0x7f045807be80 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.569+0000 7f0456a00640 1 -- 172.21.15.27:0/2172587785 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0448030920 con 0x7f045807be80 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.569+0000 7f045e200640 1 -- 172.21.15.27:0/2172587785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 msgr2=0x7f045807a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.569+0000 7f045e200640 1 --2- 172.21.15.27:0/2172587785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045807a330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0448009820 tx=0x7f044802a270 comp rx=0 tx=0).stop 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.569+0000 7f045e200640 1 -- 172.21.15.27:0/2172587785 shutdown_connections 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.569+0000 7f045e200640 1 --2- 172.21.15.27:0/2172587785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045807a330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.569+0000 7f045e200640 1 -- 172.21.15.27:0/2172587785 >> 172.21.15.27:0/2172587785 conn(0x7f0458101120 msgr2=0x7f0458103540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:44.393 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.570+0000 7f045e200640 1 -- 172.21.15.27:0/2172587785 shutdown_connections 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.570+0000 7f045e200640 1 -- 172.21.15.27:0/2172587785 wait complete. 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.571+0000 7f045e200640 1 Processor -- start 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.571+0000 7f045e200640 1 -- start start 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.571+0000 7f045e200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.571+0000 7f045e200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045819bea0 con 0x7f045807be80 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.571+0000 7f0457400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.571+0000 7f0457400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045819b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41578/0 (socket says 172.21.15.27:41578) 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.571+0000 7f0457400640 1 -- 172.21.15.27:0/3706267643 learned_addr learned my addr 172.21.15.27:0/3706267643 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.572+0000 7f0457400640 1 -- 172.21.15.27:0/3706267643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04480094d0 con 0x7f045807be80 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.572+0000 7f0457400640 1 --2- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045819b960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0448030670 tx=0x7f0448032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.572+0000 7f0454c00640 1 -- 172.21.15.27:0/3706267643 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0448032e90 con 0x7f045807be80 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.572+0000 7f0454c00640 1 -- 172.21.15.27:0/3706267643 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f044803b910 con 0x7f045807be80 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.572+0000 7f0454c00640 1 -- 172.21.15.27:0/3706267643 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f044803a7d0 con 0x7f045807be80 2024-09-13T17:54:44.394 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.572+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045819c0a0 con 0x7f045807be80 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.573+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045819c540 con 0x7f045807be80 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.574+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045810bda0 con 0x7f045807be80 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.574+0000 7f0454c00640 1 -- 172.21.15.27:0/3706267643 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0448039040 con 0x7f045807be80 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.574+0000 7f0454c00640 1 --2- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f043c038710 0x7f043c03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.574+0000 7f0454c00640 1 -- 172.21.15.27:0/3706267643 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f044806bcc0 con 0x7f045807be80 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.575+0000 7f044fe00640 1 --2- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f043c038710 0x7f043c03abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.575+0000 7f044fe00640 1 --2- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f043c038710 0x7f043c03abd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f04400098c0 tx=0x7f0440006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.579+0000 7f0454c00640 1 -- 172.21.15.27:0/3706267643 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0448072080 con 0x7f045807be80 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.762+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f045810bfe0 con 0x7f045807be80 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.762+0000 7f0454c00640 1 -- 172.21.15.27:0/3706267643 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f044803f070 con 0x7f045807be80 2024-09-13T17:54:44.395 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f043c038710 msgr2=0x7f043c03abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:44.396 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 --2- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f043c038710 0x7f043c03abd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f04400098c0 tx=0x7f0440006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:44.396 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 msgr2=0x7f045819b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:44.396 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 --2- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045819b960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0448030670 tx=0x7f0448032670 comp rx=0 tx=0).stop 2024-09-13T17:54:44.396 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 shutdown_connections 2024-09-13T17:54:44.396 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 --2- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f043c038710 0x7f043c03abd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:44.396 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 --2- 172.21.15.27:0/3706267643 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f045807be80 0x7f045819b960 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:44.396 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 >> 172.21.15.27:0/3706267643 conn(0x7f0458101120 msgr2=0x7f0458101d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:44.396 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 shutdown_connections 2024-09-13T17:54:44.396 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:43.765+0000 7f045e200640 1 -- 172.21.15.27:0/3706267643 wait complete. 2024-09-13T17:54:45.847 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.898+0000 7fdfff200640 1 Processor -- start 2024-09-13T17:54:45.847 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.899+0000 7fdfff200640 1 -- start start 2024-09-13T17:54:45.847 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.899+0000 7fdfff200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe000107e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.899+0000 7fdfff200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0001083f0 con 0x7fe000107a20 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.900+0000 7fdffde00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe000107e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.900+0000 7fdffde00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe000107e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41586/0 (socket says 172.21.15.27:41586) 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.900+0000 7fdffde00640 1 -- 172.21.15.27:0/4012830663 learned_addr learned my addr 172.21.15.27:0/4012830663 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.900+0000 7fdffde00640 1 -- 172.21.15.27:0/4012830663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe000108c20 con 0x7fe000107a20 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.901+0000 7fdffde00640 1 --2- 172.21.15.27:0/4012830663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe000107e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009820 tx=0x7fdff002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfe04991dc9a954 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.901+0000 7fdffd400640 1 -- 172.21.15.27:0/4012830663 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff002ae70 con 0x7fe000107a20 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.902+0000 7fdffd400640 1 -- 172.21.15.27:0/4012830663 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdff0032920 con 0x7fe000107a20 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.902+0000 7fdffd400640 1 -- 172.21.15.27:0/4012830663 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff0030920 con 0x7fe000107a20 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.902+0000 7fdfff200640 1 -- 172.21.15.27:0/4012830663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 msgr2=0x7fe000107e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.902+0000 7fdfff200640 1 --2- 172.21.15.27:0/4012830663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe000107e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdff0009820 tx=0x7fdff002a270 comp rx=0 tx=0).stop 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.902+0000 7fdfff200640 1 -- 172.21.15.27:0/4012830663 shutdown_connections 2024-09-13T17:54:45.848 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.902+0000 7fdfff200640 1 --2- 172.21.15.27:0/4012830663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe000107e20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.902+0000 7fdfff200640 1 -- 172.21.15.27:0/4012830663 >> 172.21.15.27:0/4012830663 conn(0x7fe00007b0a0 msgr2=0x7fe00007b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.902+0000 7fdfff200640 1 -- 172.21.15.27:0/4012830663 shutdown_connections 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.902+0000 7fdfff200640 1 -- 172.21.15.27:0/4012830663 wait complete. 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.903+0000 7fdfff200640 1 Processor -- start 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.903+0000 7fdfff200640 1 -- start start 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.904+0000 7fdfff200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe00019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.904+0000 7fdfff200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00019bce0 con 0x7fe000107a20 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.904+0000 7fdffde00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe00019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.904+0000 7fdffde00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe00019b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41600/0 (socket says 172.21.15.27:41600) 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.904+0000 7fdffde00640 1 -- 172.21.15.27:0/1717949889 learned_addr learned my addr 172.21.15.27:0/1717949889 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.904+0000 7fdffde00640 1 -- 172.21.15.27:0/1717949889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00094d0 con 0x7fe000107a20 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.905+0000 7fdffde00640 1 --2- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe00019b7a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdff0030460 tx=0x7fdff0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.905+0000 7fdff7400640 1 -- 172.21.15.27:0/1717949889 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff0032dd0 con 0x7fe000107a20 2024-09-13T17:54:45.849 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.905+0000 7fdff7400640 1 -- 172.21.15.27:0/1717949889 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdff003b910 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.905+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe00019bee0 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.905+0000 7fdff7400640 1 -- 172.21.15.27:0/1717949889 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdff003a820 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.905+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe00019c380 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.906+0000 7fdff7400640 1 -- 172.21.15.27:0/1717949889 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fdff0039040 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.906+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe00010be50 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.907+0000 7fdff7400640 1 --2- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfe4038760 0x7fdfe403ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.907+0000 7fdff7400640 1 -- 172.21.15.27:0/1717949889 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdff006baf0 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.907+0000 7fdff5400640 1 --2- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfe4038760 0x7fdfe403ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.908+0000 7fdff5400640 1 --2- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfe4038760 0x7fdfe403ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80098c0 tx=0x7fdfe8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:44.911+0000 7fdff7400640 1 -- 172.21.15.27:0/1717949889 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdff0031580 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.187+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fe00010c0c0 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.190+0000 7fdff7400640 1 -- 172.21.15.27:0/1717949889 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7fdff003f070 con 0x7fe000107a20 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T17:54:45.850 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.192+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfe4038760 msgr2=0x7fdfe403ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.192+0000 7fdfff200640 1 --2- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfe4038760 0x7fdfe403ac20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdfe80098c0 tx=0x7fdfe8006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.192+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 msgr2=0x7fe00019b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.192+0000 7fdfff200640 1 --2- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe00019b7a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdff0030460 tx=0x7fdff0032670 comp rx=0 tx=0).stop 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.192+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 shutdown_connections 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.192+0000 7fdfff200640 1 --2- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfe4038760 0x7fdfe403ac20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.192+0000 7fdfff200640 1 --2- 172.21.15.27:0/1717949889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe000107a20 0x7fe00019b7a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.192+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 >> 172.21.15.27:0/1717949889 conn(0x7fe00007b0a0 msgr2=0x7fe000105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.193+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 shutdown_connections 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:/usr/bin/ceph: stderr 2024-09-13T17:54:45.193+0000 7fdfff200640 1 -- 172.21.15.27:0/1717949889 wait complete. 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T17:54:45.851 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout: ceph telemetry on 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout:For more information see: 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:54:45.852 INFO:teuthology.orchestra.run.smithi027.stdout:Bootstrap complete. 2024-09-13T17:54:45.898 INFO:tasks.cephadm:Fetching config... 2024-09-13T17:54:45.899 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:54:45.899 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T17:54:45.936 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T17:54:45.936 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:54:45.936 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T17:54:46.014 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T17:54:46.014 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:54:46.015 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-13T17:54:46.113 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T17:54:46.114 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:54:46.114 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T17:54:46.190 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T17:54:46.190 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXFMjTTDYrQkF0iTc5HMDeCBrb5avb+NbiiIzZepDcrVrJJ2JD+ie4Tnszxx1nXEm+rxKw2lfcQhiwzG+D2xbr+zhwg97Uuka+uWi5yNMolJnJRj4Gn58/62DMR5r4mbFdNQN7BveO4GV+LayOxS05YCCGfaz+ikbCVJEZVAn8TNRs1GIljTNPDMTrBgu3gzYIFjGHLSNhipEX9KMgd69KrBP6G5S70CnDmzOOlsbidpCStgqEJV1JHDBJCzv48AIg3w2ZCdYJVodqD7d694ceiNuZk8l7OrhBsYQn2oBmsGjPj+Knc0qHabVAmSDMvm38qYbONLfCZpzIQA3UoKTz9s8NiC4Lg6Dmh0Uju9Zf2jOei07NUR7HCH2LY9tlfxcE0whY8PnTOJ3cd7ZJePuMPP2nOLBIyK0DSNl/co5jocLgI7L57EFPMcTh/H8XQCS/vC8SmKzzmOhHo8bXi3vP5eerwkyF2KuDK3Mr2SYp/UH4J4yt1GLw5IGxHTioJlc= ceph-f5527e2e-71f8-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T17:54:46.313 INFO:teuthology.orchestra.run.smithi027.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXFMjTTDYrQkF0iTc5HMDeCBrb5avb+NbiiIzZepDcrVrJJ2JD+ie4Tnszxx1nXEm+rxKw2lfcQhiwzG+D2xbr+zhwg97Uuka+uWi5yNMolJnJRj4Gn58/62DMR5r4mbFdNQN7BveO4GV+LayOxS05YCCGfaz+ikbCVJEZVAn8TNRs1GIljTNPDMTrBgu3gzYIFjGHLSNhipEX9KMgd69KrBP6G5S70CnDmzOOlsbidpCStgqEJV1JHDBJCzv48AIg3w2ZCdYJVodqD7d694ceiNuZk8l7OrhBsYQn2oBmsGjPj+Knc0qHabVAmSDMvm38qYbONLfCZpzIQA3UoKTz9s8NiC4Lg6Dmh0Uju9Zf2jOei07NUR7HCH2LY9tlfxcE0whY8PnTOJ3cd7ZJePuMPP2nOLBIyK0DSNl/co5jocLgI7L57EFPMcTh/H8XQCS/vC8SmKzzmOhHo8bXi3vP5eerwkyF2KuDK3Mr2SYp/UH4J4yt1GLw5IGxHTioJlc= ceph-f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:54:46.347 DEBUG:teuthology.orchestra.run.smithi122:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXFMjTTDYrQkF0iTc5HMDeCBrb5avb+NbiiIzZepDcrVrJJ2JD+ie4Tnszxx1nXEm+rxKw2lfcQhiwzG+D2xbr+zhwg97Uuka+uWi5yNMolJnJRj4Gn58/62DMR5r4mbFdNQN7BveO4GV+LayOxS05YCCGfaz+ikbCVJEZVAn8TNRs1GIljTNPDMTrBgu3gzYIFjGHLSNhipEX9KMgd69KrBP6G5S70CnDmzOOlsbidpCStgqEJV1JHDBJCzv48AIg3w2ZCdYJVodqD7d694ceiNuZk8l7OrhBsYQn2oBmsGjPj+Knc0qHabVAmSDMvm38qYbONLfCZpzIQA3UoKTz9s8NiC4Lg6Dmh0Uju9Zf2jOei07NUR7HCH2LY9tlfxcE0whY8PnTOJ3cd7ZJePuMPP2nOLBIyK0DSNl/co5jocLgI7L57EFPMcTh/H8XQCS/vC8SmKzzmOhHo8bXi3vP5eerwkyF2KuDK3Mr2SYp/UH4J4yt1GLw5IGxHTioJlc= ceph-f5527e2e-71f8-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T17:54:46.392 INFO:teuthology.orchestra.run.smithi122.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXFMjTTDYrQkF0iTc5HMDeCBrb5avb+NbiiIzZepDcrVrJJ2JD+ie4Tnszxx1nXEm+rxKw2lfcQhiwzG+D2xbr+zhwg97Uuka+uWi5yNMolJnJRj4Gn58/62DMR5r4mbFdNQN7BveO4GV+LayOxS05YCCGfaz+ikbCVJEZVAn8TNRs1GIljTNPDMTrBgu3gzYIFjGHLSNhipEX9KMgd69KrBP6G5S70CnDmzOOlsbidpCStgqEJV1JHDBJCzv48AIg3w2ZCdYJVodqD7d694ceiNuZk8l7OrhBsYQn2oBmsGjPj+Knc0qHabVAmSDMvm38qYbONLfCZpzIQA3UoKTz9s8NiC4Lg6Dmh0Uju9Zf2jOei07NUR7HCH2LY9tlfxcE0whY8PnTOJ3cd7ZJePuMPP2nOLBIyK0DSNl/co5jocLgI7L57EFPMcTh/H8XQCS/vC8SmKzzmOhHo8bXi3vP5eerwkyF2KuDK3Mr2SYp/UH4J4yt1GLw5IGxHTioJlc= ceph-f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:54:46.403 DEBUG:teuthology.orchestra.run.smithi143:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXFMjTTDYrQkF0iTc5HMDeCBrb5avb+NbiiIzZepDcrVrJJ2JD+ie4Tnszxx1nXEm+rxKw2lfcQhiwzG+D2xbr+zhwg97Uuka+uWi5yNMolJnJRj4Gn58/62DMR5r4mbFdNQN7BveO4GV+LayOxS05YCCGfaz+ikbCVJEZVAn8TNRs1GIljTNPDMTrBgu3gzYIFjGHLSNhipEX9KMgd69KrBP6G5S70CnDmzOOlsbidpCStgqEJV1JHDBJCzv48AIg3w2ZCdYJVodqD7d694ceiNuZk8l7OrhBsYQn2oBmsGjPj+Knc0qHabVAmSDMvm38qYbONLfCZpzIQA3UoKTz9s8NiC4Lg6Dmh0Uju9Zf2jOei07NUR7HCH2LY9tlfxcE0whY8PnTOJ3cd7ZJePuMPP2nOLBIyK0DSNl/co5jocLgI7L57EFPMcTh/H8XQCS/vC8SmKzzmOhHo8bXi3vP5eerwkyF2KuDK3Mr2SYp/UH4J4yt1GLw5IGxHTioJlc= ceph-f5527e2e-71f8-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T17:54:46.444 INFO:teuthology.orchestra.run.smithi143.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXFMjTTDYrQkF0iTc5HMDeCBrb5avb+NbiiIzZepDcrVrJJ2JD+ie4Tnszxx1nXEm+rxKw2lfcQhiwzG+D2xbr+zhwg97Uuka+uWi5yNMolJnJRj4Gn58/62DMR5r4mbFdNQN7BveO4GV+LayOxS05YCCGfaz+ikbCVJEZVAn8TNRs1GIljTNPDMTrBgu3gzYIFjGHLSNhipEX9KMgd69KrBP6G5S70CnDmzOOlsbidpCStgqEJV1JHDBJCzv48AIg3w2ZCdYJVodqD7d694ceiNuZk8l7OrhBsYQn2oBmsGjPj+Knc0qHabVAmSDMvm38qYbONLfCZpzIQA3UoKTz9s8NiC4Lg6Dmh0Uju9Zf2jOei07NUR7HCH2LY9tlfxcE0whY8PnTOJ3cd7ZJePuMPP2nOLBIyK0DSNl/co5jocLgI7L57EFPMcTh/H8XQCS/vC8SmKzzmOhHo8bXi3vP5eerwkyF2KuDK3Mr2SYp/UH4J4yt1GLw5IGxHTioJlc= ceph-f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:54:46.457 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T17:54:46.497 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:46 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1717949889' entity='client.admin' 2024-09-13T17:54:46.774 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:54:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi027", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:54:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:54:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.583+0000 7f33db000640 1 -- 172.21.15.27:0/1183170633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 msgr2=0x7f33d4101df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:49.585 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.583+0000 7f33db000640 1 --2- 172.21.15.27:0/1183170633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 0x7f33d4101df0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009880 tx=0x7f33c402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:54:49.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.583+0000 7f33db000640 1 -- 172.21.15.27:0/1183170633 shutdown_connections 2024-09-13T17:54:49.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.583+0000 7f33db000640 1 --2- 172.21.15.27:0/1183170633 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 0x7f33d4101df0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:49.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.583+0000 7f33db000640 1 -- 172.21.15.27:0/1183170633 >> 172.21.15.27:0/1183170633 conn(0x7f33d40fd1a0 msgr2=0x7f33d40ff5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:49.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.583+0000 7f33db000640 1 -- 172.21.15.27:0/1183170633 shutdown_connections 2024-09-13T17:54:49.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.583+0000 7f33db000640 1 -- 172.21.15.27:0/1183170633 wait complete. 2024-09-13T17:54:49.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.585+0000 7f33db000640 1 Processor -- start 2024-09-13T17:54:49.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.585+0000 7f33db000640 1 -- start start 2024-09-13T17:54:49.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.585+0000 7f33db000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 0x7f33d4196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:49.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.585+0000 7f33db000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d4197510 con 0x7f33d41019f0 2024-09-13T17:54:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.585+0000 7f33d3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 0x7f33d4196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.586+0000 7f33d3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 0x7f33d4196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:41618/0 (socket says 172.21.15.27:41618) 2024-09-13T17:54:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.586+0000 7f33d3e00640 1 -- 172.21.15.27:0/1822044902 learned_addr learned my addr 172.21.15.27:0/1822044902 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.586+0000 7f33d3e00640 1 -- 172.21.15.27:0/1822044902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4009560 con 0x7f33d41019f0 2024-09-13T17:54:49.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.586+0000 7f33d3e00640 1 --2- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 0x7f33d4196fd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33c40057c0 tx=0x7f33c40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.587+0000 7f33d0c00640 1 -- 172.21.15.27:0/1822044902 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33c4004ba0 con 0x7f33d41019f0 2024-09-13T17:54:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.587+0000 7f33d0c00640 1 -- 172.21.15.27:0/1822044902 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f33c4004d00 con 0x7f33d41019f0 2024-09-13T17:54:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.587+0000 7f33d0c00640 1 -- 172.21.15.27:0/1822044902 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33c4031b00 con 0x7f33d41019f0 2024-09-13T17:54:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.587+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d4197710 con 0x7f33d41019f0 2024-09-13T17:54:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.587+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d4197b50 con 0x7f33d41019f0 2024-09-13T17:54:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.588+0000 7f33d0c00640 1 -- 172.21.15.27:0/1822044902 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f33c4031d30 con 0x7f33d41019f0 2024-09-13T17:54:49.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.588+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d4101e70 con 0x7f33d41019f0 2024-09-13T17:54:49.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.588+0000 7f33d0c00640 1 --2- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33b8038760 0x7f33b803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:49.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.588+0000 7f33d0c00640 1 -- 172.21.15.27:0/1822044902 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f33c406c530 con 0x7f33d41019f0 2024-09-13T17:54:49.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.589+0000 7f33d3400640 1 --2- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33b8038760 0x7f33b803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:49.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.589+0000 7f33d3400640 1 --2- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33b8038760 0x7f33b803ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f33c00098c0 tx=0x7f33c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:49.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.593+0000 7f33d0c00640 1 -- 172.21.15.27:0/1822044902 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f33c404d9a0 con 0x7f33d41019f0 2024-09-13T17:54:49.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.774+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f33d4107910 con 0x7f33d41019f0 2024-09-13T17:54:49.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.778+0000 7f33d0c00640 1 -- 172.21.15.27:0/1822044902 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f33c4035030 con 0x7f33d41019f0 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.780+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33b8038760 msgr2=0x7f33b803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.780+0000 7f33db000640 1 --2- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33b8038760 0x7f33b803ac20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f33c00098c0 tx=0x7f33c0006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.780+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 msgr2=0x7f33d4196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.780+0000 7f33db000640 1 --2- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 0x7f33d4196fd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33c40057c0 tx=0x7f33c40056e0 comp rx=0 tx=0).stop 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.781+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 shutdown_connections 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.781+0000 7f33db000640 1 --2- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33b8038760 0x7f33b803ac20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.781+0000 7f33db000640 1 --2- 172.21.15.27:0/1822044902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f33d41019f0 0x7f33d4196fd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.781+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 >> 172.21.15.27:0/1822044902 conn(0x7f33d40fd1a0 msgr2=0x7f33d40fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.781+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 shutdown_connections 2024-09-13T17:54:49.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:49.781+0000 7f33db000640 1 -- 172.21.15.27:0/1822044902 wait complete. 2024-09-13T17:54:50.599 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T17:54:50.600 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T17:54:51.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:50 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1822044902' entity='client.admin' 2024-09-13T17:54:51.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:54:51.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:51.462 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:54:53.328 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.303+0000 7f7ffb000640 1 -- 172.21.15.27:0/740679108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 msgr2=0x7f7ff4072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.303+0000 7f7ffb000640 1 --2- 172.21.15.27:0/740679108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 0x7f7ff4072940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009880 tx=0x7f7fe402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.303+0000 7f7ffb000640 1 -- 172.21.15.27:0/740679108 shutdown_connections 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.303+0000 7f7ffb000640 1 --2- 172.21.15.27:0/740679108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 0x7f7ff4072940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.303+0000 7f7ffb000640 1 -- 172.21.15.27:0/740679108 >> 172.21.15.27:0/740679108 conn(0x7f7ff40faf90 msgr2=0x7f7ff40fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.303+0000 7f7ffb000640 1 -- 172.21.15.27:0/740679108 shutdown_connections 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.303+0000 7f7ffb000640 1 -- 172.21.15.27:0/740679108 wait complete. 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.304+0000 7f7ffb000640 1 Processor -- start 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.304+0000 7f7ffb000640 1 -- start start 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.304+0000 7f7ffb000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 0x7f7ff419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:53.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.304+0000 7f7ffb000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff419b890 con 0x7f7ff40744e0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.305+0000 7f7ff3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 0x7f7ff419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.305+0000 7f7ff3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 0x7f7ff419b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59024/0 (socket says 172.21.15.27:59024) 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.305+0000 7f7ff3e00640 1 -- 172.21.15.27:0/3146053456 learned_addr learned my addr 172.21.15.27:0/3146053456 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.305+0000 7f7ff3e00640 1 -- 172.21.15.27:0/3146053456 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4009560 con 0x7f7ff40744e0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.305+0000 7f7ff3e00640 1 --2- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 0x7f7ff419b350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40057c0 tx=0x7f7fe40056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.306+0000 7f7ff1600640 1 -- 172.21.15.27:0/3146053456 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fe4004ba0 con 0x7f7ff40744e0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.306+0000 7f7ff1600640 1 -- 172.21.15.27:0/3146053456 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7fe4004d00 con 0x7f7ff40744e0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.306+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff419ba90 con 0x7f7ff40744e0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.306+0000 7f7ff1600640 1 -- 172.21.15.27:0/3146053456 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fe4031b00 con 0x7f7ff40744e0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.306+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff419bed0 con 0x7f7ff40744e0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.307+0000 7f7ff1600640 1 -- 172.21.15.27:0/3146053456 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f7fe4031d30 con 0x7f7ff40744e0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.307+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff40729c0 con 0x7f7ff40744e0 2024-09-13T17:54:53.330 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.307+0000 7f7ff1600640 1 --2- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7fd8038760 0x7f7fd803ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.307+0000 7f7ff1600640 1 -- 172.21.15.27:0/3146053456 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7fe406c530 con 0x7f7ff40744e0 2024-09-13T17:54:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.308+0000 7f7febe00640 1 --2- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7fd8038760 0x7f7fd803ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.308+0000 7f7febe00640 1 --2- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7fd8038760 0x7f7fd803ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0098c0 tx=0x7f7fdc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:53.331 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.312+0000 7f7ff1600640 1 -- 172.21.15.27:0/3146053456 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7fe404d9a0 con 0x7f7ff40744e0 2024-09-13T17:54:53.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.499+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ff40608f0 con 0x7f7fd8038760 2024-09-13T17:54:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.503+0000 7f7ff1600640 1 -- 172.21.15.27:0/3146053456 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7ff40608f0 con 0x7f7fd8038760 2024-09-13T17:54:53.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.505+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7fd8038760 msgr2=0x7f7fd803ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:53.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.505+0000 7f7ffb000640 1 --2- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7fd8038760 0x7f7fd803ac20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0098c0 tx=0x7f7fdc006db0 comp rx=0 tx=0).stop 2024-09-13T17:54:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.505+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 msgr2=0x7f7ff419b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.505+0000 7f7ffb000640 1 --2- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 0x7f7ff419b350 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40057c0 tx=0x7f7fe40056e0 comp rx=0 tx=0).stop 2024-09-13T17:54:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.505+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 shutdown_connections 2024-09-13T17:54:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.505+0000 7f7ffb000640 1 --2- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7fd8038760 0x7f7fd803ac20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.505+0000 7f7ffb000640 1 --2- 172.21.15.27:0/3146053456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ff40744e0 0x7f7ff419b350 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.505+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 >> 172.21.15.27:0/3146053456 conn(0x7f7ff40faf90 msgr2=0x7f7ff40fb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.506+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 shutdown_connections 2024-09-13T17:54:53.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:53.506+0000 7f7ffb000640 1 -- 172.21.15.27:0/3146053456 wait complete. 2024-09-13T17:54:54.299 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi122 2024-09-13T17:54:54.299 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:54:54.299 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.conf 2024-09-13T17:54:54.319 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:54:54.319 DEBUG:teuthology.orchestra.run.smithi122:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:54:54.377 INFO:tasks.cephadm:Adding host smithi122 to orchestrator... 2024-09-13T17:54:54.377 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch host add smithi122 2024-09-13T17:54:54.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:54 smithi027 ceph-mon[30611]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:54.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:54.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:54:54.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:54:54.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:54:54.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:54 smithi027 ceph-mon[30611]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-13T17:54:54.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:54 smithi027 ceph-mon[30611]: Updating smithi027:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:54:54.705 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:54:55.766 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:55 smithi027 ceph-mon[30611]: Updating smithi027:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:54:55.766 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:55 smithi027 ceph-mon[30611]: Updating smithi027:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:54:55.766 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:55.766 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:55.766 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:54:56.703 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:56 smithi027 ceph-mon[30611]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:54:56.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.709+0000 7f6182c00640 1 -- 172.21.15.27:0/2870322996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 msgr2=0x7f617c105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:54:56.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.709+0000 7f6182c00640 1 --2- 172.21.15.27:0/2870322996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 0x7f617c105b80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f616c009880 tx=0x7f616c02a5d0 comp rx=0 tx=0).stop 2024-09-13T17:54:56.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.709+0000 7f6182c00640 1 -- 172.21.15.27:0/2870322996 shutdown_connections 2024-09-13T17:54:56.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.709+0000 7f6182c00640 1 --2- 172.21.15.27:0/2870322996 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 0x7f617c105b80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:54:56.711 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.709+0000 7f6182c00640 1 -- 172.21.15.27:0/2870322996 >> 172.21.15.27:0/2870322996 conn(0x7f617c076500 msgr2=0x7f617c076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:54:56.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.709+0000 7f6182c00640 1 -- 172.21.15.27:0/2870322996 shutdown_connections 2024-09-13T17:54:56.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.709+0000 7f6182c00640 1 -- 172.21.15.27:0/2870322996 wait complete. 2024-09-13T17:54:56.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.710+0000 7f6182c00640 1 Processor -- start 2024-09-13T17:54:56.712 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.710+0000 7f6182c00640 1 -- start start 2024-09-13T17:54:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.711+0000 7f6182c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 0x7f617c1950a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.711+0000 7f6182c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c1955e0 con 0x7f617c1057a0 2024-09-13T17:54:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.711+0000 7f617be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 0x7f617c1950a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.711+0000 7f617be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 0x7f617c1950a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59046/0 (socket says 172.21.15.27:59046) 2024-09-13T17:54:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.711+0000 7f617be00640 1 -- 172.21.15.27:0/1430941368 learned_addr learned my addr 172.21.15.27:0/1430941368 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:54:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.711+0000 7f617be00640 1 -- 172.21.15.27:0/1430941368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c009560 con 0x7f617c1057a0 2024-09-13T17:54:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.712+0000 7f617be00640 1 --2- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 0x7f617c1950a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f616c005760 tx=0x7f616c003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:56.714 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.712+0000 7f6178c00640 1 -- 172.21.15.27:0/1430941368 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f616c03b670 con 0x7f617c1057a0 2024-09-13T17:54:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.712+0000 7f6178c00640 1 -- 172.21.15.27:0/1430941368 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f616c03bcb0 con 0x7f617c1057a0 2024-09-13T17:54:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.712+0000 7f6178c00640 1 -- 172.21.15.27:0/1430941368 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f616c031ce0 con 0x7f617c1057a0 2024-09-13T17:54:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.712+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c195840 con 0x7f617c1057a0 2024-09-13T17:54:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.712+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c195cc0 con 0x7f617c1057a0 2024-09-13T17:54:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.713+0000 7f6178c00640 1 -- 172.21.15.27:0/1430941368 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f616c031400 con 0x7f617c1057a0 2024-09-13T17:54:56.715 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.713+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c100e70 con 0x7f617c1057a0 2024-09-13T17:54:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.714+0000 7f6178c00640 1 --2- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6160038760 0x7f616003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:54:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.714+0000 7f6178c00640 1 -- 172.21.15.27:0/1430941368 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f616c06bff0 con 0x7f617c1057a0 2024-09-13T17:54:56.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.714+0000 7f617b400640 1 --2- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6160038760 0x7f616003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:54:56.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.715+0000 7f617b400640 1 --2- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6160038760 0x7f616003ac20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f61680098c0 tx=0x7f6168006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:54:56.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.719+0000 7f6178c00640 1 -- 172.21.15.27:0/1430941368 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f616c03ab70 con 0x7f617c1057a0 2024-09-13T17:54:56.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:54:56.904+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}) v1 -- 0x7f617c109c30 con 0x7f6160038760 2024-09-13T17:54:57.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:57 smithi027 ceph-mon[30611]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi122", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:54:58.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:58 smithi027 ceph-mon[30611]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:54:58.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:54:58 smithi027 ceph-mon[30611]: Deploying cephadm binary to smithi122 2024-09-13T17:55:00.158 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.156+0000 7f6178c00640 1 -- 172.21.15.27:0/1430941368 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f617c109c30 con 0x7f6160038760 2024-09-13T17:55:00.158 INFO:teuthology.orchestra.run.smithi027.stdout:Added host 'smithi122' with addr '172.21.15.122' 2024-09-13T17:55:00.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6160038760 msgr2=0x7f616003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:00.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 --2- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6160038760 0x7f616003ac20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f61680098c0 tx=0x7f6168006db0 comp rx=0 tx=0).stop 2024-09-13T17:55:00.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 msgr2=0x7f617c1950a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:00.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 --2- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 0x7f617c1950a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f616c005760 tx=0x7f616c003cb0 comp rx=0 tx=0).stop 2024-09-13T17:55:00.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 shutdown_connections 2024-09-13T17:55:00.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 --2- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6160038760 0x7f616003ac20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:00.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 --2- 172.21.15.27:0/1430941368 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f617c1057a0 0x7f617c1950a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:00.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 >> 172.21.15.27:0/1430941368 conn(0x7f617c076500 msgr2=0x7f617c0fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:00.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 shutdown_connections 2024-09-13T17:55:00.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:00.159+0000 7f6182c00640 1 -- 172.21.15.27:0/1430941368 wait complete. 2024-09-13T17:55:00.929 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T17:55:01.246 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:55:01.416 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:01 smithi027 ceph-mon[30611]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:01.416 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:01.416 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:01 smithi027 ceph-mon[30611]: Added host smithi122 2024-09-13T17:55:01.416 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:01.416 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:01.416 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:02.647 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:02 smithi027 ceph-mon[30611]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:02.647 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:02 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:03.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.044+0000 7fefaa600640 1 -- 172.21.15.27:0/3757377367 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 msgr2=0x7fefa4072c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:03.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.044+0000 7fefaa600640 1 --2- 172.21.15.27:0/3757377367 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 0x7fefa4072c60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fef98009880 tx=0x7fef9802a670 comp rx=0 tx=0).stop 2024-09-13T17:55:03.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.044+0000 7fefaa600640 1 -- 172.21.15.27:0/3757377367 shutdown_connections 2024-09-13T17:55:03.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.044+0000 7fefaa600640 1 --2- 172.21.15.27:0/3757377367 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 0x7fefa4072c60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:03.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.044+0000 7fefaa600640 1 -- 172.21.15.27:0/3757377367 >> 172.21.15.27:0/3757377367 conn(0x7fefa40fb250 msgr2=0x7fefa40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:03.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.044+0000 7fefaa600640 1 -- 172.21.15.27:0/3757377367 shutdown_connections 2024-09-13T17:55:03.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.044+0000 7fefaa600640 1 -- 172.21.15.27:0/3757377367 wait complete. 2024-09-13T17:55:03.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.045+0000 7fefaa600640 1 Processor -- start 2024-09-13T17:55:03.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.045+0000 7fefaa600640 1 -- start start 2024-09-13T17:55:03.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.046+0000 7fefaa600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 0x7fefa41971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:03.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.046+0000 7fefaa600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa41976e0 con 0x7fefa4072880 2024-09-13T17:55:03.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.046+0000 7fefa9200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 0x7fefa41971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:03.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.046+0000 7fefa9200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 0x7fefa41971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34610/0 (socket says 172.21.15.27:34610) 2024-09-13T17:55:03.048 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.046+0000 7fefa9200640 1 -- 172.21.15.27:0/1575275134 learned_addr learned my addr 172.21.15.27:0/1575275134 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:55:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.046+0000 7fefa9200640 1 -- 172.21.15.27:0/1575275134 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98009560 con 0x7fefa4072880 2024-09-13T17:55:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.047+0000 7fefa9200640 1 --2- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 0x7fefa41971a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef98005ab0 tx=0x7fef98003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.047+0000 7fefa1600640 1 -- 172.21.15.27:0/1575275134 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef98005160 con 0x7fefa4072880 2024-09-13T17:55:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.047+0000 7fefa1600640 1 -- 172.21.15.27:0/1575275134 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fef98004ba0 con 0x7fefa4072880 2024-09-13T17:55:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.047+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa41978e0 con 0x7fefa4072880 2024-09-13T17:55:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.047+0000 7fefa1600640 1 -- 172.21.15.27:0/1575275134 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef9803ba00 con 0x7fefa4072880 2024-09-13T17:55:03.049 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.047+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa4197d00 con 0x7fefa4072880 2024-09-13T17:55:03.050 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.048+0000 7fefa1600640 1 -- 172.21.15.27:0/1575275134 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fef9803bcc0 con 0x7fefa4072880 2024-09-13T17:55:03.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.048+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa4073f30 con 0x7fefa4072880 2024-09-13T17:55:03.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.048+0000 7fefa1600640 1 --2- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fef8c038710 0x7fef8c03abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:03.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.049+0000 7fefa1600640 1 -- 172.21.15.27:0/1575275134 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fef9806c270 con 0x7fefa4072880 2024-09-13T17:55:03.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.049+0000 7fefa3e00640 1 --2- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fef8c038710 0x7fef8c03abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:03.051 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.049+0000 7fefa3e00640 1 --2- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fef8c038710 0x7fef8c03abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fef900098c0 tx=0x7fef90006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:03.056 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.054+0000 7fefa1600640 1 -- 172.21.15.27:0/1575275134 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fef98039db0 con 0x7fefa4072880 2024-09-13T17:55:03.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.241+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefa410bce0 con 0x7fef8c038710 2024-09-13T17:55:03.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.242+0000 7fefa1600640 1 -- 172.21.15.27:0/1575275134 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fefa410bce0 con 0x7fef8c038710 2024-09-13T17:55:03.244 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:55:03.245 INFO:teuthology.orchestra.run.smithi027.stdout:[{"addr": "172.21.15.27", "hostname": "smithi027", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}] 2024-09-13T17:55:03.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fef8c038710 msgr2=0x7fef8c03abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:03.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 --2- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fef8c038710 0x7fef8c03abd0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fef900098c0 tx=0x7fef90006db0 comp rx=0 tx=0).stop 2024-09-13T17:55:03.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 msgr2=0x7fefa41971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:03.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 --2- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 0x7fefa41971a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fef98005ab0 tx=0x7fef98003cd0 comp rx=0 tx=0).stop 2024-09-13T17:55:03.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 shutdown_connections 2024-09-13T17:55:03.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 --2- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fef8c038710 0x7fef8c03abd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:03.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 --2- 172.21.15.27:0/1575275134 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fefa4072880 0x7fefa41971a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:03.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 >> 172.21.15.27:0/1575275134 conn(0x7fefa40fb250 msgr2=0x7fefa41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:03.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 shutdown_connections 2024-09-13T17:55:03.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:03.245+0000 7fefaa600640 1 -- 172.21.15.27:0/1575275134 wait complete. 2024-09-13T17:55:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:03 smithi027 ceph-mon[30611]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:55:03.942 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi143 2024-09-13T17:55:03.942 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:55:03.943 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/etc/ceph/ceph.conf 2024-09-13T17:55:03.962 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:55:03.962 DEBUG:teuthology.orchestra.run.smithi143:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:55:04.021 INFO:tasks.cephadm:Adding host smithi143 to orchestrator... 2024-09-13T17:55:04.021 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch host add smithi143 2024-09-13T17:55:04.339 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:55:04.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:04 smithi027 ceph-mon[30611]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:04.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:04 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:04.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:04 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:04.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:04 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:04.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:04 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:04.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:04 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:55:04.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:04 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:04.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:04 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:06.170 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:06 smithi027 ceph-mon[30611]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T17:55:06.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:06 smithi027 ceph-mon[30611]: Updating smithi122:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:06.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:06 smithi027 ceph-mon[30611]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:55:06.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:06 smithi027 ceph-mon[30611]: Updating smithi122:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:55:06.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:06.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:06.171 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:06.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.276+0000 7f3683400640 1 -- 172.21.15.27:0/1512115144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 msgr2=0x7f367c100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:06.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.276+0000 7f3683400640 1 --2- 172.21.15.27:0/1512115144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 0x7f367c100d10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3670009880 tx=0x7f367002a670 comp rx=0 tx=0).stop 2024-09-13T17:55:06.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.276+0000 7f3683400640 1 -- 172.21.15.27:0/1512115144 shutdown_connections 2024-09-13T17:55:06.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.276+0000 7f3683400640 1 --2- 172.21.15.27:0/1512115144 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 0x7f367c100d10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:06.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.276+0000 7f3683400640 1 -- 172.21.15.27:0/1512115144 >> 172.21.15.27:0/1512115144 conn(0x7f367c0fa3b0 msgr2=0x7f367c0fc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:06.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.276+0000 7f3683400640 1 -- 172.21.15.27:0/1512115144 shutdown_connections 2024-09-13T17:55:06.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.276+0000 7f3683400640 1 -- 172.21.15.27:0/1512115144 wait complete. 2024-09-13T17:55:06.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.277+0000 7f3683400640 1 Processor -- start 2024-09-13T17:55:06.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.277+0000 7f3683400640 1 -- start start 2024-09-13T17:55:06.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.278+0000 7f3683400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 0x7f367c195150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:06.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.278+0000 7f3683400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c195690 con 0x7f367c100930 2024-09-13T17:55:06.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.278+0000 7f3680a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 0x7f367c195150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:06.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.278+0000 7f3680a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 0x7f367c195150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:34630/0 (socket says 172.21.15.27:34630) 2024-09-13T17:55:06.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.278+0000 7f3680a00640 1 -- 172.21.15.27:0/2693262884 learned_addr learned my addr 172.21.15.27:0/2693262884 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:55:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.278+0000 7f3680a00640 1 -- 172.21.15.27:0/2693262884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009560 con 0x7f367c100930 2024-09-13T17:55:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.279+0000 7f3680a00640 1 --2- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 0x7f367c195150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3670005ab0 tx=0x7f3670003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.279+0000 7f3679600640 1 -- 172.21.15.27:0/2693262884 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3670005160 con 0x7f367c100930 2024-09-13T17:55:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.279+0000 7f3679600640 1 -- 172.21.15.27:0/2693262884 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3670004ba0 con 0x7f367c100930 2024-09-13T17:55:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.279+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367c195890 con 0x7f367c100930 2024-09-13T17:55:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.279+0000 7f3679600640 1 -- 172.21.15.27:0/2693262884 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f367003ba00 con 0x7f367c100930 2024-09-13T17:55:06.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.279+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c195cb0 con 0x7f367c100930 2024-09-13T17:55:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.280+0000 7f3679600640 1 -- 172.21.15.27:0/2693262884 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f367003bcc0 con 0x7f367c100930 2024-09-13T17:55:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.280+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367c0687a0 con 0x7f367c100930 2024-09-13T17:55:06.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.281+0000 7f3679600640 1 --2- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3664038710 0x7f366403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.281+0000 7f3679600640 1 -- 172.21.15.27:0/2693262884 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f367006c140 con 0x7f367c100930 2024-09-13T17:55:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.281+0000 7f367be00640 1 --2- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3664038710 0x7f366403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:06.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.282+0000 7f367be00640 1 --2- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3664038710 0x7f366403abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f36680098c0 tx=0x7f3668006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:06.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.286+0000 7f3679600640 1 -- 172.21.15.27:0/2693262884 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3670004d10 con 0x7f367c100930 2024-09-13T17:55:06.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:06.472+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi143", "target": ["mon-mgr", ""]}) v1 -- 0x7f367c109ca0 con 0x7f3664038710 2024-09-13T17:55:07.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:07 smithi027 ceph-mon[30611]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:08.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:08 smithi027 ceph-mon[30611]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi143", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:55:09.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:09 smithi027 ceph-mon[30611]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:09.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:09 smithi027 ceph-mon[30611]: Deploying cephadm binary to smithi143 2024-09-13T17:55:09.790 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.787+0000 7f3679600640 1 -- 172.21.15.27:0/2693262884 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f367c109ca0 con 0x7f3664038710 2024-09-13T17:55:09.790 INFO:teuthology.orchestra.run.smithi027.stdout:Added host 'smithi143' with addr '172.21.15.143' 2024-09-13T17:55:09.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3664038710 msgr2=0x7f366403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:09.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 --2- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3664038710 0x7f366403abd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f36680098c0 tx=0x7f3668006db0 comp rx=0 tx=0).stop 2024-09-13T17:55:09.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 msgr2=0x7f367c195150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:09.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 --2- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 0x7f367c195150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3670005ab0 tx=0x7f3670003cd0 comp rx=0 tx=0).stop 2024-09-13T17:55:09.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 shutdown_connections 2024-09-13T17:55:09.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 --2- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3664038710 0x7f366403abd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:09.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 --2- 172.21.15.27:0/2693262884 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f367c100930 0x7f367c195150 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:09.793 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 >> 172.21.15.27:0/2693262884 conn(0x7f367c0fa3b0 msgr2=0x7f367c1036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:09.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 shutdown_connections 2024-09-13T17:55:09.794 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:09.790+0000 7f3683400640 1 -- 172.21.15.27:0/2693262884 wait complete. 2024-09-13T17:55:10.523 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T17:55:10.837 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:55:11.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:10 smithi027 ceph-mon[30611]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:11.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:11.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:10 smithi027 ceph-mon[30611]: Added host smithi143 2024-09-13T17:55:11.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:11.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:11.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:12.332 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:12.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.770+0000 7f4103000640 1 -- 172.21.15.27:0/3267007137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 msgr2=0x7f40fc107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:12.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.770+0000 7f4103000640 1 --2- 172.21.15.27:0/3267007137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 0x7f40fc107d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f40ec009880 tx=0x7f40ec02a5d0 comp rx=0 tx=0).stop 2024-09-13T17:55:12.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.770+0000 7f4103000640 1 -- 172.21.15.27:0/3267007137 shutdown_connections 2024-09-13T17:55:12.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.770+0000 7f4103000640 1 --2- 172.21.15.27:0/3267007137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 0x7f40fc107d50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:12.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.770+0000 7f4103000640 1 -- 172.21.15.27:0/3267007137 >> 172.21.15.27:0/3267007137 conn(0x7f40fc0fd630 msgr2=0x7f40fc0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:12.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.770+0000 7f4103000640 1 -- 172.21.15.27:0/3267007137 shutdown_connections 2024-09-13T17:55:12.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.771+0000 7f4103000640 1 -- 172.21.15.27:0/3267007137 wait complete. 2024-09-13T17:55:12.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.771+0000 7f4103000640 1 Processor -- start 2024-09-13T17:55:12.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.772+0000 7f4103000640 1 -- start start 2024-09-13T17:55:12.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.772+0000 7f4103000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 0x7f40fc197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:12.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.772+0000 7f4103000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40fc197780 con 0x7f40fc107970 2024-09-13T17:55:12.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.772+0000 7f40fbe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 0x7f40fc197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:12.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.772+0000 7f40fbe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 0x7f40fc197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51022/0 (socket says 172.21.15.27:51022) 2024-09-13T17:55:12.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.772+0000 7f40fbe00640 1 -- 172.21.15.27:0/69316965 learned_addr learned my addr 172.21.15.27:0/69316965 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:55:12.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.773+0000 7f40fbe00640 1 -- 172.21.15.27:0/69316965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec009560 con 0x7f40fc107970 2024-09-13T17:55:12.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.773+0000 7f40fbe00640 1 --2- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 0x7f40fc197240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f40ec005ab0 tx=0x7f40ec003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:12.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.773+0000 7f40f9600640 1 -- 172.21.15.27:0/69316965 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40ec005160 con 0x7f40fc107970 2024-09-13T17:55:12.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.773+0000 7f40f9600640 1 -- 172.21.15.27:0/69316965 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f40ec004ba0 con 0x7f40fc107970 2024-09-13T17:55:12.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.773+0000 7f40f9600640 1 -- 172.21.15.27:0/69316965 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40ec03ba00 con 0x7f40fc107970 2024-09-13T17:55:12.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.773+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40fc197980 con 0x7f40fc107970 2024-09-13T17:55:12.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.774+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40fc197e00 con 0x7f40fc107970 2024-09-13T17:55:12.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.775+0000 7f40f9600640 1 -- 172.21.15.27:0/69316965 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f40ec03bc70 con 0x7f40fc107970 2024-09-13T17:55:12.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.775+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40fc1030b0 con 0x7f40fc107970 2024-09-13T17:55:12.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.775+0000 7f40f9600640 1 --2- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f40e0038760 0x7f40e003ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:12.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.775+0000 7f40f9600640 1 -- 172.21.15.27:0/69316965 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f40ec06c0e0 con 0x7f40fc107970 2024-09-13T17:55:12.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.776+0000 7f40f3e00640 1 --2- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f40e0038760 0x7f40e003ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:12.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.776+0000 7f40f3e00640 1 --2- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f40e0038760 0x7f40e003ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f40e40098c0 tx=0x7f40e4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:12.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.780+0000 7f40f9600640 1 -- 172.21.15.27:0/69316965 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f40ec09fe20 con 0x7f40fc107970 2024-09-13T17:55:12.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.966+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40fc10be20 con 0x7f40e0038760 2024-09-13T17:55:12.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.967+0000 7f40f9600640 1 -- 172.21.15.27:0/69316965 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f40fc10be20 con 0x7f40e0038760 2024-09-13T17:55:12.970 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T17:55:12.970 INFO:teuthology.orchestra.run.smithi027.stdout:[{"addr": "172.21.15.27", "hostname": "smithi027", "labels": [], "status": ""}, {"addr": "172.21.15.122", "hostname": "smithi122", "labels": [], "status": ""}, {"addr": "172.21.15.143", "hostname": "smithi143", "labels": [], "status": ""}] 2024-09-13T17:55:12.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.969+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f40e0038760 msgr2=0x7f40e003ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:12.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.969+0000 7f4103000640 1 --2- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f40e0038760 0x7f40e003ac20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f40e40098c0 tx=0x7f40e4006db0 comp rx=0 tx=0).stop 2024-09-13T17:55:12.972 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.969+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 msgr2=0x7f40fc197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:12.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.969+0000 7f4103000640 1 --2- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 0x7f40fc197240 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f40ec005ab0 tx=0x7f40ec003cd0 comp rx=0 tx=0).stop 2024-09-13T17:55:12.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.969+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 shutdown_connections 2024-09-13T17:55:12.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.969+0000 7f4103000640 1 --2- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f40e0038760 0x7f40e003ac20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:12.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.969+0000 7f4103000640 1 --2- 172.21.15.27:0/69316965 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f40fc107970 0x7f40fc197240 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:12.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.969+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 >> 172.21.15.27:0/69316965 conn(0x7f40fc0fd630 msgr2=0x7f40fc0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:12.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.969+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 shutdown_connections 2024-09-13T17:55:12.973 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:12.970+0000 7f4103000640 1 -- 172.21.15.27:0/69316965 wait complete. 2024-09-13T17:55:13.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:13 smithi027 ceph-mon[30611]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:13.675 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T17:55:13.675 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T17:55:13.999 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:55:14.355 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:14 smithi027 ceph-mon[30611]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:55:14.355 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:14 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:14.355 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:14 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:14.355 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:14 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:14.355 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:14 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:14.355 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:14 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi143", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:55:14.355 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:14 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:14.356 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:14 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:15.260 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:15 smithi027 ceph-mon[30611]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:15.260 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:15 smithi027 ceph-mon[30611]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-13T17:55:15.260 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:15 smithi027 ceph-mon[30611]: Updating smithi143:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:15.260 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:15 smithi027 ceph-mon[30611]: Updating smithi143:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:55:15.260 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:15.260 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:15.260 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:15.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.867+0000 7f479b400640 1 -- 172.21.15.27:0/1017618605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 msgr2=0x7f47940726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.867+0000 7f479b400640 1 --2- 172.21.15.27:0/1017618605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 0x7f47940726e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4788009880 tx=0x7f478802a670 comp rx=0 tx=0).stop 2024-09-13T17:55:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.868+0000 7f479b400640 1 -- 172.21.15.27:0/1017618605 shutdown_connections 2024-09-13T17:55:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.868+0000 7f479b400640 1 --2- 172.21.15.27:0/1017618605 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 0x7f47940726e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.868+0000 7f479b400640 1 -- 172.21.15.27:0/1017618605 >> 172.21.15.27:0/1017618605 conn(0x7f4794076500 msgr2=0x7f4794076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.868+0000 7f479b400640 1 -- 172.21.15.27:0/1017618605 shutdown_connections 2024-09-13T17:55:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.868+0000 7f479b400640 1 -- 172.21.15.27:0/1017618605 wait complete. 2024-09-13T17:55:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.869+0000 7f479b400640 1 Processor -- start 2024-09-13T17:55:15.890 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.869+0000 7f479b400640 1 -- start start 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.869+0000 7f479b400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 0x7f479419b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.869+0000 7f479b400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479419bc00 con 0x7f4794074350 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.869+0000 7f4798a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 0x7f479419b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.869+0000 7f4798a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 0x7f479419b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51034/0 (socket says 172.21.15.27:51034) 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.869+0000 7f4798a00640 1 -- 172.21.15.27:0/2940019622 learned_addr learned my addr 172.21.15.27:0/2940019622 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.870+0000 7f4798a00640 1 -- 172.21.15.27:0/2940019622 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4788009560 con 0x7f4794074350 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.870+0000 7f4798a00640 1 --2- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 0x7f479419b6c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4788005760 tx=0x7f4788003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.870+0000 7f4791600640 1 -- 172.21.15.27:0/2940019622 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f478803b670 con 0x7f4794074350 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.870+0000 7f4791600640 1 -- 172.21.15.27:0/2940019622 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f478803bcb0 con 0x7f4794074350 2024-09-13T17:55:15.891 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.870+0000 7f4791600640 1 -- 172.21.15.27:0/2940019622 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4788031ce0 con 0x7f4794074350 2024-09-13T17:55:15.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.870+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479419be00 con 0x7f4794074350 2024-09-13T17:55:15.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.871+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479419c280 con 0x7f4794074350 2024-09-13T17:55:15.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.871+0000 7f4791600640 1 -- 172.21.15.27:0/2940019622 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f4788031400 con 0x7f4794074350 2024-09-13T17:55:15.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.872+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4794073c00 con 0x7f4794074350 2024-09-13T17:55:15.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.872+0000 7f4791600640 1 --2- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f477c038760 0x7f477c03ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:15.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.872+0000 7f4791600640 1 -- 172.21.15.27:0/2940019622 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f478806c000 con 0x7f4794074350 2024-09-13T17:55:15.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.872+0000 7f4793e00640 1 --2- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f477c038760 0x7f477c03ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:15.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.873+0000 7f4793e00640 1 --2- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f477c038760 0x7f477c03ac20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f47800098c0 tx=0x7f4780006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:15.892 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:15.877+0000 7f4791600640 1 -- 172.21.15.27:0/2940019622 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f478802f300 con 0x7f4794074350 2024-09-13T17:55:16.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.065+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f4794110210 con 0x7f4794074350 2024-09-13T17:55:16.110 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.107+0000 7f4791600640 1 -- 172.21.15.27:0/2940019622 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f4788035020 con 0x7f4794074350 2024-09-13T17:55:16.110 INFO:teuthology.orchestra.run.smithi027.stderr:adjusted tunables profile to default 2024-09-13T17:55:16.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f477c038760 msgr2=0x7f477c03ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:16.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 --2- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f477c038760 0x7f477c03ac20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f47800098c0 tx=0x7f4780006db0 comp rx=0 tx=0).stop 2024-09-13T17:55:16.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 msgr2=0x7f479419b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:16.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 --2- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 0x7f479419b6c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4788005760 tx=0x7f4788003cb0 comp rx=0 tx=0).stop 2024-09-13T17:55:16.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 shutdown_connections 2024-09-13T17:55:16.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 --2- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f477c038760 0x7f477c03ac20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:16.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 --2- 172.21.15.27:0/2940019622 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4794074350 0x7f479419b6c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:16.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 >> 172.21.15.27:0/2940019622 conn(0x7f4794076500 msgr2=0x7f47940fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:16.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 shutdown_connections 2024-09-13T17:55:16.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:16.110+0000 7f479b400640 1 -- 172.21.15.27:0/2940019622 wait complete. 2024-09-13T17:55:16.126 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:16 smithi027 ceph-mon[30611]: Updating smithi143:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:55:16.126 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:16 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2940019622' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T17:55:16.822 INFO:tasks.cephadm:Adding mon.a on smithi027 2024-09-13T17:55:16.822 INFO:tasks.cephadm:Adding mon.b on smithi122 2024-09-13T17:55:16.822 INFO:tasks.cephadm:Adding mon.c on smithi143 2024-09-13T17:55:16.823 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi027:172.21.15.27=a;smithi122:172.21.15.122=b;smithi143:172.21.15.143=c' 2024-09-13T17:55:17.018 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:17.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:17 smithi027 ceph-mon[30611]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:17.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:17 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2940019622' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T17:55:17.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:17 smithi027 ceph-mon[30611]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:18.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.452+0000 7f07f0db5640 1 -- 172.21.15.143:0/1657788649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 msgr2=0x7f07ec104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.452+0000 7f07f0db5640 1 --2- 172.21.15.143:0/1657788649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 0x7f07ec104a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009c20 tx=0x7f07e402aa90 comp rx=0 tx=0).stop 2024-09-13T17:55:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.452+0000 7f07f0db5640 1 -- 172.21.15.143:0/1657788649 shutdown_connections 2024-09-13T17:55:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.452+0000 7f07f0db5640 1 --2- 172.21.15.143:0/1657788649 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 0x7f07ec104a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.452+0000 7f07f0db5640 1 -- 172.21.15.143:0/1657788649 >> 172.21.15.143:0/1657788649 conn(0x7f07ec075490 msgr2=0x7f07ec0fc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.453+0000 7f07f0db5640 1 -- 172.21.15.143:0/1657788649 shutdown_connections 2024-09-13T17:55:18.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.453+0000 7f07f0db5640 1 -- 172.21.15.143:0/1657788649 wait complete. 2024-09-13T17:55:18.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.453+0000 7f07f0db5640 1 Processor -- start 2024-09-13T17:55:18.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.453+0000 7f07f0db5640 1 -- start start 2024-09-13T17:55:18.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.453+0000 7f07f0db5640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 0x7f07ec195120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:18.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.454+0000 7f07f0db5640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec195660 con 0x7f07ec104650 2024-09-13T17:55:18.456 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.454+0000 7f07ea59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 0x7f07ec195120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:18.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.454+0000 7f07ea59c640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 0x7f07ec195120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.143:55486/0 (socket says 172.21.15.143:55486) 2024-09-13T17:55:18.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.454+0000 7f07ea59c640 1 -- 172.21.15.143:0/1605680414 learned_addr learned my addr 172.21.15.143:0/1605680414 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T17:55:18.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.455+0000 7f07ea59c640 1 -- 172.21.15.143:0/1605680414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e4009900 con 0x7f07ec104650 2024-09-13T17:55:18.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.455+0000 7f07ea59c640 1 --2- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 0x7f07ec195120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009430 tx=0x7f07e402f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:18.457 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.455+0000 7f07e37fe640 1 -- 172.21.15.143:0/1605680414 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07e403e070 con 0x7f07ec104650 2024-09-13T17:55:18.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.455+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec1958c0 con 0x7f07ec104650 2024-09-13T17:55:18.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.455+0000 7f07e37fe640 1 -- 172.21.15.143:0/1605680414 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f07e402fc00 con 0x7f07ec104650 2024-09-13T17:55:18.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.455+0000 7f07e37fe640 1 -- 172.21.15.143:0/1605680414 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f07e40047d0 con 0x7f07ec104650 2024-09-13T17:55:18.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.455+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec195d40 con 0x7f07ec104650 2024-09-13T17:55:18.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.456+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec0ffd90 con 0x7f07ec104650 2024-09-13T17:55:18.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.456+0000 7f07e37fe640 1 -- 172.21.15.143:0/1605680414 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f07e400a040 con 0x7f07ec104650 2024-09-13T17:55:18.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.456+0000 7f07e37fe640 1 --2- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07d8038710 0x7f07d803abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:18.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.456+0000 7f07e37fe640 1 -- 172.21.15.143:0/1605680414 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f07e406c2a0 con 0x7f07ec104650 2024-09-13T17:55:18.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.457+0000 7f07e9d9b640 1 --2- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07d8038710 0x7f07d803abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:18.459 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.458+0000 7f07e9d9b640 1 --2- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07d8038710 0x7f07d803abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07d40098c0 tx=0x7f07d4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:18.464 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.462+0000 7f07e37fe640 1 -- 172.21.15.143:0/1605680414 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f07e404c440 con 0x7f07ec104650 2024-09-13T17:55:18.639 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.637+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi027:172.21.15.27=a;smithi122:172.21.15.122=b;smithi143:172.21.15.143=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f07ec108bc0 con 0x7f07d8038710 2024-09-13T17:55:18.645 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.644+0000 7f07e37fe640 1 -- 172.21.15.143:0/1605680414 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f07ec108bc0 con 0x7f07d8038710 2024-09-13T17:55:18.646 INFO:teuthology.orchestra.run.smithi143.stdout:Scheduled mon update... 2024-09-13T17:55:18.647 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.645+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07d8038710 msgr2=0x7f07d803abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:18.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.645+0000 7f07f0db5640 1 --2- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07d8038710 0x7f07d803abd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07d40098c0 tx=0x7f07d4006db0 comp rx=0 tx=0).stop 2024-09-13T17:55:18.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.645+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 msgr2=0x7f07ec195120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:18.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.645+0000 7f07f0db5640 1 --2- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 0x7f07ec195120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f07e4009430 tx=0x7f07e402f670 comp rx=0 tx=0).stop 2024-09-13T17:55:18.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.646+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 shutdown_connections 2024-09-13T17:55:18.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.646+0000 7f07f0db5640 1 --2- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07d8038710 0x7f07d803abd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:18.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.646+0000 7f07f0db5640 1 --2- 172.21.15.143:0/1605680414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f07ec104650 0x7f07ec195120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:18.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.646+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 >> 172.21.15.143:0/1605680414 conn(0x7f07ec075490 msgr2=0x7f07ec103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:18.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.646+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 shutdown_connections 2024-09-13T17:55:18.648 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:18.646+0000 7f07f0db5640 1 -- 172.21.15.143:0/1605680414 wait complete. 2024-09-13T17:55:19.253 DEBUG:teuthology.orchestra.run.smithi122:mon.b> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.b.service 2024-09-13T17:55:19.256 DEBUG:teuthology.orchestra.run.smithi143:mon.c> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.c.service 2024-09-13T17:55:19.259 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T17:55:19.259 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:19 smithi027 ceph-mon[30611]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:20.322 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:20.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:20 smithi027 ceph-mon[30611]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi027:172.21.15.27=a;smithi122:172.21.15.122=b;smithi143:172.21.15.143=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:55:20.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:20 smithi027 ceph-mon[30611]: Saving service mon spec with placement smithi027:172.21.15.27=a;smithi122:172.21.15.122=b;smithi143:172.21.15.143=c;count:3 2024-09-13T17:55:20.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:20 smithi027 ceph-mon[30611]: Deploying daemon mon.c on smithi143 2024-09-13T17:55:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:21 smithi027 ceph-mon[30611]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:21.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.828+0000 7fadba339640 1 -- 172.21.15.143:0/1248779999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 msgr2=0x7fadb4105c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:21.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.828+0000 7fadba339640 1 --2- 172.21.15.143:0/1248779999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 0x7fadb4105c10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fada4009880 tx=0x7fada402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:55:21.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.829+0000 7fadba339640 1 -- 172.21.15.143:0/1248779999 shutdown_connections 2024-09-13T17:55:21.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.829+0000 7fadba339640 1 --2- 172.21.15.143:0/1248779999 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 0x7fadb4105c10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:21.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.829+0000 7fadba339640 1 -- 172.21.15.143:0/1248779999 >> 172.21.15.143:0/1248779999 conn(0x7fadb4076500 msgr2=0x7fadb4076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:21.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.829+0000 7fadba339640 1 -- 172.21.15.143:0/1248779999 shutdown_connections 2024-09-13T17:55:21.834 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.829+0000 7fadba339640 1 -- 172.21.15.143:0/1248779999 wait complete. 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.829+0000 7fadba339640 1 Processor -- start 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.829+0000 7fadba339640 1 -- start start 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.829+0000 7fadba339640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 0x7fadb4195120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.829+0000 7fadba339640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb4195660 con 0x7fadb4105830 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.830+0000 7fadb3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 0x7fadb4195120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.830+0000 7fadb3fff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 0x7fadb4195120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.143:55494/0 (socket says 172.21.15.143:55494) 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.830+0000 7fadb3fff640 1 -- 172.21.15.143:0/2064754727 learned_addr learned my addr 172.21.15.143:0/2064754727 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.830+0000 7fadb3fff640 1 -- 172.21.15.143:0/2064754727 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada4009560 con 0x7fadb4105830 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.830+0000 7fadb3fff640 1 --2- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 0x7fadb4195120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fada4005760 tx=0x7fada4003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.831+0000 7fadb1ffb640 1 -- 172.21.15.143:0/2064754727 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fada403b670 con 0x7fadb4105830 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.831+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb4195860 con 0x7fadb4105830 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.831+0000 7fadb1ffb640 1 -- 172.21.15.143:0/2064754727 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fada403bcb0 con 0x7fadb4105830 2024-09-13T17:55:21.835 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.831+0000 7fadb1ffb640 1 -- 172.21.15.143:0/2064754727 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fada4031ce0 con 0x7fadb4105830 2024-09-13T17:55:21.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.831+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb4195ce0 con 0x7fadb4105830 2024-09-13T17:55:21.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.832+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb4100ed0 con 0x7fadb4105830 2024-09-13T17:55:21.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.832+0000 7fadb1ffb640 1 -- 172.21.15.143:0/2064754727 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fada403b7d0 con 0x7fadb4105830 2024-09-13T17:55:21.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.832+0000 7fadb1ffb640 1 --2- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fada0038710 0x7fada003abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:21.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.832+0000 7fadb1ffb640 1 -- 172.21.15.143:0/2064754727 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fada406bf90 con 0x7fadb4105830 2024-09-13T17:55:21.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.832+0000 7fadabfff640 1 --2- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fada0038710 0x7fada003abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:21.836 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.833+0000 7fadabfff640 1 --2- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fada0038710 0x7fada003abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0098c0 tx=0x7fad9c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:21.839 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:21.837+0000 7fadb1ffb640 1 -- 172.21.15.143:0/2064754727 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fada409fe20 con 0x7fadb4105830 2024-09-13T17:55:22.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.068+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fadb4109c80 con 0x7fadb4105830 2024-09-13T17:55:22.070 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.069+0000 7fadb1ffb640 1 -- 172.21.15.143:0/2064754727 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7fada4035070 con 0x7fadb4105830 2024-09-13T17:55:22.071 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:55:22.071 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","modified":"2024-09-13T17:53:36.559737Z","created":"2024-09-13T17:53:36.559737Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T17:55:22.071 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fada0038710 msgr2=0x7fada003abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 --2- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fada0038710 0x7fada003abd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0098c0 tx=0x7fad9c006db0 comp rx=0 tx=0).stop 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 msgr2=0x7fadb4195120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 --2- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 0x7fadb4195120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fada4005760 tx=0x7fada4003cb0 comp rx=0 tx=0).stop 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 shutdown_connections 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 --2- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fada0038710 0x7fada003abd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 --2- 172.21.15.143:0/2064754727 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fadb4105830 0x7fadb4195120 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 >> 172.21.15.143:0/2064754727 conn(0x7fadb4076500 msgr2=0x7fadb40fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 shutdown_connections 2024-09-13T17:55:22.073 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:22.071+0000 7fadba339640 1 -- 172.21.15.143:0/2064754727 wait complete. 2024-09-13T17:55:22.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:22 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/2064754727' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:23 smithi027 ceph-mon[30611]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:23.784 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T17:55:23.785 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T17:55:23.986 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:55:25.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:25 smithi027 ceph-mon[30611]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:25.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.553+0000 7f10b290a640 1 -- 172.21.15.143:0/730641522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 msgr2=0x7f10ac104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:25.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.553+0000 7f10b290a640 1 --2- 172.21.15.143:0/730641522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 0x7f10ac104b70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f109c009880 tx=0x7f109c02a5d0 comp rx=0 tx=0).stop 2024-09-13T17:55:25.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.553+0000 7f10b290a640 1 -- 172.21.15.143:0/730641522 shutdown_connections 2024-09-13T17:55:25.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.553+0000 7f10b290a640 1 --2- 172.21.15.143:0/730641522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 0x7f10ac104b70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:25.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.553+0000 7f10b290a640 1 -- 172.21.15.143:0/730641522 >> 172.21.15.143:0/730641522 conn(0x7f10ac0fa490 msgr2=0x7f10ac0fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:25.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.553+0000 7f10b290a640 1 -- 172.21.15.143:0/730641522 shutdown_connections 2024-09-13T17:55:25.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.553+0000 7f10b290a640 1 -- 172.21.15.143:0/730641522 wait complete. 2024-09-13T17:55:25.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.554+0000 7f10b290a640 1 Processor -- start 2024-09-13T17:55:25.559 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.554+0000 7f10b290a640 1 -- start start 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.554+0000 7f10b290a640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 0x7f10ac0fa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.554+0000 7f10b290a640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac0fc850 con 0x7f10ac104790 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.555+0000 7f10abfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 0x7f10ac0fa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.555+0000 7f10abfff640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 0x7f10ac0fa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.143:55510/0 (socket says 172.21.15.143:55510) 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.555+0000 7f10abfff640 1 -- 172.21.15.143:0/1898964251 learned_addr learned my addr 172.21.15.143:0/1898964251 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.555+0000 7f10abfff640 1 -- 172.21.15.143:0/1898964251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109c009560 con 0x7f10ac104790 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.555+0000 7f10abfff640 1 --2- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 0x7f10ac0fa940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f109c005760 tx=0x7f109c003cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.556+0000 7f10a97fa640 1 -- 172.21.15.143:0/1898964251 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f109c03b670 con 0x7f10ac104790 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.556+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ac0fae80 con 0x7f10ac104790 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.556+0000 7f10a97fa640 1 -- 172.21.15.143:0/1898964251 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f109c03bcb0 con 0x7f10ac104790 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.556+0000 7f10a97fa640 1 -- 172.21.15.143:0/1898964251 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f109c031ce0 con 0x7f10ac104790 2024-09-13T17:55:25.560 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.556+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ac0fb300 con 0x7f10ac104790 2024-09-13T17:55:25.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.557+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ac103670 con 0x7f10ac104790 2024-09-13T17:55:25.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.557+0000 7f10a97fa640 1 -- 172.21.15.143:0/1898964251 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f109c03b7d0 con 0x7f10ac104790 2024-09-13T17:55:25.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.557+0000 7f10a97fa640 1 --2- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1094038710 0x7f109403abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:25.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.557+0000 7f10a97fa640 1 -- 172.21.15.143:0/1898964251 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f109c06c040 con 0x7f10ac104790 2024-09-13T17:55:25.561 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.557+0000 7f10ab7fe640 1 --2- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1094038710 0x7f109403abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:25.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.558+0000 7f10ab7fe640 1 --2- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1094038710 0x7f109403abd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f10a00098c0 tx=0x7f10a0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:25.565 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.562+0000 7f10a97fa640 1 -- 172.21.15.143:0/1898964251 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f109c09fe20 con 0x7f10ac104790 2024-09-13T17:55:25.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.803+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f10ac0fbfb0 con 0x7f10ac104790 2024-09-13T17:55:25.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.804+0000 7f10a97fa640 1 -- 172.21.15.143:0/1898964251 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7f10ac0fbfb0 con 0x7f10ac104790 2024-09-13T17:55:25.807 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:55:25.807 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":1,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","modified":"2024-09-13T17:53:36.559737Z","created":"2024-09-13T17:53:36.559737Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T17:55:25.808 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 1 2024-09-13T17:55:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1094038710 msgr2=0x7f109403abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 --2- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1094038710 0x7f109403abd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f10a00098c0 tx=0x7f10a0006db0 comp rx=0 tx=0).stop 2024-09-13T17:55:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 msgr2=0x7f10ac0fa940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 --2- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 0x7f10ac0fa940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f109c005760 tx=0x7f109c003cb0 comp rx=0 tx=0).stop 2024-09-13T17:55:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 shutdown_connections 2024-09-13T17:55:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 --2- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1094038710 0x7f109403abd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 --2- 172.21.15.143:0/1898964251 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f10ac104790 0x7f10ac0fa940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 >> 172.21.15.143:0/1898964251 conn(0x7f10ac0fa490 msgr2=0x7f10ac0683c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:25.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 shutdown_connections 2024-09-13T17:55:25.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:25.806+0000 7f10b290a640 1 -- 172.21.15.143:0/1898964251 wait complete. 2024-09-13T17:55:26.365 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:26 smithi143 systemd[1]: Started Ceph mon.c for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T17:55:26.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:26 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/1898964251' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:27.745 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T17:55:27.745 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T17:55:27.961 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:55:31.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:31.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:55:31.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: mon.a calling monitor election 2024-09-13T17:55:31.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:31.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: mon.c calling monitor election 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: monmap e2: 2 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0],c=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: fsmap 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: mgrmap e13: x(active, since 55s) 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: overall HEALTH_OK 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:31.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:31.528 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:31.528 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: mon.a calling monitor election 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: mon.c calling monitor election 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: monmap e2: 2 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0],c=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: fsmap 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: mgrmap e13: x(active, since 55s) 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: overall HEALTH_OK 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:31.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:32.449 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.445+0000 7fdba26da640 1 -- 172.21.15.143:0/355825508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb88003530 msgr2=0x7fdb880059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.445+0000 7fdba26da640 1 --2- 172.21.15.143:0/355825508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb88003530 0x7fdb880059c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c067df0 tx=0x7fdb8c02bce0 comp rx=0 tx=0).stop 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.446+0000 7fdba26da640 1 -- 172.21.15.143:0/355825508 shutdown_connections 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.446+0000 7fdba26da640 1 --2- 172.21.15.143:0/355825508 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb88003530 0x7fdb880059c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.446+0000 7fdba26da640 1 -- 172.21.15.143:0/355825508 >> 172.21.15.143:0/355825508 conn(0x7fdb9c0f9c10 msgr2=0x7fdb9c0fc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.446+0000 7fdba26da640 1 -- 172.21.15.143:0/355825508 shutdown_connections 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.446+0000 7fdba26da640 1 -- 172.21.15.143:0/355825508 wait complete. 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.446+0000 7fdba26da640 1 Processor -- start 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.446+0000 7fdba26da640 1 -- start start 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdba26da640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 0x7fdb9c1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:32.450 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdba26da640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb9c1979f0 0x7fdb9c19bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdba26da640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c197f60 con 0x7fdb9c1979f0 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdba26da640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c1980d0 con 0x7fdb88003530 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdb9bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 0x7fdb9c1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdb9bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 0x7fdb9c1974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:58060/0 (socket says 172.21.15.143:58060) 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdb9bfff640 1 -- 172.21.15.143:0/2509487241 learned_addr learned my addr 172.21.15.143:0/2509487241 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdb9bfff640 1 -- 172.21.15.143:0/2509487241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 msgr2=0x7fdb9c1974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdb9bfff640 1 -- 172.21.15.143:0/2509487241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 msgr2=0x7fdb9c1974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdb9bfff640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 0x7fdb9c1974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdb9bfff640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 0x7fdb9c1974b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.447+0000 7fdb93fff640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb9c1979f0 0x7fdb9c19bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.448+0000 7fdb93fff640 1 -- 172.21.15.143:0/2509487241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 msgr2=0x7fdb9c1974b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:55:32.451 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.448+0000 7fdb93fff640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 0x7fdb9c1974b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:32.452 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.448+0000 7fdb93fff640 1 -- 172.21.15.143:0/2509487241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c011870 con 0x7fdb9c1979f0 2024-09-13T17:55:32.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.448+0000 7fdb93fff640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb9c1979f0 0x7fdb9c19bdf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400b3d0 tx=0x7fdb8400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:32.453 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.448+0000 7fdb99ffb640 1 -- 172.21.15.143:0/2509487241 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fdb84011630 con 0x7fdb9c1979f0 2024-09-13T17:55:32.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.448+0000 7fdb99ffb640 1 -- 172.21.15.143:0/2509487241 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdb84011c70 con 0x7fdb9c1979f0 2024-09-13T17:55:32.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.448+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9c19c330 con 0x7fdb9c1979f0 2024-09-13T17:55:32.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.448+0000 7fdb99ffb640 1 -- 172.21.15.143:0/2509487241 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fdb84010dc0 con 0x7fdb9c1979f0 2024-09-13T17:55:32.454 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.448+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9c19c880 con 0x7fdb9c1979f0 2024-09-13T17:55:32.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.450+0000 7fdb99ffb640 1 -- 172.21.15.143:0/2509487241 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fdb8401a400 con 0x7fdb9c1979f0 2024-09-13T17:55:32.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.450+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9c1000b0 con 0x7fdb9c1979f0 2024-09-13T17:55:32.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.450+0000 7fdb99ffb640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdb7c038550 0x7fdb7c03aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:32.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.450+0000 7fdb99ffb640 1 -- 172.21.15.143:0/2509487241 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdb8404b0b0 con 0x7fdb9c1979f0 2024-09-13T17:55:32.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.450+0000 7fdb9bfff640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdb7c038550 0x7fdb7c03aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:32.455 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.451+0000 7fdb9bfff640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdb7c038550 0x7fdb7c03aa10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c005940 tx=0x7fdb8c0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:32.458 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.456+0000 7fdb99ffb640 1 -- 172.21.15.143:0/2509487241 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdb840176a0 con 0x7fdb9c1979f0 2024-09-13T17:55:32.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:32 smithi143 ceph-mon[38210]: Deploying daemon mon.b on smithi122 2024-09-13T17:55:32.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:32 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:32.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:32 smithi027 ceph-mon[30611]: Deploying daemon mon.b on smithi122 2024-09-13T17:55:32.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:32 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:32.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.684+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdb9c19cc10 con 0x7fdb9c1979f0 2024-09-13T17:55:32.687 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.684+0000 7fdb99ffb640 1 -- 172.21.15.143:0/2509487241 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7fdb840172c0 con 0x7fdb9c1979f0 2024-09-13T17:55:32.687 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:55:32.688 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":2,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","modified":"2024-09-13T17:55:26.163397Z","created":"2024-09-13T17:53:36.559737Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:3300","nonce":0},{"type":"v1","addr":"172.21.15.143:6789","nonce":0}]},"addr":"172.21.15.143:6789/0","public_addr":"172.21.15.143:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T17:55:32.689 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 2 2024-09-13T17:55:32.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdb7c038550 msgr2=0x7fdb7c03aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:32.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdb7c038550 0x7fdb7c03aa10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c005940 tx=0x7fdb8c0058b0 comp rx=0 tx=0).stop 2024-09-13T17:55:32.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb9c1979f0 msgr2=0x7fdb9c19bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:32.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb9c1979f0 0x7fdb9c19bdf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400b3d0 tx=0x7fdb8400b890 comp rx=0 tx=0).stop 2024-09-13T17:55:32.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 shutdown_connections 2024-09-13T17:55:32.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdb7c038550 0x7fdb7c03aa10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:32.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdb9c1979f0 0x7fdb9c19bdf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:32.689 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 --2- 172.21.15.143:0/2509487241 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdb88003530 0x7fdb9c1974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:32.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 >> 172.21.15.143:0/2509487241 conn(0x7fdb9c0f9c10 msgr2=0x7fdb9c0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:32.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 shutdown_connections 2024-09-13T17:55:32.690 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:32.686+0000 7fdba26da640 1 -- 172.21.15.143:0/2509487241 wait complete. 2024-09-13T17:55:33.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:33 smithi143 ceph-mon[38210]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:33.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:33 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/2509487241' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:33.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:33 smithi027 ceph-mon[30611]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:33 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/2509487241' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:33.557 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:55:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:55:33.163+0000 7f4ec7a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T17:55:34.291 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-13T17:55:34.291 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T17:55:34.492 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:55:34.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 podman[35291]: 2024-09-13 17:55:34.610750892 +0000 UTC m=+0.136762409 container create 889580ada60ef2b86330a7bc94fe1f20240aa0f0541d1ee81113e27fc0362ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T17:55:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 podman[35291]: 2024-09-13 17:55:34.910630245 +0000 UTC m=+0.436641763 container init 889580ada60ef2b86330a7bc94fe1f20240aa0f0541d1ee81113e27fc0362ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2) 2024-09-13T17:55:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 podman[35291]: 2024-09-13 17:55:34.913738271 +0000 UTC m=+0.439749786 container start 889580ada60ef2b86330a7bc94fe1f20240aa0f0541d1ee81113e27fc0362ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T17:55:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T17:55:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable), process ceph-mon, pid 2 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pidfile_write: ignore empty --pid-file 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: load: jerasure load: lrc 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: RocksDB version: 7.9.2 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Git sha 0 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Compile date 2024-09-10 12:59:06 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: DB SUMMARY 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: DB Session ID: XXVAEU5ZH1G53L1D8WHW 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: CURRENT file: CURRENT 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-13T17:55:35.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.error_if_exists: 0 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.create_if_missing: 0 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.paranoid_checks: 1 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.env: 0x55c5bb429bc0 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.info_log: 0x55c5bcd28be0 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.statistics: (nil) 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.use_fsync: 0 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_log_file_size: 0 2024-09-13T17:55:35.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.allow_fallocate: 1 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.use_direct_reads: 0 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.db_log_dir: 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.wal_dir: 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T17:55:35.217 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.write_buffer_manager: 0x55c5bcd36320 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T17:55:35.218 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.unordered_write: 0 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.row_cache: None 2024-09-13T17:55:35.219 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.wal_filter: None 2024-09-13T17:55:35.221 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T17:55:35.221 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T17:55:35.221 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.two_write_queues: 0 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.wal_compression: 0 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.atomic_flush: 0 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.log_readahead_size: 0 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T17:55:35.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_background_jobs: 2 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_background_compactions: -1 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_subcompactions: 1 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T17:55:35.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_open_files: -1 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_background_flushes: -1 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Compression algorithms supported: 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: kZSTD supported: 0 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: kXpressCompression supported: 0 2024-09-13T17:55:35.224 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: kBZip2Compression supported: 0 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: kLZ4Compression supported: 1 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: kZlibCompression supported: 1 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: kSnappyCompression supported: 1 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.merge_operator: 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_filter: None 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T17:55:35.225 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c5bcd287e0) 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: cache_index_and_filter_blocks: 1 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: pin_top_level_index_and_filter: 1 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: index_type: 0 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: data_block_index_type: 0 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: index_shortening: 1 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: checksum: 4 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: no_block_cache: 0 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_cache: 0x55c5bcd1d350 2024-09-13T17:55:35.226 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_cache_name: BinnedLRUCache 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_cache_options: 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: capacity : 536870912 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: num_shard_bits : 4 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: strict_capacity_limit : 0 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: high_pri_pool_ratio: 0.000 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_cache_compressed: (nil) 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: persistent_cache: (nil) 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_size: 4096 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_size_deviation: 10 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_restart_interval: 16 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: index_block_restart_interval: 1 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: metadata_block_size: 4096 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: partition_filters: 0 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: use_delta_encoding: 1 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: filter_policy: bloomfilter 2024-09-13T17:55:35.227 INFO:journalctl@ceph.mon.b.smithi122.stdout: whole_key_filtering: 1 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout: verify_compression: 0 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout: read_amp_bytes_per_bit: 0 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout: format_version: 5 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout: enable_index_compression: 1 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout: block_align: 0 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout: max_auto_readahead_size: 262144 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout: prepopulate_block_cache: 0 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout: initial_auto_readahead_size: 8192 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression: NoCompression 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T17:55:35.228 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.num_levels: 7 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T17:55:35.229 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T17:55:35.230 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T17:55:35.231 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T17:55:35.232 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.inplace_update_support: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.bloom_locality: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.max_successive_merges: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.ttl: 2592000 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T17:55:35.233 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.enable_blob_files: false 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.min_blob_size: 0 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-13T17:55:35.234 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d18c5597-6563-4f58-a98a-ff5fbb2e66c8 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250134940697, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250134941105, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726250134, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d18c5597-6563-4f58-a98a-ff5fbb2e66c8", "db_session_id": "XXVAEU5ZH1G53L1D8WHW", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726250134941198, "job": 1, "event": "recovery_finished"} 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c5bcd48e00 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: DB pointer 0x55c5bce3c000 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** DB Stats ** 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:55:35.235 INFO:journalctl@ceph.mon.b.smithi122.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** Compaction Stats [default] ** 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2024-09-13T17:55:35.236 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** Compaction Stats [default] ** 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T17:55:35.237 INFO:journalctl@ceph.mon.b.smithi122.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout: Block cache BinnedLRUCache@0x55c5bcd1d350#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: using public_addr v2:172.21.15.122:0/0 -> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: starting mon.b rank -1 at public addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] at bind addrs [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(???) e0 preinit fsid f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).mds e1 new map 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout: e1 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T17:55:35.238 INFO:journalctl@ceph.mon.b.smithi122.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout: legacy client fscid: -1 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout: 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout: No filesystems configured 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T17:55:35.239 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi122", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Updating smithi122:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Updating smithi122:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Updating smithi122:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:55:35.240 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi143", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Deploying cephadm binary to smithi143 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Added host smithi143 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.241 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi143", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Updating smithi143:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Updating smithi143:/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:55:35.242 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Updating smithi143:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2940019622' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2940019622' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.243 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi027:172.21.15.27=a;smithi122:172.21.15.122=b;smithi143:172.21.15.143=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Saving service mon spec with placement smithi027:172.21.15.27=a;smithi122:172.21.15.122=b;smithi143:172.21.15.143=c;count:3 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Deploying daemon mon.c on smithi143 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/2064754727' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/1898964251' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.a calling monitor election 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:35.244 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.c calling monitor election 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: monmap e2: 2 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0],c=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: fsmap 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:35.245 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mgrmap e13: x(active, since 55s) 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: overall HEALTH_OK 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: Deploying daemon mon.b on smithi122 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/2509487241' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 ceph-mon[35310]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 bash[35291]: 889580ada60ef2b86330a7bc94fe1f20240aa0f0541d1ee81113e27fc0362ecb 2024-09-13T17:55:35.246 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:34 smithi122 systemd[1]: Started Ceph mon.b for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T17:55:40.268 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.266+0000 7fa29d816640 1 -- 172.21.15.143:0/1270773322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa284003530 msgr2=0x7fa2840059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:40.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.266+0000 7fa29d816640 1 --2- 172.21.15.143:0/1270773322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa284003530 0x7fa2840059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa298100d30 tx=0x7fa28802c490 comp rx=0 tx=0).stop 2024-09-13T17:55:40.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.266+0000 7fa29d816640 1 -- 172.21.15.143:0/1270773322 shutdown_connections 2024-09-13T17:55:40.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.266+0000 7fa29d816640 1 --2- 172.21.15.143:0/1270773322 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa284003530 0x7fa2840059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:40.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.266+0000 7fa29d816640 1 -- 172.21.15.143:0/1270773322 >> 172.21.15.143:0/1270773322 conn(0x7fa2980fb5a0 msgr2=0x7fa2980fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:40.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.266+0000 7fa29d816640 1 -- 172.21.15.143:0/1270773322 shutdown_connections 2024-09-13T17:55:40.269 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.266+0000 7fa29d816640 1 -- 172.21.15.143:0/1270773322 wait complete. 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.267+0000 7fa29d816640 1 Processor -- start 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.267+0000 7fa29d816640 1 -- start start 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa29d816640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 0x7fa2981953a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa29d816640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2981958e0 0x7fa298199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa29d816640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29819a220 0x7fa29819a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa29d816640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa298195fb0 con 0x7fa29819a220 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa29d816640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2981a1f90 con 0x7fa2981958e0 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa29d816640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2981a20d0 con 0x7fa284003530 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 0x7fa2981953a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 0x7fa2981953a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:51742/0 (socket says 172.21.15.143:51742) 2024-09-13T17:55:40.273 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa296ffd640 1 -- 172.21.15.143:0/3926004264 learned_addr learned my addr 172.21.15.143:0/3926004264 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa28e7fc640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2981958e0 0x7fa298199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa2977fe640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29819a220 0x7fa29819a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa296ffd640 1 -- 172.21.15.143:0/3926004264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 msgr2=0x7fa2981953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa296ffd640 1 -- 172.21.15.143:0/3926004264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 msgr2=0x7fa2981953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa296ffd640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 0x7fa2981953a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa296ffd640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 0x7fa2981953a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa28e7fc640 1 -- 172.21.15.143:0/3926004264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2981958e0 msgr2=0x7fa298199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa28e7fc640 1 -- 172.21.15.143:0/3926004264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2981958e0 msgr2=0x7fa298199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa28e7fc640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2981958e0 0x7fa298199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa28e7fc640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2981958e0 0x7fa298199ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa2977fe640 1 -- 172.21.15.143:0/3926004264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 msgr2=0x7fa2981953a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa2977fe640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 0x7fa2981953a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa2977fe640 1 -- 172.21.15.143:0/3926004264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2981958e0 msgr2=0x7fa298199ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa2977fe640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2981958e0 0x7fa298199ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:40.274 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.268+0000 7fa2977fe640 1 -- 172.21.15.143:0/3926004264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa288012880 con 0x7fa29819a220 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.269+0000 7fa2977fe640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29819a220 0x7fa29819a6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa29000bd80 tx=0x7fa29000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.269+0000 7fa29c814640 1 -- 172.21.15.143:0/3926004264 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290014440 con 0x7fa29819a220 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.269+0000 7fa29c814640 1 -- 172.21.15.143:0/3926004264 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa290014a80 con 0x7fa29819a220 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.269+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2981a2380 con 0x7fa29819a220 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.269+0000 7fa29c814640 1 -- 172.21.15.143:0/3926004264 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa290012a90 con 0x7fa29819a220 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.269+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2981a2800 con 0x7fa29819a220 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.270+0000 7fa29c814640 1 -- 172.21.15.143:0/3926004264 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fa290012cf0 con 0x7fa29819a220 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.270+0000 7fa29c814640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa278038be0 0x7fa27803b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.270+0000 7fa29c814640 1 -- 172.21.15.143:0/3926004264 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa29004c090 con 0x7fa29819a220 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.270+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa298100fe0 con 0x7fa29819a220 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.270+0000 7fa296ffd640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa278038be0 0x7fa27803b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:40.275 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.271+0000 7fa296ffd640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa278038be0 0x7fa27803b0a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa28802ca00 tx=0x7fa28802c990 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:40.277 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.275+0000 7fa29c814640 1 -- 172.21.15.143:0/3926004264 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa290011d00 con 0x7fa29819a220 2024-09-13T17:55:40.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:55:40.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: mon.c calling monitor election 2024-09-13T17:55:40.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: mon.a calling monitor election 2024-09-13T17:55:40.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:40.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:40.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: monmap e3: 3 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: fsmap 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: mgrmap e13: x(active, since 64s) 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: mon.b (rank 2) addr [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] is down (out of quorum) 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:40.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:40.309 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:40.309 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:40.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: mon.c calling monitor election 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: mon.a calling monitor election 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:55:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: monmap e3: 3 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: fsmap 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: mgrmap e13: x(active, since 64s) 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: mon.b (rank 2) addr [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] is down (out of quorum) 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:40.542 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.540+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa298196760 con 0x7fa29819a220 2024-09-13T17:55:40.543 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.541+0000 7fa29c814640 1 -- 172.21.15.143:0/3926004264 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7fa2900112a0 con 0x7fa29819a220 2024-09-13T17:55:40.543 INFO:teuthology.orchestra.run.smithi143.stdout: 2024-09-13T17:55:40.543 INFO:teuthology.orchestra.run.smithi143.stdout:{"epoch":3,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","modified":"2024-09-13T17:55:34.972660Z","created":"2024-09-13T17:53:36.559737Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:3300","nonce":0},{"type":"v1","addr":"172.21.15.27:6789","nonce":0}]},"addr":"172.21.15.27:6789/0","public_addr":"172.21.15.27:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:3300","nonce":0},{"type":"v1","addr":"172.21.15.143:6789","nonce":0}]},"addr":"172.21.15.143:6789/0","public_addr":"172.21.15.143:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:3300","nonce":0},{"type":"v1","addr":"172.21.15.122:6789","nonce":0}]},"addr":"172.21.15.122:6789/0","public_addr":"172.21.15.122:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T17:55:40.543 INFO:teuthology.orchestra.run.smithi143.stderr:dumped monmap epoch 3 2024-09-13T17:55:40.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa278038be0 msgr2=0x7fa27803b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:40.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa278038be0 0x7fa27803b0a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa28802ca00 tx=0x7fa28802c990 comp rx=0 tx=0).stop 2024-09-13T17:55:40.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29819a220 msgr2=0x7fa29819a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:40.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29819a220 0x7fa29819a6d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa29000bd80 tx=0x7fa29000be70 comp rx=0 tx=0).stop 2024-09-13T17:55:40.545 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 shutdown_connections 2024-09-13T17:55:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa278038be0 0x7fa27803b0a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa29819a220 0x7fa29819a6d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa2981958e0 0x7fa298199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 --2- 172.21.15.143:0/3926004264 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa284003530 0x7fa2981953a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 >> 172.21.15.143:0/3926004264 conn(0x7fa2980fb5a0 msgr2=0x7fa29818df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 shutdown_connections 2024-09-13T17:55:40.546 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:40.543+0000 7fa29d816640 1 -- 172.21.15.143:0/3926004264 wait complete. 2024-09-13T17:55:41.162 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:41 smithi143 ceph-mon[38210]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:41.163 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:41 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:41.163 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:41 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:41.163 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:41 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/3926004264' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:41.163 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:41 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:41.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:41 smithi027 ceph-mon[30611]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:41.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:41 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:41.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:41 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:41.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:41 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/3926004264' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:41.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:41 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:41.873 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T17:55:41.873 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T17:55:42.200 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:55:42.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:55:42.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: mon.c calling monitor election 2024-09-13T17:55:42.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: mon.a calling monitor election 2024-09-13T17:55:42.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:42.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:55:42.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:42.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: monmap e3: 3 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: fsmap 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: mgrmap e13: x(active, since 64s) 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-09-13T17:55:42.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: mon.b (rank 2) addr [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] is down (out of quorum) 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/3926004264' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T17:55:42.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: mon.b calling monitor election 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: Updating smithi122:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: Updating smithi143:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: Updating smithi027:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: mon.b calling monitor election 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: mon.c calling monitor election 2024-09-13T17:55:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: mon.a calling monitor election 2024-09-13T17:55:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T17:55:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: monmap e3: 3 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:55:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: fsmap 2024-09-13T17:55:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: mgrmap e13: x(active, since 66s) 2024-09-13T17:55:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T17:55:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: Cluster is now healthy 2024-09-13T17:55:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: overall HEALTH_OK 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:55:43.216 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: mon.b calling monitor election 2024-09-13T17:55:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-13T17:55:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T17:55:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-13T17:55:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: Updating smithi122:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: Updating smithi143:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: Updating smithi027:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: mon.b calling monitor election 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: mon.c calling monitor election 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: mon.a calling monitor election 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: monmap e3: 3 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: fsmap 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: mgrmap e13: x(active, since 66s) 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: Cluster is now healthy 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: overall HEALTH_OK 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: mon.b calling monitor election 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: Updating smithi027:/etc/ceph/ceph.conf 2024-09-13T17:55:43.278 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: Updating smithi122:/etc/ceph/ceph.conf 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: Updating smithi143:/etc/ceph/ceph.conf 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: Updating smithi122:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: Updating smithi143:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: Updating smithi027:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: mon.b calling monitor election 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: mon.c calling monitor election 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: mon.a calling monitor election 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: monmap e3: 3 mons at {a=[v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0],b=[v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0],c=[v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: fsmap 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: mgrmap e13: x(active, since 66s) 2024-09-13T17:55:43.279 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: Cluster is now healthy 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: overall HEALTH_OK 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:55:43.280 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:44.187 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:43 smithi027 ceph-mon[30611]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T17:55:44.187 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:43 smithi027 ceph-mon[30611]: Reconfiguring daemon mon.a on smithi027 2024-09-13T17:55:44.187 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:44.187 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 17:55:43 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T17:55:43.971+0000 7f4ec7a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T17:55:44.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:43 smithi122 ceph-mon[35310]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T17:55:44.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:43 smithi122 ceph-mon[35310]: Reconfiguring daemon mon.a on smithi027 2024-09-13T17:55:44.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:44.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:43 smithi143 ceph-mon[38210]: Reconfiguring mon.a (unknown last config time)... 2024-09-13T17:55:44.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:43 smithi143 ceph-mon[38210]: Reconfiguring daemon mon.a on smithi027 2024-09-13T17:55:44.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:55:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.761+0000 7fc2fbc00640 1 -- 172.21.15.27:0/3191762843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 msgr2=0x7fc2f4072ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.761+0000 7fc2fbc00640 1 --2- 172.21.15.27:0/3191762843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 0x7fc2f4072ac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009880 tx=0x7fc2e802a670 comp rx=0 tx=0).stop 2024-09-13T17:55:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.761+0000 7fc2fbc00640 1 -- 172.21.15.27:0/3191762843 shutdown_connections 2024-09-13T17:55:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.761+0000 7fc2fbc00640 1 --2- 172.21.15.27:0/3191762843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 0x7fc2f4072ac0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.761+0000 7fc2fbc00640 1 -- 172.21.15.27:0/3191762843 >> 172.21.15.27:0/3191762843 conn(0x7fc2f4076500 msgr2=0x7fc2f4076910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.761+0000 7fc2fbc00640 1 -- 172.21.15.27:0/3191762843 shutdown_connections 2024-09-13T17:55:44.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.762+0000 7fc2fbc00640 1 -- 172.21.15.27:0/3191762843 wait complete. 2024-09-13T17:55:44.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.763+0000 7fc2fbc00640 1 Processor -- start 2024-09-13T17:55:44.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.763+0000 7fc2fbc00640 1 -- start start 2024-09-13T17:55:44.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.763+0000 7fc2fbc00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 0x7fc2f4197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:44.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.763+0000 7fc2fbc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4197970 0x7fc2f419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:44.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.763+0000 7fc2fbc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f419c2b0 0x7fc2f419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:44.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.763+0000 7fc2fbc00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4198040 con 0x7fc2f40726e0 2024-09-13T17:55:44.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.763+0000 7fc2fbc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41a4020 con 0x7fc2f4197970 2024-09-13T17:55:44.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.763+0000 7fc2fbc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41a4160 con 0x7fc2f419c2b0 2024-09-13T17:55:44.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f9200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 0x7fc2f4197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:44.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f9200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 0x7fc2f4197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51440/0 (socket says 172.21.15.27:51440) 2024-09-13T17:55:44.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f9200640 1 -- 172.21.15.27:0/129893997 learned_addr learned my addr 172.21.15.27:0/129893997 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:55:44.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f9c00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f419c2b0 0x7fc2f419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:44.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f3e00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4197970 0x7fc2f419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:44.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f9200640 1 -- 172.21.15.27:0/129893997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f419c2b0 msgr2=0x7fc2f419c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:44.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f9200640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f419c2b0 0x7fc2f419c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:44.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f9200640 1 -- 172.21.15.27:0/129893997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4197970 msgr2=0x7fc2f419bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:44.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f9200640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4197970 0x7fc2f419bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:44.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f9200640 1 -- 172.21.15.27:0/129893997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8009560 con 0x7fc2f40726e0 2024-09-13T17:55:44.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.764+0000 7fc2f3e00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4197970 0x7fc2f419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T17:55:44.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.765+0000 7fc2f9200640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 0x7fc2f4197430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009230 tx=0x7fc2e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:44.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.765+0000 7fc2f1600640 1 -- 172.21.15.27:0/129893997 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8004d80 con 0x7fc2f40726e0 2024-09-13T17:55:44.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.765+0000 7fc2f1600640 1 -- 172.21.15.27:0/129893997 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc2e80319b0 con 0x7fc2f40726e0 2024-09-13T17:55:44.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.765+0000 7fc2f1600640 1 -- 172.21.15.27:0/129893997 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8003c00 con 0x7fc2f40726e0 2024-09-13T17:55:44.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.765+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f41a4410 con 0x7fc2f40726e0 2024-09-13T17:55:44.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.765+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f41a48e0 con 0x7fc2f40726e0 2024-09-13T17:55:44.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.766+0000 7fc2f1600640 1 -- 172.21.15.27:0/129893997 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fc2e8003d60 con 0x7fc2f40726e0 2024-09-13T17:55:44.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.766+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f4073c00 con 0x7fc2f40726e0 2024-09-13T17:55:44.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.767+0000 7fc2f1600640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2dc038be0 0x7fc2dc03b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:44.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.767+0000 7fc2f1600640 1 -- 172.21.15.27:0/129893997 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc2e806c500 con 0x7fc2f40726e0 2024-09-13T17:55:44.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.767+0000 7fc2f3e00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2dc038be0 0x7fc2dc03b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:44.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.768+0000 7fc2f3e00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2dc038be0 0x7fc2dc03b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009890 tx=0x7fc2e0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:44.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.773+0000 7fc2f1600640 1 -- 172.21.15.27:0/129893997 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc2e803c470 con 0x7fc2f40726e0 2024-09-13T17:55:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.960+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc2f410be10 con 0x7fc2f40726e0 2024-09-13T17:55:44.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.960+0000 7fc2f1600640 1 -- 172.21.15.27:0/129893997 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7fc2e8035070 con 0x7fc2f40726e0 2024-09-13T17:55:44.965 INFO:teuthology.orchestra.run.smithi027.stdout:# minimal ceph.conf for f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:55:44.965 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2024-09-13T17:55:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T17:55:44.965 INFO:teuthology.orchestra.run.smithi027.stdout: mon_host = [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] 2024-09-13T17:55:44.965 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2dc038be0 msgr2=0x7fc2dc03b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:44.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2dc038be0 0x7fc2dc03b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009890 tx=0x7fc2e0008040 comp rx=0 tx=0).stop 2024-09-13T17:55:44.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 msgr2=0x7fc2f4197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:44.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 0x7fc2f4197430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009230 tx=0x7fc2e80046c0 comp rx=0 tx=0).stop 2024-09-13T17:55:44.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 shutdown_connections 2024-09-13T17:55:44.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2dc038be0 0x7fc2dc03b0a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:44.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc2f419c2b0 0x7fc2f419c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:44.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc2f4197970 0x7fc2f419bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 --2- 172.21.15.27:0/129893997 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc2f40726e0 0x7fc2f4197430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 >> 172.21.15.27:0/129893997 conn(0x7fc2f4076500 msgr2=0x7fc2f4103ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 shutdown_connections 2024-09-13T17:55:44.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:44.963+0000 7fc2fbc00640 1 -- 172.21.15.27:0/129893997 wait complete. 2024-09-13T17:55:45.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:44 smithi122 ceph-mon[35310]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:45.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:44 smithi143 ceph-mon[38210]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:45.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:44 smithi027 ceph-mon[30611]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:45.978 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T17:55:45.978 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:55:45.978 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T17:55:46.038 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:55:46.038 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:55:46.126 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:45 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/129893997' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:46.126 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:45 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:46.126 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:45 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:46.126 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:45 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:46.126 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:45 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:55:46.126 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:45 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:46.134 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:55:46.134 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T17:55:46.158 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:45 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/129893997' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:46.158 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:45 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:46.159 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:45 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:46.159 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:45 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:46.159 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:45 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:55:46.159 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:45 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:46.163 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:55:46.163 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:55:46.229 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:55:46.229 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T17:55:46.256 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:45 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/129893997' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:46.256 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:45 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:46.257 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:45 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:46.257 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:45 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:46.257 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:45 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:55:46.257 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:45 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:46.261 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:55:46.262 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T17:55:46.330 INFO:tasks.cephadm:Adding mgr.x on smithi027 2024-09-13T17:55:46.331 INFO:tasks.cephadm:Adding mgr.y on smithi122 2024-09-13T17:55:46.331 INFO:tasks.cephadm:Adding mgr.z on smithi143 2024-09-13T17:55:46.331 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi027=x;smithi122=y;smithi143=z' 2024-09-13T17:55:46.564 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:55:47.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:46 smithi122 ceph-mon[35310]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:46 smithi122 ceph-mon[35310]: Reconfiguring mon.b (monmap changed)... 2024-09-13T17:55:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:46 smithi122 ceph-mon[35310]: Reconfiguring daemon mon.b on smithi122 2024-09-13T17:55:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:55:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:47.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:46 smithi143 ceph-mon[38210]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:46 smithi143 ceph-mon[38210]: Reconfiguring mon.b (monmap changed)... 2024-09-13T17:55:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:46 smithi143 ceph-mon[38210]: Reconfiguring daemon mon.b on smithi122 2024-09-13T17:55:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:55:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:47.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:46 smithi027 ceph-mon[30611]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:47.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:46 smithi027 ceph-mon[30611]: Reconfiguring mon.b (monmap changed)... 2024-09-13T17:55:47.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:46 smithi027 ceph-mon[30611]: Reconfiguring daemon mon.b on smithi122 2024-09-13T17:55:47.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:47.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:47.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T17:55:47.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T17:55:47.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:48.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:47 smithi122 ceph-mon[35310]: Reconfiguring mon.c (monmap changed)... 2024-09-13T17:55:48.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:47 smithi122 ceph-mon[35310]: Reconfiguring daemon mon.c on smithi143 2024-09-13T17:55:48.243 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:47 smithi143 ceph-mon[38210]: Reconfiguring mon.c (monmap changed)... 2024-09-13T17:55:48.243 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:47 smithi143 ceph-mon[38210]: Reconfiguring daemon mon.c on smithi143 2024-09-13T17:55:48.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:47 smithi027 ceph-mon[30611]: Reconfiguring mon.c (monmap changed)... 2024-09-13T17:55:48.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:47 smithi027 ceph-mon[30611]: Reconfiguring daemon mon.c on smithi143 2024-09-13T17:55:48.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.610+0000 7fe52a8a9640 1 -- 172.21.15.143:0/1607726581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5240ff8f0 msgr2=0x7fe5240ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:48.612 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.610+0000 7fe52a8a9640 1 --2- 172.21.15.143:0/1607726581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5240ff8f0 0x7fe5240ffcf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe514009880 tx=0x7fe51402a5d0 comp rx=0 tx=0).stop 2024-09-13T17:55:48.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.610+0000 7fe52a8a9640 1 -- 172.21.15.143:0/1607726581 shutdown_connections 2024-09-13T17:55:48.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.610+0000 7fe52a8a9640 1 --2- 172.21.15.143:0/1607726581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5240ff8f0 0x7fe5240ffcf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:48.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.610+0000 7fe52a8a9640 1 -- 172.21.15.143:0/1607726581 >> 172.21.15.143:0/1607726581 conn(0x7fe5240fb080 msgr2=0x7fe5240fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:48.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.610+0000 7fe52a8a9640 1 -- 172.21.15.143:0/1607726581 shutdown_connections 2024-09-13T17:55:48.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.610+0000 7fe52a8a9640 1 -- 172.21.15.143:0/1607726581 wait complete. 2024-09-13T17:55:48.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe52a8a9640 1 Processor -- start 2024-09-13T17:55:48.613 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe52a8a9640 1 -- start start 2024-09-13T17:55:48.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe52a8a9640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5240ff8f0 0x7fe524195000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:48.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe52a8a9640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe524195540 0x7fe52419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:48.615 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe52a8a9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5241959c0 0x7fe52419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe52a8a9640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52419d2d0 con 0x7fe5240ff8f0 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe52a8a9640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52419d440 con 0x7fe5241959c0 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe52a8a9640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52419d600 con 0x7fe524195540 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe51bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe524195540 0x7fe52419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe51bfff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe524195540 0x7fe52419a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:35784/0 (socket says 172.21.15.143:35784) 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe51bfff640 1 -- 172.21.15.143:0/457505293 learned_addr learned my addr 172.21.15.143:0/457505293 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe528e46640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5241959c0 0x7fe52419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.611+0000 7fe523fff640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5240ff8f0 0x7fe524195000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe51bfff640 1 -- 172.21.15.143:0/457505293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5241959c0 msgr2=0x7fe52419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe51bfff640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5241959c0 0x7fe52419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe51bfff640 1 -- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5240ff8f0 msgr2=0x7fe524195000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe51bfff640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5240ff8f0 0x7fe524195000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:48.616 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe51bfff640 1 -- 172.21.15.143:0/457505293 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe514009560 con 0x7fe524195540 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe51bfff640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe524195540 0x7fe52419a5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00b520 tx=0x7fe50c00b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe521ffb640 1 -- 172.21.15.143:0/457505293 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c004230 con 0x7fe524195540 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe521ffb640 1 -- 172.21.15.143:0/457505293 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe50c004390 con 0x7fe524195540 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe524072740 con 0x7fe524195540 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe521ffb640 1 -- 172.21.15.143:0/457505293 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c003cd0 con 0x7fe524195540 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.612+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe524072cc0 con 0x7fe524195540 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.613+0000 7fe521ffb640 1 -- 172.21.15.143:0/457505293 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fe50c00f3e0 con 0x7fe524195540 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.613+0000 7fe521ffb640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe510038b90 0x7fe51003b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.613+0000 7fe521ffb640 1 -- 172.21.15.143:0/457505293 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe50c04acc0 con 0x7fe524195540 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.613+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52418e6f0 con 0x7fe524195540 2024-09-13T17:55:48.617 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.614+0000 7fe523fff640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe510038b90 0x7fe51003b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:48.618 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.614+0000 7fe523fff640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe510038b90 0x7fe51003b050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe514000c00 tx=0x7fe514031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:48.620 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.618+0000 7fe521ffb640 1 -- 172.21.15.143:0/457505293 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe50c0168f0 con 0x7fe524195540 2024-09-13T17:55:48.801 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.798+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi027=x;smithi122=y;smithi143=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5240608f0 con 0x7fe510038b90 2024-09-13T17:55:48.807 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.805+0000 7fe521ffb640 1 -- 172.21.15.143:0/457505293 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fe5240608f0 con 0x7fe510038b90 2024-09-13T17:55:48.807 INFO:teuthology.orchestra.run.smithi143.stdout:Scheduled mgr update... 2024-09-13T17:55:48.809 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe510038b90 msgr2=0x7fe51003b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe510038b90 0x7fe51003b050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe514000c00 tx=0x7fe514031400 comp rx=0 tx=0).stop 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe524195540 msgr2=0x7fe52419a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe524195540 0x7fe52419a5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe50c00b520 tx=0x7fe50c00b9e0 comp rx=0 tx=0).stop 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 shutdown_connections 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe510038b90 0x7fe51003b050 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe5241959c0 0x7fe52419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe524195540 0x7fe52419a5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 --2- 172.21.15.143:0/457505293 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe5240ff8f0 0x7fe524195000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 >> 172.21.15.143:0/457505293 conn(0x7fe5240fb080 msgr2=0x7fe5240fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 shutdown_connections 2024-09-13T17:55:48.810 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:55:48.808+0000 7fe52a8a9640 1 -- 172.21.15.143:0/457505293 wait complete. 2024-09-13T17:55:49.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:48 smithi122 ceph-mon[35310]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:49.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:48 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:49.246 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:48 smithi143 ceph-mon[38210]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:49.246 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:48 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:49.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:48 smithi027 ceph-mon[30611]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:48 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:49.599 DEBUG:teuthology.orchestra.run.smithi122:mgr.y> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.y.service 2024-09-13T17:55:49.601 DEBUG:teuthology.orchestra.run.smithi143:mgr.z> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.z.service 2024-09-13T17:55:49.603 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T17:55:49.604 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T17:55:49.604 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:55:49.645 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:55:49.645 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_1 2024-09-13T17:55:49.724 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:55:49.724 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:49.724 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-09-13T17:55:49.724 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:49.725 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:49.725 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-13 17:54:50.377435186 +0000 2024-09-13T17:55:49.725 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-13 17:50:10.227980918 +0000 2024-09-13T17:55:49.725 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-13 17:50:10.227980918 +0000 2024-09-13T17:55:49.725 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-13 17:50:10.227980918 +0000 2024-09-13T17:55:49.725 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:55:49.822 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-13T17:55:49.822 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-13T17:55:49.822 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000295613 s, 1.7 MB/s 2024-09-13T17:55:49.824 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:55:49.863 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_2 2024-09-13T17:55:49.940 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:55:49.940 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:49.940 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-09-13T17:55:49.940 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:49.940 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:49.940 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-13 17:54:50.425433942 +0000 2024-09-13T17:55:49.940 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-13 17:50:10.707968424 +0000 2024-09-13T17:55:49.941 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-13 17:50:10.707968424 +0000 2024-09-13T17:55:49.941 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-13 17:50:10.707968424 +0000 2024-09-13T17:55:49.941 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:55:50.035 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-13T17:55:50.035 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-13T17:55:50.035 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.00027742 s, 1.8 MB/s 2024-09-13T17:55:50.037 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:55:50.076 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_3 2024-09-13T17:55:50.152 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:55:50.153 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:50.153 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 677 Links: 1 2024-09-13T17:55:50.153 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:50.153 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:50.153 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-13 17:54:50.472432723 +0000 2024-09-13T17:55:50.153 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-13 17:50:11.196955698 +0000 2024-09-13T17:55:50.153 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-13 17:50:11.196955698 +0000 2024-09-13T17:55:50.153 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-13 17:50:11.196955698 +0000 2024-09-13T17:55:50.153 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi027=x;smithi122=y;smithi143=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: Saving service mgr spec with placement smithi027=x;smithi122=y;smithi143=z;count:3 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:55:50.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:55:50.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:55:50.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:50.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:50 smithi122 ceph-mon[35310]: Deploying daemon mgr.z on smithi143 2024-09-13T17:55:50.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi027=x;smithi122=y;smithi143=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:55:50.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: Saving service mgr spec with placement smithi027=x;smithi122=y;smithi143=z;count:3 2024-09-13T17:55:50.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:50.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:50.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:50.241 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:50.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:50.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:50.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:55:50.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:55:50.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:55:50.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:50.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:50 smithi027 ceph-mon[30611]: Deploying daemon mgr.z on smithi143 2024-09-13T17:55:50.246 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-13T17:55:50.246 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-13T17:55:50.246 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.00026102 s, 2.0 MB/s 2024-09-13T17:55:50.249 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:55:50.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi027=x;smithi122=y;smithi143=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: Saving service mgr spec with placement smithi027=x;smithi122=y;smithi143=z;count:3 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:55:50.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:50.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:50 smithi143 ceph-mon[38210]: Deploying daemon mgr.z on smithi143 2024-09-13T17:55:50.287 DEBUG:teuthology.orchestra.run.smithi027:> stat /dev/vg_nvme/lv_4 2024-09-13T17:55:50.363 INFO:teuthology.orchestra.run.smithi027.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:55:50.364 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:50.364 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 6h/6d Inode: 697 Links: 1 2024-09-13T17:55:50.364 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:50.364 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:50.364 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-13 17:54:50.518431531 +0000 2024-09-13T17:55:50.364 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-13 17:50:11.693942764 +0000 2024-09-13T17:55:50.364 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-13 17:50:11.693942764 +0000 2024-09-13T17:55:50.364 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-13 17:50:11.693942764 +0000 2024-09-13T17:55:50.364 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:55:50.458 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records in 2024-09-13T17:55:50.458 INFO:teuthology.orchestra.run.smithi027.stderr:1+0 records out 2024-09-13T17:55:50.458 INFO:teuthology.orchestra.run.smithi027.stderr:512 bytes copied, 0.000314849 s, 1.6 MB/s 2024-09-13T17:55:50.461 DEBUG:teuthology.orchestra.run.smithi027:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:55:50.498 DEBUG:teuthology.orchestra.run.smithi122:> set -ex 2024-09-13T17:55:50.498 DEBUG:teuthology.orchestra.run.smithi122:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:55:50.515 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:55:50.515 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_1 2024-09-13T17:55:50.570 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:55:50.570 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:50.570 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-13T17:55:50.570 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:50.571 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:50.571 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-13 17:55:34.303103923 +0000 2024-09-13T17:55:50.571 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-13 17:49:27.453096411 +0000 2024-09-13T17:55:50.571 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-13 17:49:27.453096411 +0000 2024-09-13T17:55:50.571 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-13 17:49:27.453096411 +0000 2024-09-13T17:55:50.571 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:55:50.635 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-13T17:55:50.635 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-13T17:55:50.635 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000191743 s, 2.7 MB/s 2024-09-13T17:55:50.636 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:55:50.693 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_2 2024-09-13T17:55:50.748 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:55:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:50.749 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-13T17:55:50.749 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:50.749 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:50.749 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-13 17:55:34.303103923 +0000 2024-09-13T17:55:50.749 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-13 17:49:27.782088468 +0000 2024-09-13T17:55:50.749 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-13 17:49:27.782088468 +0000 2024-09-13T17:55:50.749 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-13 17:49:27.782088468 +0000 2024-09-13T17:55:50.749 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:55:50.812 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-13T17:55:50.812 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-13T17:55:50.813 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000218127 s, 2.3 MB/s 2024-09-13T17:55:50.813 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:55:50.870 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_3 2024-09-13T17:55:50.926 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:55:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:50.927 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-13T17:55:50.927 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:50.927 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:50.927 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-13 17:55:34.304103899 +0000 2024-09-13T17:55:50.927 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-13 17:49:28.103080719 +0000 2024-09-13T17:55:50.927 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-13 17:49:28.103080719 +0000 2024-09-13T17:55:50.927 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-13 17:49:28.103080719 +0000 2024-09-13T17:55:50.927 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:55:50.990 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-13T17:55:50.990 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-13T17:55:50.990 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000202319 s, 2.5 MB/s 2024-09-13T17:55:50.991 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:55:51.048 DEBUG:teuthology.orchestra.run.smithi122:> stat /dev/vg_nvme/lv_4 2024-09-13T17:55:51.104 INFO:teuthology.orchestra.run.smithi122.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:55:51.104 INFO:teuthology.orchestra.run.smithi122.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:51.104 INFO:teuthology.orchestra.run.smithi122.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-13T17:55:51.105 INFO:teuthology.orchestra.run.smithi122.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:51.105 INFO:teuthology.orchestra.run.smithi122.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:51.105 INFO:teuthology.orchestra.run.smithi122.stdout:Access: 2024-09-13 17:55:34.304103899 +0000 2024-09-13T17:55:51.105 INFO:teuthology.orchestra.run.smithi122.stdout:Modify: 2024-09-13 17:49:28.433072752 +0000 2024-09-13T17:55:51.105 INFO:teuthology.orchestra.run.smithi122.stdout:Change: 2024-09-13 17:49:28.433072752 +0000 2024-09-13T17:55:51.105 INFO:teuthology.orchestra.run.smithi122.stdout: Birth: 2024-09-13 17:49:28.433072752 +0000 2024-09-13T17:55:51.105 DEBUG:teuthology.orchestra.run.smithi122:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:55:51.168 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records in 2024-09-13T17:55:51.168 INFO:teuthology.orchestra.run.smithi122.stderr:1+0 records out 2024-09-13T17:55:51.168 INFO:teuthology.orchestra.run.smithi122.stderr:512 bytes copied, 0.000235938 s, 2.2 MB/s 2024-09-13T17:55:51.169 DEBUG:teuthology.orchestra.run.smithi122:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:55:51.226 DEBUG:teuthology.orchestra.run.smithi143:> set -ex 2024-09-13T17:55:51.226 DEBUG:teuthology.orchestra.run.smithi143:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T17:55:51.243 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T17:55:51.243 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_1 2024-09-13T17:55:51.249 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:51 smithi143 ceph-mon[38210]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T17:55:51.264 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:51.264 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-13T17:55:51.264 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:51.265 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:51.265 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-13 17:55:51.002282840 +0000 2024-09-13T17:55:51.265 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-13 17:49:39.006510363 +0000 2024-09-13T17:55:51.265 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-13 17:49:39.006510363 +0000 2024-09-13T17:55:51.265 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-13 17:49:39.006510363 +0000 2024-09-13T17:55:51.265 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T17:55:51.330 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-13T17:55:51.330 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-13T17:55:51.330 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000270624 s, 1.9 MB/s 2024-09-13T17:55:51.331 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T17:55:51.388 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_2 2024-09-13T17:55:51.453 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T17:55:51.454 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:51.454 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-13T17:55:51.454 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:51.454 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:51.454 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-13 17:55:51.002282840 +0000 2024-09-13T17:55:51.454 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-13 17:49:39.345500979 +0000 2024-09-13T17:55:51.454 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-13 17:49:39.345500979 +0000 2024-09-13T17:55:51.454 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-13 17:49:39.345500979 +0000 2024-09-13T17:55:51.454 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T17:55:51.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:51 smithi122 ceph-mon[35310]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:51.512 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:51 smithi143 podman[39812]: 2024-09-13 17:55:51.486897206 +0000 UTC m=+0.329376611 container start 6dbea186e507364bdcd4827cd9221fefae5b6ca9c0f41b4e9939db78ff044979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, ceph=True) 2024-09-13T17:55:51.512 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:51 smithi143 ceph-mgr[39916]: -- 172.21.15.143:0/2898807515 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e64b468d00 con 0x55e64b43d000 2024-09-13T17:55:51.519 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-13T17:55:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-13T17:55:51.520 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000179085 s, 2.9 MB/s 2024-09-13T17:55:51.521 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T17:55:51.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:51 smithi027 ceph-mon[30611]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:51.576 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_3 2024-09-13T17:55:51.633 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T17:55:51.633 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:51.633 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T17:55:51.633 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:51.634 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:51.634 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-13 17:55:51.002282840 +0000 2024-09-13T17:55:51.634 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-13 17:49:39.684491596 +0000 2024-09-13T17:55:51.634 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-13 17:49:39.684491596 +0000 2024-09-13T17:55:51.634 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-13 17:49:39.684491596 +0000 2024-09-13T17:55:51.635 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T17:55:51.697 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-13T17:55:51.698 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-13T17:55:51.698 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.00018339 s, 2.8 MB/s 2024-09-13T17:55:51.699 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T17:55:51.757 DEBUG:teuthology.orchestra.run.smithi143:> stat /dev/vg_nvme/lv_4 2024-09-13T17:55:51.775 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:51 smithi143 bash[39812]: 6dbea186e507364bdcd4827cd9221fefae5b6ca9c0f41b4e9939db78ff044979 2024-09-13T17:55:51.776 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:51 smithi143 systemd[1]: Started Ceph mgr.z for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T17:55:51.776 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:51.606+0000 7f0f285ce040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:55:51.776 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:51.667+0000 7f0f285ce040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:55:51.791 INFO:teuthology.orchestra.run.smithi143.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T17:55:51.791 INFO:teuthology.orchestra.run.smithi143.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T17:55:51.791 INFO:teuthology.orchestra.run.smithi143.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-13T17:55:51.791 INFO:teuthology.orchestra.run.smithi143.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T17:55:51.791 INFO:teuthology.orchestra.run.smithi143.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T17:55:51.791 INFO:teuthology.orchestra.run.smithi143.stdout:Access: 2024-09-13 17:55:51.002282840 +0000 2024-09-13T17:55:51.791 INFO:teuthology.orchestra.run.smithi143.stdout:Modify: 2024-09-13 17:49:39.993483042 +0000 2024-09-13T17:55:51.791 INFO:teuthology.orchestra.run.smithi143.stdout:Change: 2024-09-13 17:49:39.993483042 +0000 2024-09-13T17:55:51.791 INFO:teuthology.orchestra.run.smithi143.stdout: Birth: 2024-09-13 17:49:39.993483042 +0000 2024-09-13T17:55:51.792 DEBUG:teuthology.orchestra.run.smithi143:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T17:55:51.855 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records in 2024-09-13T17:55:51.855 INFO:teuthology.orchestra.run.smithi143.stderr:1+0 records out 2024-09-13T17:55:51.855 INFO:teuthology.orchestra.run.smithi143.stderr:512 bytes copied, 0.000243566 s, 2.1 MB/s 2024-09-13T17:55:51.856 DEBUG:teuthology.orchestra.run.smithi143:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T17:55:51.913 INFO:tasks.cephadm:Deploying osd.0 on smithi027 with /dev/vg_nvme/lv_4... 2024-09-13T17:55:51.913 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T17:55:52.178 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:51.821+0000 7f0f285ce040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:55:52.178 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:51.889+0000 7f0f285ce040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:55:52.178 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:52.036+0000 7f0f285ce040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:55:52.179 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:52.176+0000 7f0f285ce040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:55:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:55:52.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-mon[38210]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:52.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-mon[38210]: Deploying daemon mgr.y on smithi122 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:52.481+0000 7f0f285ce040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:52.541+0000 7f0f285ce040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:55:52.776 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:52 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:52.722+0000 7f0f285ce040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:55:52.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:52 smithi122 ceph-mon[35310]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:52.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:52 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:52.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:52 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:52.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:52 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:52.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:52 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:55:52.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:52 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:55:52.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:52 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:55:52.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:52 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:52.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:52 smithi122 ceph-mon[35310]: Deploying daemon mgr.y on smithi122 2024-09-13T17:55:53.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:52 smithi027 ceph-mon[30611]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:53.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:52 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:53.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:52 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:53.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:52 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:53.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:52 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:55:53.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:52 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T17:55:53.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:52 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:55:53.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:52 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:53.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:52 smithi027 ceph-mon[30611]: Deploying daemon mgr.y on smithi122 2024-09-13T17:55:53.661 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:53 smithi122 systemd[1]: Starting Ceph mgr.y for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T17:55:53.916 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:53 smithi122 podman[36676]: 2024-09-13 17:55:53.561976522 +0000 UTC m=+0.015526036 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T17:55:53.916 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:53 smithi122 podman[36676]: 2024-09-13 17:55:53.697506268 +0000 UTC m=+0.151055811 container create b2981fac8317f45daa729bee9cd618c517ea0c7c9cb7b62d7c88d1e3a43efd3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T17:55:53.917 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:53 smithi122 podman[36676]: 2024-09-13 17:55:53.91499092 +0000 UTC m=+0.368540421 container init b2981fac8317f45daa729bee9cd618c517ea0c7c9cb7b62d7c88d1e3a43efd3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T17:55:54.025 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:53 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:53.584+0000 7f0f285ce040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:55:54.025 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:53 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:53.648+0000 7f0f285ce040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:55:54.214 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:53 smithi122 podman[36676]: 2024-09-13 17:55:53.917853436 +0000 UTC m=+0.371402946 container start b2981fac8317f45daa729bee9cd618c517ea0c7c9cb7b62d7c88d1e3a43efd3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T17:55:54.214 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:53 smithi122 ceph-mgr[36695]: -- 172.21.15.122:0/350719403 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56493f146d00 con 0x56493f11b000 2024-09-13T17:55:54.214 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:53 smithi122 bash[36676]: b2981fac8317f45daa729bee9cd618c517ea0c7c9cb7b62d7c88d1e3a43efd3b 2024-09-13T17:55:54.214 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:54 smithi122 systemd[1]: Started Ceph mgr.y for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T17:55:54.214 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:54.044+0000 7f27d7b79040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T17:55:54.214 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:54.102+0000 7f27d7b79040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T17:55:54.341 INFO:teuthology.orchestra.run.smithi027.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T17:55:54.474 INFO:teuthology.orchestra.run.smithi027.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T17:55:54.508 INFO:teuthology.orchestra.run.smithi027.stderr: stderr: 10+0 records in 2024-09-13T17:55:54.508 INFO:teuthology.orchestra.run.smithi027.stderr:10+0 records out 2024-09-13T17:55:54.508 INFO:teuthology.orchestra.run.smithi027.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0273358 s, 384 MB/s 2024-09-13T17:55:54.509 INFO:teuthology.orchestra.run.smithi027.stderr:--> Zapping successful for: 2024-09-13T17:55:54.634 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:54.254+0000 7f27d7b79040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T17:55:54.634 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:54.323+0000 7f27d7b79040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T17:55:54.634 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:54.482+0000 7f27d7b79040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:55:54.634 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:54.632+0000 7f27d7b79040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T17:55:54.650 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:54.371+0000 7f0f285ce040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:55:54.650 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:54.499+0000 7f0f285ce040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:55:54.650 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:54.647+0000 7f0f285ce040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:55:54.933 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:54.708+0000 7f0f285ce040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:55:54.934 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:54.863+0000 7f0f285ce040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:55:54.934 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:54.931+0000 7f0f285ce040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:55:55.202 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:54.950+0000 7f27d7b79040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T17:55:55.203 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:55 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:55.010+0000 7f27d7b79040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T17:55:55.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:55 smithi122 ceph-mon[35310]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:55.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.203 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:55.223 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-mon[38210]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:55.223 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.223 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.223 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.223 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.223 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:55.224 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:54.991+0000 7f0f285ce040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:55:55.224 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:55.156+0000 7f0f285ce040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:55:55.224 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:55.221+0000 7f0f285ce040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:55:55.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:55 smithi027 ceph-mon[30611]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:55.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.224 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:55.225 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:55.255 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi027:vg_nvme/lv_4 2024-09-13T17:55:55.463 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:55 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:55.200+0000 7f27d7b79040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T17:55:55.492 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:55.289+0000 7f0f285ce040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:55:55.492 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:55.373+0000 7f0f285ce040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:55:55.492 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:55.431+0000 7f0f285ce040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:55:55.492 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:55.489+0000 7f0f285ce040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:55:55.586 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:55:56.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:56.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.464 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:56.066+0000 7f27d7b79040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T17:55:56.464 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:56.132+0000 7f27d7b79040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T17:55:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:55:56.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:55:56.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:56.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.525 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z[39879]: 2024-09-13T17:55:56.261+0000 7f0f285ce040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:55:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T17:55:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T17:55:56.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:56.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:57.093 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:56.840+0000 7f27d7b79040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T17:55:57.094 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:56 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:56.952+0000 7f27d7b79040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T17:55:57.094 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.091+0000 7f27d7b79040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T17:55:57.363 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.151+0000 7f27d7b79040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T17:55:57.363 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.295+0000 7f27d7b79040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T17:55:57.364 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.361+0000 7f27d7b79040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T17:55:57.364 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-mon[35310]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T17:55:57.364 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-mon[35310]: Reconfiguring daemon mgr.x on smithi027 2024-09-13T17:55:57.364 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-mon[35310]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:57.364 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-mon[35310]: Standby manager daemon z started 2024-09-13T17:55:57.364 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-mon[35310]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T17:55:57.364 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-mon[35310]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:55:57.364 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-mon[35310]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T17:55:57.364 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-mon[35310]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:55:57.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:57 smithi027 ceph-mon[30611]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T17:55:57.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:57 smithi027 ceph-mon[30611]: Reconfiguring daemon mgr.x on smithi027 2024-09-13T17:55:57.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:57 smithi027 ceph-mon[30611]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:57.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:57 smithi027 ceph-mon[30611]: Standby manager daemon z started 2024-09-13T17:55:57.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:57 smithi027 ceph-mon[30611]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T17:55:57.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:57 smithi027 ceph-mon[30611]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:55:57.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:57 smithi027 ceph-mon[30611]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T17:55:57.469 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:57 smithi027 ceph-mon[30611]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:55:57.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:57 smithi143 ceph-mon[38210]: Reconfiguring mgr.x (unknown last config time)... 2024-09-13T17:55:57.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:57 smithi143 ceph-mon[38210]: Reconfiguring daemon mgr.x on smithi027 2024-09-13T17:55:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:57 smithi143 ceph-mon[38210]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:57 smithi143 ceph-mon[38210]: Standby manager daemon z started 2024-09-13T17:55:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:57 smithi143 ceph-mon[38210]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-13T17:55:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:57 smithi143 ceph-mon[38210]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:55:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:57 smithi143 ceph-mon[38210]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-13T17:55:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:57 smithi143 ceph-mon[38210]: from='mgr.? 172.21.15.143:0/2809157809' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:55:57.641 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.421+0000 7f27d7b79040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T17:55:57.641 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.574+0000 7f27d7b79040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T17:55:57.641 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.638+0000 7f27d7b79040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T17:55:57.906 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.707+0000 7f27d7b79040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T17:55:57.907 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.788+0000 7f27d7b79040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T17:55:57.907 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.847+0000 7f27d7b79040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T17:55:57.907 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:57.904+0000 7f27d7b79040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T17:55:58.423 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:58 smithi027 ceph-mon[30611]: mgrmap e14: x(active, since 81s), standbys: z 2024-09-13T17:55:58.423 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T17:55:58.423 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:58.423 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:58.423 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:58.423 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:58.424 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:58.424 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:58.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:58 smithi122 ceph-mon[35310]: mgrmap e14: x(active, since 81s), standbys: z 2024-09-13T17:55:58.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T17:55:58.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:58.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:58.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:58.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:58.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:58.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:58.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:58 smithi143 ceph-mon[38210]: mgrmap e14: x(active, since 81s), standbys: z 2024-09-13T17:55:58.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-13T17:55:58.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:58.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:58.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:55:58.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:58.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:55:58.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:55:58.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.537+0000 7fac72c00640 1 -- 172.21.15.27:0/3787394222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac6c0744e0 msgr2=0x7fac6c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.537+0000 7fac72c00640 1 --2- 172.21.15.27:0/3787394222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac6c0744e0 0x7fac6c072940 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009900 tx=0x7fac5c02a3f0 comp rx=0 tx=0).stop 2024-09-13T17:55:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.537+0000 7fac72c00640 1 -- 172.21.15.27:0/3787394222 shutdown_connections 2024-09-13T17:55:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.537+0000 7fac72c00640 1 --2- 172.21.15.27:0/3787394222 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c107c70 0x7fac6c10a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.537+0000 7fac72c00640 1 --2- 172.21.15.27:0/3787394222 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac6c072f10 0x7fac6c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.537+0000 7fac72c00640 1 --2- 172.21.15.27:0/3787394222 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac6c0744e0 0x7fac6c072940 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.537+0000 7fac72c00640 1 -- 172.21.15.27:0/3787394222 >> 172.21.15.27:0/3787394222 conn(0x7fac6c0fb5a0 msgr2=0x7fac6c0fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:55:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.537+0000 7fac72c00640 1 -- 172.21.15.27:0/3787394222 shutdown_connections 2024-09-13T17:55:58.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.537+0000 7fac72c00640 1 -- 172.21.15.27:0/3787394222 wait complete. 2024-09-13T17:55:58.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.538+0000 7fac72c00640 1 Processor -- start 2024-09-13T17:55:58.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.538+0000 7fac72c00640 1 -- start start 2024-09-13T17:55:58.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac72c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac6c072f10 0x7fac6c198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:58.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac72c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac6c0744e0 0x7fac6c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:58.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac72c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c107c70 0x7fac6c19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:58.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac72c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c19fbc0 con 0x7fac6c0744e0 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac72c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c19fd30 con 0x7fac6c107c70 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac72c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c19fef0 con 0x7fac6c072f10 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac70c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c107c70 0x7fac6c19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac6b400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac6c0744e0 0x7fac6c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac6be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac6c072f10 0x7fac6c198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac70c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c107c70 0x7fac6c19f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:43194/0 (socket says 172.21.15.27:43194) 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac6b400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac6c0744e0 0x7fac6c198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:36672/0 (socket says 172.21.15.27:36672) 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.539+0000 7fac70c00640 1 -- 172.21.15.27:0/128499784 learned_addr learned my addr 172.21.15.27:0/128499784 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac70c00640 1 -- 172.21.15.27:0/128499784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac6c072f10 msgr2=0x7fac6c198110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac70c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac6c072f10 0x7fac6c198110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac70c00640 1 -- 172.21.15.27:0/128499784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac6c0744e0 msgr2=0x7fac6c198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac70c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac6c0744e0 0x7fac6c198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:55:58.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac70c00640 1 -- 172.21.15.27:0/128499784 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c009560 con 0x7fac6c107c70 2024-09-13T17:55:58.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac70c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c107c70 0x7fac6c19f680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fac6400eb10 tx=0x7fac6400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:58.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac68c00640 1 -- 172.21.15.27:0/128499784 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64004b20 con 0x7fac6c107c70 2024-09-13T17:55:58.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac68c00640 1 -- 172.21.15.27:0/128499784 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fac64004c80 con 0x7fac6c107c70 2024-09-13T17:55:58.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c1a01d0 con 0x7fac6c107c70 2024-09-13T17:55:58.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac68c00640 1 -- 172.21.15.27:0/128499784 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac64010720 con 0x7fac6c107c70 2024-09-13T17:55:58.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.540+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c1a06d0 con 0x7fac6c107c70 2024-09-13T17:55:58.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.541+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c1069f0 con 0x7fac6c107c70 2024-09-13T17:55:58.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.542+0000 7fac68c00640 1 -- 172.21.15.27:0/128499784 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7fac64005020 con 0x7fac6c107c70 2024-09-13T17:55:58.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.543+0000 7fac68c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fac5006ccc0 0x7fac5006f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:55:58.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.543+0000 7fac68c00640 1 -- 172.21.15.27:0/128499784 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fac64014070 con 0x7fac6c107c70 2024-09-13T17:55:58.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.543+0000 7fac6be00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fac5006ccc0 0x7fac5006f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:55:58.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.544+0000 7fac6be00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fac5006ccc0 0x7fac5006f180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009230 tx=0x7fac5c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:55:58.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.547+0000 7fac68c00640 1 -- 172.21.15.27:0/128499784 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fac64056af0 con 0x7fac6c107c70 2024-09-13T17:55:58.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:58.736+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fac6c0608f0 con 0x7fac5006ccc0 2024-09-13T17:55:58.963 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 17:55:58 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y[36691]: 2024-09-13T17:55:58.670+0000 7f27d7b79040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T17:55:59.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:55:59.173+0000 7fac68c00640 1 -- 172.21.15.27:0/128499784 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fac64056ec0 con 0x7fac6c107c70 2024-09-13T17:55:59.463 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:59 smithi027 ceph-mon[30611]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:59.463 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:59 smithi027 ceph-mon[30611]: Standby manager daemon y started 2024-09-13T17:55:59.463 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:59 smithi027 ceph-mon[30611]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T17:55:59.463 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:59 smithi027 ceph-mon[30611]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:55:59.463 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:59 smithi027 ceph-mon[30611]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T17:55:59.463 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:59 smithi027 ceph-mon[30611]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:55:59.463 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:59 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:55:59.463 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:59 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:55:59.464 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:55:59 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:59 smithi122 ceph-mon[35310]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:59 smithi122 ceph-mon[35310]: Standby manager daemon y started 2024-09-13T17:55:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:59 smithi122 ceph-mon[35310]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T17:55:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:59 smithi122 ceph-mon[35310]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:55:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:59 smithi122 ceph-mon[35310]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T17:55:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:59 smithi122 ceph-mon[35310]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:55:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:59 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:55:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:59 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:55:59.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:55:59 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:55:59.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:59 smithi143 ceph-mon[38210]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:55:59.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:59 smithi143 ceph-mon[38210]: Standby manager daemon y started 2024-09-13T17:55:59.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:59 smithi143 ceph-mon[38210]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-13T17:55:59.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:59 smithi143 ceph-mon[38210]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T17:55:59.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:59 smithi143 ceph-mon[38210]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-13T17:55:59.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:59 smithi143 ceph-mon[38210]: from='mgr.? 172.21.15.122:0/4261496479' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T17:55:59.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:59 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:55:59.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:59 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:55:59.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:55:59 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:00.422 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:00 smithi027 ceph-mon[30611]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:56:00.422 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:00 smithi027 ceph-mon[30611]: mgrmap e15: x(active, since 83s), standbys: z, y 2024-09-13T17:56:00.422 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:00 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T17:56:00.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:00 smithi122 ceph-mon[35310]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:56:00.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:00 smithi122 ceph-mon[35310]: mgrmap e15: x(active, since 83s), standbys: z, y 2024-09-13T17:56:00.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:00 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T17:56:00.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:00 smithi143 ceph-mon[38210]: from='client.24122 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:56:00.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:00 smithi143 ceph-mon[38210]: mgrmap e15: x(active, since 83s), standbys: z, y 2024-09-13T17:56:00.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:00 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-13T17:56:01.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:01 smithi122 ceph-mon[35310]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:01.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:01 smithi143 ceph-mon[38210]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:01.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:01 smithi027 ceph-mon[30611]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:02.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:02 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1341039293' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54ed9933-44c6-4fe4-b442-fc797b98c8bf"}]: dispatch 2024-09-13T17:56:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:02 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1341039293' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54ed9933-44c6-4fe4-b442-fc797b98c8bf"}]': finished 2024-09-13T17:56:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:02 smithi027 ceph-mon[30611]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T17:56:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:02 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:02 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1341039293' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54ed9933-44c6-4fe4-b442-fc797b98c8bf"}]: dispatch 2024-09-13T17:56:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:02 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1341039293' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54ed9933-44c6-4fe4-b442-fc797b98c8bf"}]': finished 2024-09-13T17:56:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:02 smithi122 ceph-mon[35310]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T17:56:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:02 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:02.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:02 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1341039293' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "54ed9933-44c6-4fe4-b442-fc797b98c8bf"}]: dispatch 2024-09-13T17:56:02.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:02 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1341039293' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "54ed9933-44c6-4fe4-b442-fc797b98c8bf"}]': finished 2024-09-13T17:56:02.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:02 smithi143 ceph-mon[38210]: osdmap e5: 1 total, 0 up, 1 in 2024-09-13T17:56:02.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:02 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:03.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:03 smithi122 ceph-mon[35310]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:03 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1963513203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:56:03.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:03 smithi143 ceph-mon[38210]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:03.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:03 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1963513203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:56:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:03 smithi027 ceph-mon[30611]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:03 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1963513203' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:56:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:05 smithi122 ceph-mon[35310]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:05.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:05 smithi143 ceph-mon[38210]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:05.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:05 smithi027 ceph-mon[30611]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:07.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:07 smithi122 ceph-mon[35310]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:07.492 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:07 smithi027 ceph-mon[30611]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:07.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:07 smithi143 ceph-mon[38210]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:09.458 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:09 smithi027 ceph-mon[30611]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:09.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:09 smithi122 ceph-mon[35310]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:09.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:09 smithi143 ceph-mon[38210]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:10.380 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T17:56:10.380 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:10.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T17:56:10.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:10.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T17:56:10.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:11.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:11 smithi122 ceph-mon[35310]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:11 smithi122 ceph-mon[35310]: Deploying daemon osd.0 on smithi027 2024-09-13T17:56:11.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:11 smithi143 ceph-mon[38210]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:11.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:11 smithi143 ceph-mon[38210]: Deploying daemon osd.0 on smithi027 2024-09-13T17:56:11.541 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:11 smithi027 ceph-mon[30611]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:11.541 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:11 smithi027 ceph-mon[30611]: Deploying daemon osd.0 on smithi027 2024-09-13T17:56:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:13 smithi027 ceph-mon[30611]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:13.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:13 smithi122 ceph-mon[35310]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:13.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:13 smithi143 ceph-mon[38210]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:15.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:15 smithi027 ceph-mon[30611]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:15.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:15 smithi122 ceph-mon[35310]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:15.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:15 smithi143 ceph-mon[38210]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:17.260 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:17 smithi027 ceph-mon[30611]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:17.261 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:17.261 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:17.261 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:17.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:17 smithi143 ceph-mon[38210]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:17.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:17.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:17.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:17.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:17 smithi122 ceph-mon[35310]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:19.473 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:19 smithi027 ceph-mon[30611]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:19.516 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:19 smithi122 ceph-mon[35310]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:19.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:19 smithi143 ceph-mon[38210]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:20.742 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 0 on host 'smithi027' 2024-09-13T17:56:20.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.740+0000 7fac68c00640 1 -- 172.21.15.27:0/128499784 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fac6c0608f0 con 0x7fac5006ccc0 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fac5006ccc0 msgr2=0x7fac5006f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fac5006ccc0 0x7fac5006f180 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009230 tx=0x7fac5c005a20 comp rx=0 tx=0).stop 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c107c70 msgr2=0x7fac6c19f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c107c70 0x7fac6c19f680 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fac6400eb10 tx=0x7fac6400c2d0 comp rx=0 tx=0).stop 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 shutdown_connections 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fac5006ccc0 0x7fac5006f180 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fac6c107c70 0x7fac6c19f680 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fac6c0744e0 0x7fac6c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 --2- 172.21.15.27:0/128499784 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fac6c072f10 0x7fac6c198110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.742+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 >> 172.21.15.27:0/128499784 conn(0x7fac6c0fb5a0 msgr2=0x7fac6c103bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:56:20.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.743+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 shutdown_connections 2024-09-13T17:56:20.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:56:20.743+0000 7fac72c00640 1 -- 172.21.15.27:0/128499784 wait complete. 2024-09-13T17:56:21.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:20 smithi143 ceph-mon[38210]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:21.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:20 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:20 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:20 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:21.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:20 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:21.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:20 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:20 smithi143 ceph-mon[38210]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T17:56:21.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:20 smithi027 ceph-mon[30611]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:21.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:20 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:20 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:20 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:21.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:20 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:21.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:20 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:20 smithi027 ceph-mon[30611]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T17:56:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:20 smithi122 ceph-mon[35310]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:20 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:20 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:20 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:20 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:20 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:20 smithi122 ceph-mon[35310]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T17:56:21.462 DEBUG:teuthology.orchestra.run.smithi027:osd.0> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T17:56:21.467 INFO:tasks.cephadm:Deploying osd.1 on smithi122 with /dev/vg_nvme/lv_4... 2024-09-13T17:56:21.467 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T17:56:21.664 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:56:21.785 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:21.785 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.785 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:21.785 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:21 smithi122 ceph-mon[35310]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T17:56:21.785 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:21 smithi122 ceph-mon[35310]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T17:56:21.785 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:21.785 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:21 smithi122 ceph-mon[35310]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T17:56:22.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:22.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:22.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:22.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:21 smithi027 ceph-mon[30611]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T17:56:22.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:21 smithi027 ceph-mon[30611]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T17:56:22.009 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:22.010 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:21 smithi027 ceph-mon[30611]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T17:56:22.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:22.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:22.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:22.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:21 smithi143 ceph-mon[38210]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T17:56:22.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:21 smithi143 ceph-mon[38210]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T17:56:22.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:22.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:21 smithi143 ceph-mon[38210]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T17:56:23.362 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:23 smithi122 ceph-mon[35310]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:23.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:23 smithi122 ceph-mon[35310]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T17:56:23.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:23 smithi122 ceph-mon[35310]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T17:56:23.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:23 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:23.363 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:23 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:23.363 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T17:56:23.390 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:23 smithi027 ceph-mon[30611]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:23.390 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:23 smithi027 ceph-mon[30611]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T17:56:23.390 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:23 smithi027 ceph-mon[30611]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T17:56:23.390 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:23 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:23.390 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:23 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:23.391 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:56:23 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0[44826]: 2024-09-13T17:56:23.251+0000 7fceb4600640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T17:56:23.391 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:56:23 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0[44826]: 2024-09-13T17:56:23.270+0000 7fcea9200640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:56:23.442 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T17:56:23.455 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-09-13T17:56:23.455 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-09-13T17:56:23.455 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110917 s, 945 MB/s 2024-09-13T17:56:23.455 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-09-13T17:56:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:23 smithi143 ceph-mon[38210]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:23 smithi143 ceph-mon[38210]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T17:56:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:23 smithi143 ceph-mon[38210]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T17:56:23.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:23 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:23.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:23 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:24.011 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_4 2024-09-13T17:56:24.212 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:56:24.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:24 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T17:56:24.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:24 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T17:56:24.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:24.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:24 smithi143 ceph-mon[38210]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' 2024-09-13T17:56:24.550 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:24 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T17:56:24.550 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:24 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T17:56:24.550 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:24.550 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:24 smithi122 ceph-mon[35310]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' 2024-09-13T17:56:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:24 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T17:56:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:24 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T17:56:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:24 smithi027 ceph-mon[30611]: from='osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537]' entity='osd.0' 2024-09-13T17:56:25.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:25.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:25.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] boot 2024-09-13T17:56:25.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T17:56:25.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:25.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.237 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:56:25.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:25.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:25.238 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:25 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] boot 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:25 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T17:56:25.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:25.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: osd.0 [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] boot 2024-09-13T17:56:25.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: osdmap e8: 1 total, 1 up, 1 in 2024-09-13T17:56:25.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T17:56:25.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:56:25.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:25.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:25.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:25 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:25.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 -- 172.21.15.122:0/3367356902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c81008a0 msgr2=0x7f24c8107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:25.715 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 --2- 172.21.15.122:0/3367356902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c81008a0 0x7f24c8107130 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f24c0009ca0 tx=0x7f24c002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:56:25.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 -- 172.21.15.122:0/3367356902 shutdown_connections 2024-09-13T17:56:25.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 --2- 172.21.15.122:0/3367356902 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c81008a0 0x7f24c8107130 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:25.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 --2- 172.21.15.122:0/3367356902 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24c80ffee0 0x7f24c8100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:25.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 --2- 172.21.15.122:0/3367356902 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c80fece0 0x7f24c80ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:25.716 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 -- 172.21.15.122:0/3367356902 >> 172.21.15.122:0/3367356902 conn(0x7f24c80fa490 msgr2=0x7f24c80fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:56:25.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 -- 172.21.15.122:0/3367356902 shutdown_connections 2024-09-13T17:56:25.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 -- 172.21.15.122:0/3367356902 wait complete. 2024-09-13T17:56:25.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 Processor -- start 2024-09-13T17:56:25.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.710+0000 7f24d061d640 1 -- start start 2024-09-13T17:56:25.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24d061d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c80fece0 0x7f24c8068a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:56:25.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24d061d640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24c80ffee0 0x7f24c819ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:56:25.717 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24d061d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c81008a0 0x7f24c819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:56:25.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24d061d640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c819d980 con 0x7f24c80ffee0 2024-09-13T17:56:25.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24d061d640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c819daf0 con 0x7f24c80fece0 2024-09-13T17:56:25.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24d061d640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c819dcb0 con 0x7f24c81008a0 2024-09-13T17:56:25.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24ce3b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c80fece0 0x7f24c8068a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:56:25.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24ce3b9640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c80fece0 0x7f24c8068a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:51404/0 (socket says 172.21.15.122:51404) 2024-09-13T17:56:25.718 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24ce3b9640 1 -- 172.21.15.122:0/1844597485 learned_addr learned my addr 172.21.15.122:0/1844597485 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T17:56:25.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24cebba640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c81008a0 0x7f24c819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:56:25.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24ce3b9640 1 -- 172.21.15.122:0/1844597485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c81008a0 msgr2=0x7f24c819d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:25.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24ce3b9640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c81008a0 0x7f24c819d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:25.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24ce3b9640 1 -- 172.21.15.122:0/1844597485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24c80ffee0 msgr2=0x7f24c819ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:25.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24ce3b9640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24c80ffee0 0x7f24c819ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:25.719 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24ce3b9640 1 -- 172.21.15.122:0/1844597485 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c0009900 con 0x7f24c80fece0 2024-09-13T17:56:25.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24ce3b9640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c80fece0 0x7f24c8068a10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f24c400d950 tx=0x7f24c400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:56:25.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24bf7fe640 1 -- 172.21.15.122:0/1844597485 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c4009c30 con 0x7f24c80fece0 2024-09-13T17:56:25.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c819df90 con 0x7f24c80fece0 2024-09-13T17:56:25.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.711+0000 7f24bf7fe640 1 -- 172.21.15.122:0/1844597485 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f24c4009d90 con 0x7f24c80fece0 2024-09-13T17:56:25.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.712+0000 7f24bf7fe640 1 -- 172.21.15.122:0/1844597485 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c400f740 con 0x7f24c80fece0 2024-09-13T17:56:25.720 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.712+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c819e480 con 0x7f24c80fece0 2024-09-13T17:56:25.721 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.713+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c81060e0 con 0x7f24c80fece0 2024-09-13T17:56:25.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.714+0000 7f24bf7fe640 1 -- 172.21.15.122:0/1844597485 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f24c4010460 con 0x7f24c80fece0 2024-09-13T17:56:25.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.714+0000 7f24bf7fe640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f24b40a0ff0 0x7f24b40a34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:56:25.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.714+0000 7f24bf7fe640 1 -- 172.21.15.122:0/1844597485 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f24c40cac90 con 0x7f24c80fece0 2024-09-13T17:56:25.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.715+0000 7f24cdbb8640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f24b40a0ff0 0x7f24b40a34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:56:25.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.715+0000 7f24cdbb8640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f24b40a0ff0 0x7f24b40a34b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f24c8068790 tx=0x7f24b8006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:56:25.722 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.719+0000 7f24bf7fe640 1 -- 172.21.15.122:0/1844597485 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f24c40d0020 con 0x7f24c80fece0 2024-09-13T17:56:25.894 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:25.891+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f24c802c4f0 con 0x7f24b40a0ff0 2024-09-13T17:56:26.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:26 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi027 2024-09-13T17:56:26.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:26 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi027 to 17089M 2024-09-13T17:56:26.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:26 smithi143 ceph-mon[38210]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T17:56:26.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:56:26.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:56:26.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:26.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:26 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi027 2024-09-13T17:56:26.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:26 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi027 to 17089M 2024-09-13T17:56:26.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:26 smithi027 ceph-mon[30611]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T17:56:26.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:56:26.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:56:26.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:26.584 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:26 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi027 2024-09-13T17:56:26.584 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:26 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi027 to 17089M 2024-09-13T17:56:26.584 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:26 smithi122 ceph-mon[35310]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T17:56:26.584 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:56:26.584 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:56:26.584 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:27.507 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:27 smithi122 ceph-mon[35310]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:27.508 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:27 smithi122 ceph-mon[35310]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:56:27.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:27 smithi143 ceph-mon[38210]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:27.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:27 smithi143 ceph-mon[38210]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:56:27.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:27 smithi027 ceph-mon[30611]: pgmap v54: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:27.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:27 smithi027 ceph-mon[30611]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:56:28.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:28 smithi143 ceph-mon[38210]: from='client.? 172.21.15.122:0/967981599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66669cca-0b9c-4b87-b8b3-3581b2959c02"}]: dispatch 2024-09-13T17:56:28.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:28 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66669cca-0b9c-4b87-b8b3-3581b2959c02"}]: dispatch 2024-09-13T17:56:28.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:28 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66669cca-0b9c-4b87-b8b3-3581b2959c02"}]': finished 2024-09-13T17:56:28.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:28 smithi143 ceph-mon[38210]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T17:56:28.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:28 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:28.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:28 smithi027 ceph-mon[30611]: from='client.? 172.21.15.122:0/967981599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66669cca-0b9c-4b87-b8b3-3581b2959c02"}]: dispatch 2024-09-13T17:56:28.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:28 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66669cca-0b9c-4b87-b8b3-3581b2959c02"}]: dispatch 2024-09-13T17:56:28.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:28 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66669cca-0b9c-4b87-b8b3-3581b2959c02"}]': finished 2024-09-13T17:56:28.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:28 smithi027 ceph-mon[30611]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T17:56:28.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:28 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:28 smithi122 ceph-mon[35310]: from='client.? 172.21.15.122:0/967981599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66669cca-0b9c-4b87-b8b3-3581b2959c02"}]: dispatch 2024-09-13T17:56:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:28 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "66669cca-0b9c-4b87-b8b3-3581b2959c02"}]: dispatch 2024-09-13T17:56:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:28 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "66669cca-0b9c-4b87-b8b3-3581b2959c02"}]': finished 2024-09-13T17:56:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:28 smithi122 ceph-mon[35310]: osdmap e10: 2 total, 1 up, 2 in 2024-09-13T17:56:28.702 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:28 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:29.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:29 smithi027 ceph-mon[30611]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:29.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:29 smithi027 ceph-mon[30611]: from='client.? 172.21.15.122:0/303232230' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:56:29.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:29 smithi122 ceph-mon[35310]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:29.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:29 smithi122 ceph-mon[35310]: from='client.? 172.21.15.122:0/303232230' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:56:29.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:29 smithi143 ceph-mon[38210]: pgmap v55: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:29.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:29 smithi143 ceph-mon[38210]: from='client.? 172.21.15.122:0/303232230' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:56:31.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:31 smithi027 ceph-mon[30611]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:31.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:31 smithi122 ceph-mon[35310]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:31.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:31 smithi143 ceph-mon[38210]: pgmap v57: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:33.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:33 smithi122 ceph-mon[35310]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:33 smithi027 ceph-mon[30611]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:33.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:33 smithi143 ceph-mon[38210]: pgmap v58: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:35 smithi122 ceph-mon[35310]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:56:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:35 smithi027 ceph-mon[30611]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:56:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:35.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:35 smithi143 ceph-mon[38210]: pgmap v59: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:35.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T17:56:35.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:36 smithi027 ceph-mon[30611]: Deploying daemon osd.1 on smithi122 2024-09-13T17:56:36.630 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:36 smithi122 ceph-mon[35310]: Deploying daemon osd.1 on smithi122 2024-09-13T17:56:36.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:36 smithi143 ceph-mon[38210]: Deploying daemon osd.1 on smithi122 2024-09-13T17:56:37.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:37 smithi027 ceph-mon[30611]: pgmap v60: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:37.578 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:37 smithi122 ceph-mon[35310]: pgmap v60: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:37.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:37 smithi143 ceph-mon[38210]: pgmap v60: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:38 smithi027 ceph-mon[30611]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:38.633 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:38 smithi122 ceph-mon[35310]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:38.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:38 smithi143 ceph-mon[38210]: pgmap v61: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:40.667 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:40 smithi122 ceph-mon[35310]: pgmap v62: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:40.667 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:40.667 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:40.667 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:40.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:40 smithi143 ceph-mon[38210]: pgmap v62: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:40.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:40 smithi027 ceph-mon[30611]: pgmap v62: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:43 smithi143 ceph-mon[38210]: pgmap v63: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:43.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.284 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.281+0000 7f24bf7fe640 1 -- 172.21.15.122:0/1844597485 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f24c802c4f0 con 0x7f24b40a0ff0 2024-09-13T17:56:43.284 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 1 on host 'smithi122' 2024-09-13T17:56:43.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:43 smithi122 ceph-mon[35310]: pgmap v63: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:43.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:43.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:43.285 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f24b40a0ff0 msgr2=0x7f24b40a34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:43.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f24b40a0ff0 0x7f24b40a34b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f24c8068790 tx=0x7f24b8006c90 comp rx=0 tx=0).stop 2024-09-13T17:56:43.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c80fece0 msgr2=0x7f24c8068a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:43.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c80fece0 0x7f24c8068a10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f24c400d950 tx=0x7f24c400de10 comp rx=0 tx=0).stop 2024-09-13T17:56:43.286 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 shutdown_connections 2024-09-13T17:56:43.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f24b40a0ff0 0x7f24b40a34b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:43.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f24c81008a0 0x7f24c819d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:43.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f24c80ffee0 0x7f24c819ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:43.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 --2- 172.21.15.122:0/1844597485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f24c80fece0 0x7f24c8068a10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:43.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 >> 172.21.15.122:0/1844597485 conn(0x7f24c80fa490 msgr2=0x7f24c81032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:56:43.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 shutdown_connections 2024-09-13T17:56:43.287 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:56:43.284+0000 7f24d061d640 1 -- 172.21.15.122:0/1844597485 wait complete. 2024-09-13T17:56:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:43 smithi027 ceph-mon[30611]: pgmap v63: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:43.852 DEBUG:teuthology.orchestra.run.smithi122:osd.1> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T17:56:43.854 INFO:tasks.cephadm:Deploying osd.2 on smithi143 with /dev/vg_nvme/lv_4... 2024-09-13T17:56:43.854 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-09-13T17:56:44.057 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:56:44.114 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:44 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:44.114 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:44 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:44.114 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:44 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:44.114 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:44 smithi122 ceph-mon[35310]: from='osd.1 [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:56:44.114 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:44 smithi122 ceph-mon[35310]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:56:44.115 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:56:43 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1[39774]: 2024-09-13T17:56:43.932+0000 7fd24307a640 -1 osd.1 0 log_to_monitors true 2024-09-13T17:56:44.176 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:44 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:44.176 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:44 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:44.176 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:44 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:44.176 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:44 smithi143 ceph-mon[38210]: from='osd.1 [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:56:44.177 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:44 smithi143 ceph-mon[38210]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:56:44.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:44 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:56:44.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:44 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:44.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:44 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:44.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:44 smithi027 ceph-mon[30611]: from='osd.1 [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:56:44.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:44 smithi027 ceph-mon[30611]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T17:56:45.464 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:56:45 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1[39774]: 2024-09-13T17:56:45.290+0000 7fd23e7d8640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T17:56:45.464 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:56:45 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1[39774]: 2024-09-13T17:56:45.293+0000 7fd23ae13640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:56:45.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:45 smithi122 ceph-mon[35310]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:45.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:45 smithi122 ceph-mon[35310]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:56:45.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:45 smithi122 ceph-mon[35310]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T17:56:45.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:45 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:45.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:45 smithi122 ceph-mon[35310]: from='osd.1 [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:56:45.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:45 smithi122 ceph-mon[35310]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:56:45.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:45 smithi143 ceph-mon[38210]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:45.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:45 smithi143 ceph-mon[38210]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:56:45.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:45 smithi143 ceph-mon[38210]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T17:56:45.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:45 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:45.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:45 smithi143 ceph-mon[38210]: from='osd.1 [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:56:45.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:45 smithi143 ceph-mon[38210]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:56:45.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:45 smithi027 ceph-mon[30611]: pgmap v64: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:45.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:45 smithi027 ceph-mon[30611]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T17:56:45.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:45 smithi027 ceph-mon[30611]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T17:56:45.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:45 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:45.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:45 smithi027 ceph-mon[30611]: from='osd.1 [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:56:45.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:45 smithi027 ceph-mon[30611]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:56:45.604 INFO:teuthology.orchestra.run.smithi143.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-09-13T17:56:45.692 INFO:teuthology.orchestra.run.smithi143.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-09-13T17:56:45.707 INFO:teuthology.orchestra.run.smithi143.stderr: stderr: 10+0 records in 2024-09-13T17:56:45.708 INFO:teuthology.orchestra.run.smithi143.stderr:10+0 records out 2024-09-13T17:56:45.708 INFO:teuthology.orchestra.run.smithi143.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0133503 s, 785 MB/s 2024-09-13T17:56:45.708 INFO:teuthology.orchestra.run.smithi143.stderr:--> Zapping successful for: 2024-09-13T17:56:46.304 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi143:vg_nvme/lv_4 2024-09-13T17:56:46.498 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:56:46.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:46 smithi143 ceph-mon[38210]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T17:56:46.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:46 smithi143 ceph-mon[38210]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T17:56:46.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:46.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:46.537 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:46 smithi122 ceph-mon[35310]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T17:56:46.537 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:46 smithi122 ceph-mon[35310]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T17:56:46.537 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:46.537 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:46.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:46 smithi027 ceph-mon[30611]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T17:56:46.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:46 smithi027 ceph-mon[30611]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T17:56:46.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:46.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:47.541 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T17:56:47.541 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T17:56:47.541 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: pgmap v67: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:47.541 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: osd.1 [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] boot 2024-09-13T17:56:47.541 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi122 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi122 to 17087M 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:47.542 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:47 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T17:56:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T17:56:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: pgmap v67: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: osd.1 [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] boot 2024-09-13T17:56:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T17:56:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi122 2024-09-13T17:56:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:56:47.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi122 to 17087M 2024-09-13T17:56:47.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:47.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:47.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:47 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: pgmap v67: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: osd.1 [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] boot 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: osdmap e13: 2 total, 2 up, 2 in 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi122 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:56:47.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi122 to 17087M 2024-09-13T17:56:47.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:47.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:47.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:56:47.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:47 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:56:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.154+0000 7f161041e640 1 -- 172.21.15.143:0/1890958258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 msgr2=0x7f1608100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.154+0000 7f161041e640 1 --2- 172.21.15.143:0/1890958258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 0x7f1608100200 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1604009900 tx=0x7f160402a410 comp rx=0 tx=0).stop 2024-09-13T17:56:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.154+0000 7f161041e640 1 -- 172.21.15.143:0/1890958258 shutdown_connections 2024-09-13T17:56:48.159 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.154+0000 7f161041e640 1 --2- 172.21.15.143:0/1890958258 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1608101920 0x7f1608108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.154+0000 7f161041e640 1 --2- 172.21.15.143:0/1890958258 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1608100f60 0x7f16081013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.154+0000 7f161041e640 1 --2- 172.21.15.143:0/1890958258 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 0x7f1608100200 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.154+0000 7f161041e640 1 -- 172.21.15.143:0/1890958258 >> 172.21.15.143:0/1890958258 conn(0x7f16080fb5d0 msgr2=0x7f16080fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.154+0000 7f161041e640 1 -- 172.21.15.143:0/1890958258 shutdown_connections 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.154+0000 7f161041e640 1 -- 172.21.15.143:0/1890958258 wait complete. 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f161041e640 1 Processor -- start 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f161041e640 1 -- start start 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f161041e640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 0x7f1608195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f161041e640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1608100f60 0x7f1608196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:56:48.160 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f161041e640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1608101920 0x7f160819d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f161041e640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160819da30 con 0x7f1608100f60 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f161041e640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160819dba0 con 0x7f1608101920 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f161041e640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160819dd60 con 0x7f16080ffe00 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f160e1ba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 0x7f1608195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f160e1ba640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 0x7f1608195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:49912/0 (socket says 172.21.15.143:49912) 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f160e1ba640 1 -- 172.21.15.143:0/2609137362 learned_addr learned my addr 172.21.15.143:0/2609137362 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.155+0000 7f160e9bb640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1608101920 0x7f160819d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f160e1ba640 1 -- 172.21.15.143:0/2609137362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1608101920 msgr2=0x7f160819d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f160e1ba640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1608101920 0x7f160819d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:48.161 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f160e1ba640 1 -- 172.21.15.143:0/2609137362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1608100f60 msgr2=0x7f1608196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:56:48.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f160e1ba640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1608100f60 0x7f1608196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:56:48.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f160e1ba640 1 -- 172.21.15.143:0/2609137362 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1604009560 con 0x7f16080ffe00 2024-09-13T17:56:48.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f160e1ba640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 0x7f1608195f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1604005940 tx=0x7f1604032e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:56:48.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f15ff7fe640 1 -- 172.21.15.143:0/2609137362 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604005290 con 0x7f16080ffe00 2024-09-13T17:56:48.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f15ff7fe640 1 -- 172.21.15.143:0/2609137362 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f16040053f0 con 0x7f16080ffe00 2024-09-13T17:56:48.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160819dfe0 con 0x7f16080ffe00 2024-09-13T17:56:48.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f15ff7fe640 1 -- 172.21.15.143:0/2609137362 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604003c20 con 0x7f16080ffe00 2024-09-13T17:56:48.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.156+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160819e470 con 0x7f16080ffe00 2024-09-13T17:56:48.162 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.157+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1608107210 con 0x7f16080ffe00 2024-09-13T17:56:48.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.159+0000 7f15ff7fe640 1 -- 172.21.15.143:0/2609137362 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f1604004ca0 con 0x7f16080ffe00 2024-09-13T17:56:48.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.159+0000 7f15ff7fe640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f15f40a1020 0x7f15f40a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:56:48.163 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.159+0000 7f15ff7fe640 1 -- 172.21.15.143:0/2609137362 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f16040ec280 con 0x7f16080ffe00 2024-09-13T17:56:48.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.160+0000 7f160d9b9640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f15f40a1020 0x7f15f40a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:56:48.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.160+0000 7f160d9b9640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f15f40a1020 0x7f15f40a34e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1608197450 tx=0x7f15f8006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:56:48.164 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.162+0000 7f15ff7fe640 1 -- 172.21.15.143:0/2609137362 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f16040b7260 con 0x7f16080ffe00 2024-09-13T17:56:48.335 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:56:48.333+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f160802c520 con 0x7f15f40a1020 2024-09-13T17:56:48.862 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:48 smithi143 ceph-mon[38210]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:48.862 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:48 smithi143 ceph-mon[38210]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T17:56:48.862 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:48 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:56:48.862 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:48 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:56:48.862 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:48 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:48.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:48 smithi122 ceph-mon[35310]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:48.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:48 smithi122 ceph-mon[35310]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T17:56:48.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:48 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:56:48.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:48 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:56:48.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:48 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:49.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:48 smithi027 ceph-mon[30611]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:49.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:48 smithi027 ceph-mon[30611]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T17:56:49.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:48 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:56:49.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:48 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:56:49.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:48 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:49.833 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:49 smithi143 ceph-mon[38210]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:56:49.865 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:49 smithi122 ceph-mon[35310]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:56:50.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:49 smithi027 ceph-mon[30611]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:56:50.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:50 smithi122 ceph-mon[35310]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:50.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:50 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/4004452372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2db6f706-d974-4498-b969-2d2382873bf2"}]: dispatch 2024-09-13T17:56:50.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:50 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2db6f706-d974-4498-b969-2d2382873bf2"}]: dispatch 2024-09-13T17:56:50.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:50 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2db6f706-d974-4498-b969-2d2382873bf2"}]': finished 2024-09-13T17:56:50.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:50 smithi122 ceph-mon[35310]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T17:56:50.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:56:51.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:50 smithi143 ceph-mon[38210]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:51.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:50 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/4004452372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2db6f706-d974-4498-b969-2d2382873bf2"}]: dispatch 2024-09-13T17:56:51.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:50 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2db6f706-d974-4498-b969-2d2382873bf2"}]: dispatch 2024-09-13T17:56:51.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:50 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2db6f706-d974-4498-b969-2d2382873bf2"}]': finished 2024-09-13T17:56:51.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:50 smithi143 ceph-mon[38210]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T17:56:51.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:56:51.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:50 smithi027 ceph-mon[30611]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:51.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:50 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/4004452372' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2db6f706-d974-4498-b969-2d2382873bf2"}]: dispatch 2024-09-13T17:56:51.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:50 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2db6f706-d974-4498-b969-2d2382873bf2"}]: dispatch 2024-09-13T17:56:51.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:50 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2db6f706-d974-4498-b969-2d2382873bf2"}]': finished 2024-09-13T17:56:51.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:50 smithi027 ceph-mon[30611]: osdmap e15: 3 total, 2 up, 3 in 2024-09-13T17:56:51.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:56:51.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:51 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/4279456152' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:56:52.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:51 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/4279456152' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:56:52.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:51 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/4279456152' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:56:52.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:52 smithi122 ceph-mon[35310]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:53.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:52 smithi143 ceph-mon[38210]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:53.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:52 smithi027 ceph-mon[30611]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:54.933 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:54 smithi143 ceph-mon[38210]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:54.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:54 smithi122 ceph-mon[35310]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:55.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:54 smithi027 ceph-mon[30611]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:56.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:56 smithi122 ceph-mon[35310]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:57.020 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:56 smithi143 ceph-mon[38210]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:57.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:56 smithi027 ceph-mon[30611]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:57.875 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:56:57.875 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:57.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:56:57.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:58.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T17:56:58.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:56:58.701 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:58 smithi143 ceph-mon[38210]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:58.701 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:56:58 smithi143 ceph-mon[38210]: Deploying daemon osd.2 on smithi143 2024-09-13T17:56:58.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:58 smithi122 ceph-mon[35310]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:58.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:56:58 smithi122 ceph-mon[35310]: Deploying daemon osd.2 on smithi143 2024-09-13T17:56:59.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:58 smithi027 ceph-mon[30611]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:56:59.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:56:58 smithi027 ceph-mon[30611]: Deploying daemon osd.2 on smithi143 2024-09-13T17:57:00.882 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:00 smithi143 ceph-mon[38210]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:00.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:00 smithi122 ceph-mon[35310]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:01.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:00 smithi027 ceph-mon[30611]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:02.676 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:02 smithi143 ceph-mon[38210]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:02.676 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:02 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:02.676 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:02 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:02.676 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:02 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:02.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:02 smithi122 ceph-mon[35310]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:02.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:02 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:02.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:02 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:02.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:02 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:03.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:02 smithi027 ceph-mon[30611]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:03.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:02 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:03.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:02 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:03.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:02 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.178 INFO:teuthology.orchestra.run.smithi143.stdout:Created osd(s) 2 on host 'smithi143' 2024-09-13T17:57:05.178 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.175+0000 7f15ff7fe640 1 -- 172.21.15.143:0/2609137362 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f160802c520 con 0x7f15f40a1020 2024-09-13T17:57:05.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f15f40a1020 msgr2=0x7f15f40a34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:05.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f15f40a1020 0x7f15f40a34e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1608197450 tx=0x7f15f8006c90 comp rx=0 tx=0).stop 2024-09-13T17:57:05.180 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 msgr2=0x7f1608195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:05.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 0x7f1608195f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1604005940 tx=0x7f1604032e20 comp rx=0 tx=0).stop 2024-09-13T17:57:05.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 shutdown_connections 2024-09-13T17:57:05.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f15f40a1020 0x7f15f40a34e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:05.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1608101920 0x7f160819d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:05.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1608100f60 0x7f1608196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:05.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 --2- 172.21.15.143:0/2609137362 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f16080ffe00 0x7f1608195f30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:05.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 >> 172.21.15.143:0/2609137362 conn(0x7f16080fb5d0 msgr2=0x7f16081043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:57:05.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 shutdown_connections 2024-09-13T17:57:05.181 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:57:05.178+0000 7f161041e640 1 -- 172.21.15.143:0/2609137362 wait complete. 2024-09-13T17:57:05.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:05 smithi143 ceph-mon[38210]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:05.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:05.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:05.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:05 smithi027 ceph-mon[30611]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:05.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:05.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:05.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:05 smithi122 ceph-mon[35310]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:05.793 DEBUG:teuthology.orchestra.run.smithi143:osd.2> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T17:57:05.796 INFO:tasks.cephadm:Deploying osd.3 on smithi027 with /dev/vg_nvme/lv_3... 2024-09-13T17:57:05.796 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T17:57:06.089 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:06.089 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:06.089 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:06.090 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:06 smithi143 ceph-mon[38210]: from='osd.2 [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:57:06.090 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:06 smithi143 ceph-mon[38210]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:57:06.090 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2[43235]: 2024-09-13T17:57:05.908+0000 7f0725301640 -1 osd.2 0 log_to_monitors true 2024-09-13T17:57:06.126 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:57:06.265 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:06.265 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:06.265 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:06.266 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:06 smithi027 ceph-mon[30611]: from='osd.2 [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:57:06.266 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:06 smithi027 ceph-mon[30611]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:57:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:06 smithi122 ceph-mon[35310]: from='osd.2 [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:57:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:06 smithi122 ceph-mon[35310]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T17:57:07.275 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:07 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2[43235]: 2024-09-13T17:57:07.194+0000 7f0720a5f640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T17:57:07.276 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:07 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2[43235]: 2024-09-13T17:57:07.198+0000 7f071d09a640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:57:07.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:07 smithi143 ceph-mon[38210]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:07.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:07 smithi143 ceph-mon[38210]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:57:07.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:07 smithi143 ceph-mon[38210]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T17:57:07.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:07.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:07 smithi143 ceph-mon[38210]: from='osd.2 [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:57:07.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:07 smithi143 ceph-mon[38210]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:57:07.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:07 smithi122 ceph-mon[35310]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:07.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:07 smithi122 ceph-mon[35310]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:57:07.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:07 smithi122 ceph-mon[35310]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T17:57:07.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:07.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:07 smithi122 ceph-mon[35310]: from='osd.2 [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:57:07.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:07 smithi122 ceph-mon[35310]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:57:07.507 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:07 smithi027 ceph-mon[30611]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:07.507 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:07 smithi027 ceph-mon[30611]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T17:57:07.507 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:07 smithi027 ceph-mon[30611]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T17:57:07.507 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:07.507 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:07 smithi027 ceph-mon[30611]: from='osd.2 [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:57:07.507 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:07 smithi027 ceph-mon[30611]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:57:08.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:08 smithi027 ceph-mon[30611]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T17:57:08.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:08 smithi027 ceph-mon[30611]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T17:57:08.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:08 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:08.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:08 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:08.366 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:08 smithi143 ceph-mon[38210]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T17:57:08.366 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:08 smithi143 ceph-mon[38210]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T17:57:08.366 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:08 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:08.367 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:08 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:08.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:08 smithi122 ceph-mon[35310]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T17:57:08.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:08 smithi122 ceph-mon[35310]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T17:57:08.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:08 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:08.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:08 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:08.472 INFO:teuthology.orchestra.run.smithi027.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T17:57:08.623 INFO:teuthology.orchestra.run.smithi027.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T17:57:08.657 INFO:teuthology.orchestra.run.smithi027.stderr: stderr: 10+0 records in 2024-09-13T17:57:08.658 INFO:teuthology.orchestra.run.smithi027.stderr:10+0 records out 2024-09-13T17:57:08.658 INFO:teuthology.orchestra.run.smithi027.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0276885 s, 379 MB/s 2024-09-13T17:57:08.658 INFO:teuthology.orchestra.run.smithi027.stderr:--> Zapping successful for: 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: osd.2 [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] boot 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:09.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:09.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: osd.2 [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] boot 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:57:09.490 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.491 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:09.491 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:09.491 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.519 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi027:vg_nvme/lv_3 2024-09-13T17:57:09.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T17:57:09.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T17:57:09.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: osd.2 [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] boot 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: osdmap e18: 3 total, 3 up, 3 in 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:09.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:09.857 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:57:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:10 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi143 2024-09-13T17:57:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:10 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi143 to 17088M 2024-09-13T17:57:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:57:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T17:57:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:10 smithi027 ceph-mon[30611]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T17:57:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:57:10.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:10 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi143 2024-09-13T17:57:10.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:10 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi143 to 17088M 2024-09-13T17:57:10.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:57:10.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T17:57:10.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:10 smithi122 ceph-mon[35310]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T17:57:10.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:57:10.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:10 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi143 2024-09-13T17:57:10.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:10 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi143 to 17088M 2024-09-13T17:57:10.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:57:10.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-13T17:57:10.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:10 smithi143 ceph-mon[38210]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T17:57:10.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T17:57:11.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:11 smithi122 ceph-mon[35310]: pgmap v85: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:11 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:57:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:11 smithi122 ceph-mon[35310]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T17:57:11.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:11 smithi143 ceph-mon[38210]: pgmap v85: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:11.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:11 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:57:11.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:11 smithi143 ceph-mon[38210]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T17:57:11.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:11 smithi027 ceph-mon[30611]: pgmap v85: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:11 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T17:57:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:11 smithi027 ceph-mon[30611]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T17:57:11.991 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.988+0000 7fd2fa000640 1 -- 172.21.15.27:0/1910895808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2f4074480 msgr2=0x7fd2f40728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:11.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.988+0000 7fd2fa000640 1 --2- 172.21.15.27:0/1910895808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2f4074480 0x7fd2f40728e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009900 tx=0x7fd2e802a480 comp rx=0 tx=0).stop 2024-09-13T17:57:11.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.988+0000 7fd2fa000640 1 -- 172.21.15.27:0/1910895808 shutdown_connections 2024-09-13T17:57:11.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.988+0000 7fd2fa000640 1 --2- 172.21.15.27:0/1910895808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2f4107ad0 0x7fd2f4109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:11.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.988+0000 7fd2fa000640 1 --2- 172.21.15.27:0/1910895808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f4072eb0 0x7fd2f4073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:11.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.988+0000 7fd2fa000640 1 --2- 172.21.15.27:0/1910895808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2f4074480 0x7fd2f40728e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:11.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.988+0000 7fd2fa000640 1 -- 172.21.15.27:0/1910895808 >> 172.21.15.27:0/1910895808 conn(0x7fd2f40fb3c0 msgr2=0x7fd2f40fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:57:11.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.988+0000 7fd2fa000640 1 -- 172.21.15.27:0/1910895808 shutdown_connections 2024-09-13T17:57:11.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.988+0000 7fd2fa000640 1 -- 172.21.15.27:0/1910895808 wait complete. 2024-09-13T17:57:11.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.989+0000 7fd2fa000640 1 Processor -- start 2024-09-13T17:57:11.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.989+0000 7fd2fa000640 1 -- start start 2024-09-13T17:57:11.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2fa000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2f4072eb0 0x7fd2f4197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:57:11.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2fa000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f4074480 0x7fd2f41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2fa000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2f4107ad0 0x7fd2f419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2fa000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f419f9b0 con 0x7fd2f4107ad0 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2fa000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f419fb20 con 0x7fd2f4074480 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2fa000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f419fce0 con 0x7fd2f4072eb0 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2f8c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2f4072eb0 0x7fd2f4197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2f3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f4074480 0x7fd2f41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2f8c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2f4072eb0 0x7fd2f4197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:47690/0 (socket says 172.21.15.27:47690) 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2f8c00640 1 -- 172.21.15.27:0/325013974 learned_addr learned my addr 172.21.15.27:0/325013974 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.990+0000 7fd2f9600640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2f4107ad0 0x7fd2f419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2f8c00640 1 -- 172.21.15.27:0/325013974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f4074480 msgr2=0x7fd2f41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:11.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2f8c00640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f4074480 0x7fd2f41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2f8c00640 1 -- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2f4107ad0 msgr2=0x7fd2f419f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2f8c00640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2f4107ad0 0x7fd2f419f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2f8c00640 1 -- 172.21.15.27:0/325013974 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e8009560 con 0x7fd2f4072eb0 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2f8c00640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2f4072eb0 0x7fd2f4197eb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8031510 tx=0x7fd2e80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2f1600640 1 -- 172.21.15.27:0/325013974 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8004cc0 con 0x7fd2f4072eb0 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2f1600640 1 -- 172.21.15.27:0/325013974 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd2e8003ad0 con 0x7fd2f4072eb0 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2f1600640 1 -- 172.21.15.27:0/325013974 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8031d60 con 0x7fd2f4072eb0 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.991+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f40ff650 con 0x7fd2f4072eb0 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.992+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f40ffaa0 con 0x7fd2f4072eb0 2024-09-13T17:57:11.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.993+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f4106890 con 0x7fd2f4072eb0 2024-09-13T17:57:11.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.994+0000 7fd2f1600640 1 -- 172.21.15.27:0/325013974 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fd2e8003c40 con 0x7fd2f4072eb0 2024-09-13T17:57:12.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.997+0000 7fd2f1600640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2dc0a1010 0x7fd2dc0a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:57:12.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.997+0000 7fd2f3e00640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2dc0a1010 0x7fd2dc0a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:57:12.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.997+0000 7fd2f1600640 1 -- 172.21.15.27:0/325013974 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3237+0+0 (secure 0 0 0) 0x7fd2e80ec4d0 con 0x7fd2f4072eb0 2024-09-13T17:57:12.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:11.998+0000 7fd2f3e00640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2dc0a1010 0x7fd2dc0a34d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2f41993d0 tx=0x7fd2e000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:57:12.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:12.000+0000 7fd2f1600640 1 -- 172.21.15.27:0/325013974 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd2e80b7120 con 0x7fd2f4072eb0 2024-09-13T17:57:12.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:12.189+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2f402c450 con 0x7fd2dc0a1010 2024-09-13T17:57:12.192 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:57:11 smithi027 sudo[49173]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:57:12.193 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:57:11 smithi027 sudo[49173]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:12.193 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:57:11 smithi027 sudo[49173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:12.193 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:57:11 smithi027 sudo[49173]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:12.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:12.220+0000 7fd2f1600640 1 -- 172.21.15.27:0/325013974 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd2e80b74f0 con 0x7fd2f4072eb0 2024-09-13T17:57:12.984 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:57:12 smithi027 sudo[49316]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:57:12.984 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:57:12 smithi027 sudo[49316]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:12.984 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:57:12 smithi027 sudo[49316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:12.984 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 17:57:12 smithi027 sudo[49316]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:13.267 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:57:13 smithi122 sudo[43908]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:57:13.267 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:57:13 smithi122 sudo[43908]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:13.267 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:57:13 smithi122 sudo[43908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:13.267 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:57:13 smithi122 sudo[43908]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:13.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:13 smithi122 ceph-mon[35310]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:13.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:13 smithi122 ceph-mon[35310]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T17:57:13.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:13 smithi122 ceph-mon[35310]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:57:13.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:57:13.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:57:13.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:13.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:13 smithi122 ceph-mon[35310]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T17:57:13.268 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:13 smithi027 ceph-mon[30611]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:13 smithi027 ceph-mon[30611]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T17:57:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:13 smithi027 ceph-mon[30611]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:57:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:57:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:57:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:13 smithi027 ceph-mon[30611]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T17:57:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:13.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:13 smithi143 ceph-mon[38210]: pgmap v88: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:13.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:13 smithi143 ceph-mon[38210]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T17:57:13.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:13 smithi143 ceph-mon[38210]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:57:13.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:57:13.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:57:13.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:13.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:13 smithi143 ceph-mon[38210]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-13T17:57:13.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:13.713 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:57:13 smithi122 sudo[43911]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:57:13.714 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:57:13 smithi122 sudo[43911]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:13.714 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:57:13 smithi122 sudo[43911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:13.714 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 17:57:13 smithi122 sudo[43911]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:13.791 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:13 smithi143 sudo[46850]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:57:13.791 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:13 smithi143 sudo[46850]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:13.792 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:13 smithi143 sudo[46850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:13.792 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:13 smithi143 sudo[46850]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:14.275 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:13 smithi143 sudo[46853]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:57:14.275 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:13 smithi143 sudo[46853]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:14.275 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:13 smithi143 sudo[46853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:14.275 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 17:57:13 smithi143 sudo[46853]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:14.813 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:14 smithi027 sudo[49371]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:57:14.813 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:14 smithi027 sudo[49371]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:14.813 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:14 smithi027 sudo[49371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:14.814 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:14 smithi027 sudo[49371]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:15.591 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:15.592 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:15.592 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 ceph-mon[38210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:57:15.592 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 sudo[46856]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:57:15.592 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 sudo[46856]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:15.592 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 sudo[46856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:15.592 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 sudo[46856]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:15.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:15.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:15.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:15 smithi122 ceph-mon[35310]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:57:15.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:15 smithi027 sudo[49412]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:57:15.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:15 smithi027 sudo[49412]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:15.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:15 smithi027 sudo[49412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:15.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:15 smithi027 sudo[49412]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:15.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:15.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:15.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:15 smithi027 ceph-mon[30611]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:57:16.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 sudo[46859]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:57:16.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 sudo[46859]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:16.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 sudo[46859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:16.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:15 smithi143 sudo[46859]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:16.329 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 sudo[43914]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T17:57:16.329 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 sudo[43914]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:16.329 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 sudo[43914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:16.329 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 sudo[43914]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:16.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:16.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/205710003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14528e45-0ca2-401e-9cf7-8cafd2beb354"}]: dispatch 2024-09-13T17:57:16.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: pgmap v91: 1 pgs: 1 active+clean; 449 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:16.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:57:16.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14528e45-0ca2-401e-9cf7-8cafd2beb354"}]: dispatch 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14528e45-0ca2-401e-9cf7-8cafd2beb354"}]': finished 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: osdmap e22: 4 total, 3 up, 4 in 2024-09-13T17:57:16.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:16.559 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:57:16.559 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:57:16.559 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:57:16.559 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:16 smithi027 ceph-mon[30611]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:57:16.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 sudo[43917]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T17:57:16.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 sudo[43917]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T17:57:16.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 sudo[43917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T17:57:16.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 sudo[43917]: pam_unix(sudo:session): session closed for user root 2024-09-13T17:57:16.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:16.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/205710003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14528e45-0ca2-401e-9cf7-8cafd2beb354"}]: dispatch 2024-09-13T17:57:16.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: pgmap v91: 1 pgs: 1 active+clean; 449 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:16.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14528e45-0ca2-401e-9cf7-8cafd2beb354"}]: dispatch 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14528e45-0ca2-401e-9cf7-8cafd2beb354"}]': finished 2024-09-13T17:57:16.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: osdmap e22: 4 total, 3 up, 4 in 2024-09-13T17:57:16.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:16.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:57:16.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:57:16.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:57:16.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:16 smithi122 ceph-mon[35310]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:57:16.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: pgmap v90: 1 pgs: 1 active+clean; 449 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:16.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/205710003' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14528e45-0ca2-401e-9cf7-8cafd2beb354"}]: dispatch 2024-09-13T17:57:16.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: pgmap v91: 1 pgs: 1 active+clean; 449 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:16.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:57:16.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:57:16.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14528e45-0ca2-401e-9cf7-8cafd2beb354"}]: dispatch 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14528e45-0ca2-401e-9cf7-8cafd2beb354"}]': finished 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: osdmap e22: 4 total, 3 up, 4 in 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:16.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-13T17:57:16.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-13T17:57:16.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-13T17:57:16.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:16 smithi143 ceph-mon[38210]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T17:57:17.678 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:17 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1095609025' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:57:17.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:17 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1095609025' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:57:17.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:17 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1095609025' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:57:18.694 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:18 smithi143 ceph-mon[38210]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 457 KiB/s wr, 30 op/s 2024-09-13T17:57:18.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:18 smithi122 ceph-mon[35310]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 457 KiB/s wr, 30 op/s 2024-09-13T17:57:18.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:18 smithi027 ceph-mon[30611]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 9.0 KiB/s rd, 457 KiB/s wr, 30 op/s 2024-09-13T17:57:20.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:20 smithi122 ceph-mon[35310]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 20 op/s 2024-09-13T17:57:20.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:20 smithi143 ceph-mon[38210]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 20 op/s 2024-09-13T17:57:20.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:20 smithi027 ceph-mon[30611]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 6.0 KiB/s rd, 305 KiB/s wr, 20 op/s 2024-09-13T17:57:22.627 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:22 smithi027 ceph-mon[30611]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 228 KiB/s wr, 15 op/s 2024-09-13T17:57:22.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:22 smithi122 ceph-mon[35310]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 228 KiB/s wr, 15 op/s 2024-09-13T17:57:22.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:22 smithi143 ceph-mon[38210]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 228 KiB/s wr, 15 op/s 2024-09-13T17:57:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:24 smithi027 ceph-mon[30611]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T17:57:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:57:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:24 smithi027 ceph-mon[30611]: Deploying daemon osd.3 on smithi027 2024-09-13T17:57:24.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:24 smithi122 ceph-mon[35310]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T17:57:24.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:57:24.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:24.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:24 smithi122 ceph-mon[35310]: Deploying daemon osd.3 on smithi027 2024-09-13T17:57:24.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:24 smithi143 ceph-mon[38210]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T17:57:24.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T17:57:24.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:24.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:24 smithi143 ceph-mon[38210]: Deploying daemon osd.3 on smithi027 2024-09-13T17:57:26.615 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:26 smithi027 ceph-mon[30611]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T17:57:26.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:26 smithi122 ceph-mon[35310]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T17:57:26.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:26 smithi143 ceph-mon[38210]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.6 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-09-13T17:57:28.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:28 smithi027 ceph-mon[30611]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 159 KiB/s wr, 10 op/s 2024-09-13T17:57:28.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:28 smithi122 ceph-mon[35310]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 159 KiB/s wr, 10 op/s 2024-09-13T17:57:28.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:28 smithi143 ceph-mon[38210]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail; 3.1 KiB/s rd, 159 KiB/s wr, 10 op/s 2024-09-13T17:57:30.423 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:30 smithi027 ceph-mon[30611]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:30.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:30 smithi122 ceph-mon[35310]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:30.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:30 smithi143 ceph-mon[38210]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:31.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:31.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:31.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:31.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:31.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:31.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:31.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:31.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:33.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:32 smithi122 ceph-mon[35310]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:33.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:32 smithi143 ceph-mon[38210]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:33.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:32 smithi027 ceph-mon[30611]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:34.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.993+0000 7fd2f1600640 1 -- 172.21.15.27:0/325013974 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd2f402c450 con 0x7fd2dc0a1010 2024-09-13T17:57:34.996 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 3 on host 'smithi027' 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.995+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2dc0a1010 msgr2=0x7fd2dc0a34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.995+0000 7fd2fa000640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2dc0a1010 0x7fd2dc0a34d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd2f41993d0 tx=0x7fd2e000b390 comp rx=0 tx=0).stop 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.995+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2f4072eb0 msgr2=0x7fd2f4197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.995+0000 7fd2fa000640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2f4072eb0 0x7fd2f4197eb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8031510 tx=0x7fd2e80046c0 comp rx=0 tx=0).stop 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.996+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 shutdown_connections 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.996+0000 7fd2fa000640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2dc0a1010 0x7fd2dc0a34d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.996+0000 7fd2fa000640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd2f4107ad0 0x7fd2f419f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.996+0000 7fd2fa000640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2f4074480 0x7fd2f41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.996+0000 7fd2fa000640 1 --2- 172.21.15.27:0/325013974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd2f4072eb0 0x7fd2f4197eb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.996+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 >> 172.21.15.27:0/325013974 conn(0x7fd2f40fb3c0 msgr2=0x7fd2f4103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:57:34.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.996+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 shutdown_connections 2024-09-13T17:57:34.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:57:34.996+0000 7fd2fa000640 1 -- 172.21.15.27:0/325013974 wait complete. 2024-09-13T17:57:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:34 smithi122 ceph-mon[35310]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:34 smithi122 ceph-mon[35310]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:57:35.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:34 smithi143 ceph-mon[38210]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:35.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:35.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:35.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:34 smithi143 ceph-mon[38210]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:57:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:34 smithi027 ceph-mon[30611]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:34 smithi027 ceph-mon[30611]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T17:57:35.732 DEBUG:teuthology.orchestra.run.smithi027:osd.3> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T17:57:35.736 INFO:tasks.cephadm:Deploying osd.4 on smithi122 with /dev/vg_nvme/lv_3... 2024-09-13T17:57:35.736 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T17:57:35.938 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:57:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:35 smithi027 ceph-mon[30611]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:57:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:35 smithi027 ceph-mon[30611]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T17:57:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:35 smithi027 ceph-mon[30611]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T17:57:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:35.983 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:36.059 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:35 smithi122 ceph-mon[35310]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:57:36.059 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:35 smithi122 ceph-mon[35310]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T17:57:36.059 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:36.059 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:35 smithi122 ceph-mon[35310]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T17:57:36.059 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:36.059 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:36.059 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:36.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:35 smithi143 ceph-mon[38210]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T17:57:36.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:35 smithi143 ceph-mon[38210]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T17:57:36.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:36.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:35 smithi143 ceph-mon[38210]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T17:57:36.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:36.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:36.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:37.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:36 smithi027 ceph-mon[30611]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:37.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:36 smithi027 ceph-mon[30611]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T17:57:37.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:36 smithi027 ceph-mon[30611]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T17:57:37.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:37.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:37.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:36 smithi027 ceph-mon[30611]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' 2024-09-13T17:57:37.058 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 17:57:36 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3[51434]: 2024-09-13T17:57:36.891+0000 7fc5b7c00640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T17:57:37.058 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 17:57:36 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3[51434]: 2024-09-13T17:57:36.920+0000 7fc5ac800640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:57:37.177 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:36 smithi122 ceph-mon[35310]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:37.177 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:36 smithi122 ceph-mon[35310]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T17:57:37.177 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:36 smithi122 ceph-mon[35310]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T17:57:37.177 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:37.177 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:37.177 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:36 smithi122 ceph-mon[35310]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' 2024-09-13T17:57:37.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:36 smithi143 ceph-mon[38210]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:37.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:36 smithi143 ceph-mon[38210]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T17:57:37.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:36 smithi143 ceph-mon[38210]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T17:57:37.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:37.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:37.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:36 smithi143 ceph-mon[38210]: from='osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559]' entity='osd.3' 2024-09-13T17:57:37.681 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T17:57:37.756 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T17:57:37.770 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-09-13T17:57:37.770 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-09-13T17:57:37.770 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115115 s, 911 MB/s 2024-09-13T17:57:37.770 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-09-13T17:57:38.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:37 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T17:57:38.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:37 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T17:57:38.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:37 smithi027 ceph-mon[30611]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T17:57:38.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:38.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:38.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:37 smithi027 ceph-mon[30611]: osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] boot 2024-09-13T17:57:38.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:37 smithi027 ceph-mon[30611]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T17:57:38.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:38.131 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:37 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T17:57:38.131 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:37 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T17:57:38.131 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:37 smithi122 ceph-mon[35310]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T17:57:38.131 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:38.131 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:38.132 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:37 smithi122 ceph-mon[35310]: osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] boot 2024-09-13T17:57:38.132 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:37 smithi122 ceph-mon[35310]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T17:57:38.132 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:38.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:37 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T17:57:38.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:37 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T17:57:38.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:37 smithi143 ceph-mon[38210]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T17:57:38.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:38.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:38.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:37 smithi143 ceph-mon[38210]: osd.3 [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] boot 2024-09-13T17:57:38.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:37 smithi143 ceph-mon[38210]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T17:57:38.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T17:57:38.420 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_3 2024-09-13T17:57:38.624 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:57:38.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:38 smithi122 ceph-mon[35310]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:38.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:38 smithi122 ceph-mon[35310]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T17:57:39.177 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:38 smithi027 ceph-mon[30611]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:39.177 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:38 smithi027 ceph-mon[30611]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T17:57:39.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:38 smithi143 ceph-mon[38210]: pgmap v106: 1 pgs: 1 remapped+peering; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-13T17:57:39.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:38 smithi143 ceph-mon[38210]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T17:57:40.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/1555751877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4105ad0 msgr2=0x7f6df4107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:40.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/1555751877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4105ad0 0x7f6df4107f20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6dec009900 tx=0x7f6dec02a410 comp rx=0 tx=0).stop 2024-09-13T17:57:40.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/1555751877 shutdown_connections 2024-09-13T17:57:40.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/1555751877 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4105ad0 0x7f6df4107f20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:40.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/1555751877 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df41031a0 0x7f6df4105590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:40.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/1555751877 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6df4100870 0x7f6df4102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:40.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/1555751877 >> 172.21.15.122:0/1555751877 conn(0x7f6df40fa490 msgr2=0x7f6df40fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:57:40.152 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/1555751877 shutdown_connections 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/1555751877 wait complete. 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 Processor -- start 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 -- start start 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4100870 0x7f6df4195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.148+0000 7f6dfb8cc640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6df41031a0 0x7f6df4196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6dfb8cc640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df4105ad0 0x7f6df419d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6dfb8cc640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df419d8c0 con 0x7f6df4105ad0 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6dfb8cc640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df419da30 con 0x7f6df4100870 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6dfb8cc640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df419dbf0 con 0x7f6df41031a0 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9668640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4100870 0x7f6df4195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:57:40.153 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9668640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4100870 0x7f6df4195dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:45932/0 (socket says 172.21.15.122:45932) 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9668640 1 -- 172.21.15.122:0/3693799616 learned_addr learned my addr 172.21.15.122:0/3693799616 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9e69640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df4105ad0 0x7f6df419d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df8e67640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6df41031a0 0x7f6df4196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9668640 1 -- 172.21.15.122:0/3693799616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6df41031a0 msgr2=0x7f6df4196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9668640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6df41031a0 0x7f6df4196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9668640 1 -- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df4105ad0 msgr2=0x7f6df419d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9668640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df4105ad0 0x7f6df419d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9668640 1 -- 172.21.15.122:0/3693799616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec009560 con 0x7f6df4100870 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df9668640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4100870 0x7f6df4195dc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6de400cce0 tx=0x7f6de400a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df27fc640 1 -- 172.21.15.122:0/3693799616 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4004b20 con 0x7f6df4100870 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df27fc640 1 -- 172.21.15.122:0/3693799616 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6de4004c80 con 0x7f6df4100870 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df419ded0 con 0x7f6df4100870 2024-09-13T17:57:40.154 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6df27fc640 1 -- 172.21.15.122:0/3693799616 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de400f740 con 0x7f6df4100870 2024-09-13T17:57:40.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.149+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df419e340 con 0x7f6df4100870 2024-09-13T17:57:40.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.150+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df40fbf80 con 0x7f6df4100870 2024-09-13T17:57:40.155 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.151+0000 7f6df27fc640 1 -- 172.21.15.122:0/3693799616 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6de400f8a0 con 0x7f6df4100870 2024-09-13T17:57:40.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.152+0000 7f6df27fc640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6ddc0a1130 0x7f6ddc0a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:57:40.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.152+0000 7f6df27fc640 1 -- 172.21.15.122:0/3693799616 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f6de40cbb60 con 0x7f6df4100870 2024-09-13T17:57:40.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.152+0000 7f6df8e67640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6ddc0a1130 0x7f6ddc0a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:57:40.156 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.153+0000 7f6df8e67640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6ddc0a1130 0x7f6ddc0a35f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6df41972e0 tx=0x7f6de800b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:57:40.158 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.156+0000 7f6df27fc640 1 -- 172.21.15.122:0/3693799616 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6de4096570 con 0x7f6df4100870 2024-09-13T17:57:40.332 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:40.330+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6df402c550 con 0x7f6ddc0a1130 2024-09-13T17:57:40.687 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:40.687 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi027 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi027 to 8544M 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:57:40.688 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:40.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi027 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi027 to 8544M 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:57:40.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:57:40.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:40.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi027 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi027 to 8544M 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:40.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T17:57:40.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:57:40.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:57:40.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:42.163 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:41 smithi122 ceph-mon[35310]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:57:42.163 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:41 smithi122 ceph-mon[35310]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T17:57:42.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:41 smithi143 ceph-mon[38210]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:57:42.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:41 smithi143 ceph-mon[38210]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T17:57:42.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:41 smithi027 ceph-mon[30611]: from='client.24230 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:57:42.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:41 smithi027 ceph-mon[30611]: osdmap e29: 4 total, 4 up, 4 in 2024-09-13T17:57:43.196 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:42 smithi122 ceph-mon[35310]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:43.197 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:42 smithi122 ceph-mon[35310]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T17:57:43.197 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:42 smithi122 ceph-mon[35310]: from='client.? 172.21.15.122:0/2256812188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28"}]: dispatch 2024-09-13T17:57:43.197 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:42 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28"}]: dispatch 2024-09-13T17:57:43.197 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:42 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28"}]': finished 2024-09-13T17:57:43.197 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:42 smithi122 ceph-mon[35310]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T17:57:43.197 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:57:43.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:42 smithi143 ceph-mon[38210]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:42 smithi143 ceph-mon[38210]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T17:57:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:42 smithi143 ceph-mon[38210]: from='client.? 172.21.15.122:0/2256812188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28"}]: dispatch 2024-09-13T17:57:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:42 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28"}]: dispatch 2024-09-13T17:57:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:42 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28"}]': finished 2024-09-13T17:57:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:42 smithi143 ceph-mon[38210]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T17:57:43.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:57:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:42 smithi027 ceph-mon[30611]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:42 smithi027 ceph-mon[30611]: osdmap e30: 4 total, 4 up, 4 in 2024-09-13T17:57:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:42 smithi027 ceph-mon[30611]: from='client.? 172.21.15.122:0/2256812188' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28"}]: dispatch 2024-09-13T17:57:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:42 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28"}]: dispatch 2024-09-13T17:57:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:42 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28"}]': finished 2024-09-13T17:57:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:42 smithi027 ceph-mon[30611]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T17:57:43.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:57:44.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:43 smithi122 ceph-mon[35310]: from='client.? 172.21.15.122:0/3748326998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:57:44.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:43 smithi143 ceph-mon[38210]: from='client.? 172.21.15.122:0/3748326998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:57:44.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:43 smithi027 ceph-mon[30611]: from='client.? 172.21.15.122:0/3748326998' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:57:45.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:44 smithi122 ceph-mon[35310]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:57:45.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:44 smithi143 ceph-mon[38210]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:57:45.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:44 smithi027 ceph-mon[30611]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:57:47.043 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:46 smithi122 ceph-mon[35310]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-13T17:57:47.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:46 smithi143 ceph-mon[38210]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-13T17:57:47.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:46 smithi027 ceph-mon[30611]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-13T17:57:49.159 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:48 smithi122 ceph-mon[35310]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-13T17:57:49.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:48 smithi143 ceph-mon[38210]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-13T17:57:49.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:48 smithi027 ceph-mon[30611]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-13T17:57:50.162 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:49 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:57:50.162 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:49 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:50.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:49 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:57:50.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:49 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:50.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T17:57:50.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:57:51.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:50 smithi122 ceph-mon[35310]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:57:51.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:50 smithi122 ceph-mon[35310]: Deploying daemon osd.4 on smithi122 2024-09-13T17:57:51.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:50 smithi143 ceph-mon[38210]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:57:51.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:50 smithi143 ceph-mon[38210]: Deploying daemon osd.4 on smithi122 2024-09-13T17:57:51.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:50 smithi027 ceph-mon[30611]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:57:51.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:50 smithi027 ceph-mon[30611]: Deploying daemon osd.4 on smithi122 2024-09-13T17:57:53.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:52 smithi122 ceph-mon[35310]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-13T17:57:53.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:52 smithi143 ceph-mon[38210]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-13T17:57:53.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:52 smithi027 ceph-mon[30611]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-13T17:57:55.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:54 smithi122 ceph-mon[35310]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:55.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:55.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:55.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:55.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:54 smithi143 ceph-mon[38210]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:55.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:55.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:55.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:55.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:54 smithi027 ceph-mon[30611]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:55.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:57:55.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:55.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:57.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:56 smithi122 ceph-mon[35310]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:57.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:56 smithi143 ceph-mon[38210]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:57.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:56 smithi027 ceph-mon[30611]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:57.797 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.795+0000 7f6df27fc640 1 -- 172.21.15.122:0/3693799616 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6df402c550 con 0x7f6ddc0a1130 2024-09-13T17:57:57.798 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 4 on host 'smithi122' 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6ddc0a1130 msgr2=0x7f6ddc0a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6ddc0a1130 0x7f6ddc0a35f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6df41972e0 tx=0x7f6de800b590 comp rx=0 tx=0).stop 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4100870 msgr2=0x7f6df4195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4100870 0x7f6df4195dc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6de400cce0 tx=0x7f6de400a620 comp rx=0 tx=0).stop 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 shutdown_connections 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6ddc0a1130 0x7f6ddc0a35f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6df4105ad0 0x7f6df419d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6df41031a0 0x7f6df4196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 --2- 172.21.15.122:0/3693799616 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6df4100870 0x7f6df4195dc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:57:57.800 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 >> 172.21.15.122:0/3693799616 conn(0x7f6df40fa490 msgr2=0x7f6df41012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:57:57.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 shutdown_connections 2024-09-13T17:57:57.801 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:57:57.797+0000 7f6dfb8cc640 1 -- 172.21.15.122:0/3693799616 wait complete. 2024-09-13T17:57:58.463 DEBUG:teuthology.orchestra.run.smithi122:osd.4> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T17:57:58.466 INFO:tasks.cephadm:Deploying osd.5 on smithi143 with /dev/vg_nvme/lv_3... 2024-09-13T17:57:58.466 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-09-13T17:57:58.671 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:57:59.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:58 smithi027 ceph-mon[30611]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:59.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:58 smithi027 ceph-mon[30611]: from='osd.4 [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:57:59.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:58 smithi027 ceph-mon[30611]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:57:59.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.088 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:58 smithi122 ceph-mon[35310]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:59.088 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.088 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.088 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:58 smithi122 ceph-mon[35310]: from='osd.4 [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:57:59.088 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:58 smithi122 ceph-mon[35310]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:57:59.088 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.089 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.089 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:58 smithi143 ceph-mon[38210]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:57:59.089 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.089 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.090 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:58 smithi143 ceph-mon[38210]: from='osd.4 [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:57:59.090 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:58 smithi143 ceph-mon[38210]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T17:57:59.090 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:57:59.090 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:00.172 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:59 smithi122 ceph-mon[35310]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:58:00.172 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:59 smithi122 ceph-mon[35310]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T17:58:00.173 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:59 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:00.173 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:59 smithi122 ceph-mon[35310]: from='osd.4 [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:58:00.173 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:57:59 smithi122 ceph-mon[35310]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:58:00.258 INFO:teuthology.orchestra.run.smithi143.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-09-13T17:58:00.258 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:59 smithi143 ceph-mon[38210]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:58:00.258 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:59 smithi143 ceph-mon[38210]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T17:58:00.258 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:59 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:00.258 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:59 smithi143 ceph-mon[38210]: from='osd.4 [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:58:00.258 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:57:59 smithi143 ceph-mon[38210]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:58:00.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:59 smithi027 ceph-mon[30611]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T17:58:00.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:59 smithi027 ceph-mon[30611]: osdmap e32: 5 total, 4 up, 5 in 2024-09-13T17:58:00.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:59 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:00.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:59 smithi027 ceph-mon[30611]: from='osd.4 [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:58:00.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:57:59 smithi027 ceph-mon[30611]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:58:00.349 INFO:teuthology.orchestra.run.smithi143.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-09-13T17:58:00.361 INFO:teuthology.orchestra.run.smithi143.stderr: stderr: 10+0 records in 2024-09-13T17:58:00.362 INFO:teuthology.orchestra.run.smithi143.stderr:10+0 records out 2024-09-13T17:58:00.362 INFO:teuthology.orchestra.run.smithi143.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113734 s, 922 MB/s 2024-09-13T17:58:00.362 INFO:teuthology.orchestra.run.smithi143.stderr:--> Zapping successful for: 2024-09-13T17:58:00.979 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi143:vg_nvme/lv_3 2024-09-13T17:58:01.174 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:58:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:00 smithi122 ceph-mon[35310]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:58:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:00 smithi122 ceph-mon[35310]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T17:58:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:00 smithi122 ceph-mon[35310]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T17:58:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:00 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:00 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:01.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:00 smithi122 ceph-mon[35310]: from='osd.4 ' entity='osd.4' 2024-09-13T17:58:01.215 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 17:58:00 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T17:58:00.771+0000 7fad658a8640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T17:58:01.215 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 17:58:00 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T17:58:00.783+0000 7fad5c6a0640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:58:01.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:00 smithi143 ceph-mon[38210]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:58:01.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:00 smithi143 ceph-mon[38210]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T17:58:01.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:00 smithi143 ceph-mon[38210]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T17:58:01.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:00 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:01.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:00 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:01.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:00 smithi143 ceph-mon[38210]: from='osd.4 ' entity='osd.4' 2024-09-13T17:58:01.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:00 smithi027 ceph-mon[30611]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:58:01.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:00 smithi027 ceph-mon[30611]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T17:58:01.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:00 smithi027 ceph-mon[30611]: osdmap e33: 5 total, 4 up, 5 in 2024-09-13T17:58:01.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:00 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:01.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:00 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:01.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:00 smithi027 ceph-mon[30611]: from='osd.4 ' entity='osd.4' 2024-09-13T17:58:02.260 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T17:58:02.260 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T17:58:02.260 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:02.260 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.260 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.260 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:02.260 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: osd.4 [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] boot 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T17:58:02.261 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:02.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:02.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:02.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: osd.4 [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] boot 2024-09-13T17:58:02.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T17:58:02.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:02.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:02.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:02.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:02.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:02.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: osd.4 [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] boot 2024-09-13T17:58:02.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: osdmap e34: 5 total, 5 up, 5 in 2024-09-13T17:58:02.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T17:58:02.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.698+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2411623435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d4101080 msgr2=0x7fe9d4101500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:02.702 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.698+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2411623435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d4101080 0x7fe9d4101500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009900 tx=0x7fe9c802a410 comp rx=0 tx=0).stop 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.698+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2411623435 shutdown_connections 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.698+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2411623435 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9d4101a40 0x7fe9d41082d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.698+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2411623435 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d4101080 0x7fe9d4101500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.698+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2411623435 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9d40fe0a0 0x7fe9d40fe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.698+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2411623435 >> 172.21.15.143:0/2411623435 conn(0x7fe9d40f9c10 msgr2=0x7fe9d40fc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.698+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2411623435 shutdown_connections 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.698+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2411623435 wait complete. 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9da3e6640 1 Processor -- start 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9da3e6640 1 -- start start 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9da3e6640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d40fe0a0 0x7fe9d41980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9da3e6640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9d4101080 0x7fe9d4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9da3e6640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9d4101a40 0x7fe9d419f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:02.703 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9da3e6640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d419fbe0 con 0x7fe9d4101a40 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9da3e6640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d419fd50 con 0x7fe9d4101080 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9da3e6640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d419ff10 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9d3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d40fe0a0 0x7fe9d41980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9d3fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d40fe0a0 0x7fe9d41980e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:43418/0 (socket says 172.21.15.143:43418) 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9d3fff640 1 -- 172.21.15.143:0/2849776348 learned_addr learned my addr 172.21.15.143:0/2849776348 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.699+0000 7fe9d37fe640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9d4101080 0x7fe9d4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d8983640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9d4101a40 0x7fe9d419f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d3fff640 1 -- 172.21.15.143:0/2849776348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9d4101080 msgr2=0x7fe9d4198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d3fff640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9d4101080 0x7fe9d4198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d3fff640 1 -- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9d4101a40 msgr2=0x7fe9d419f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d3fff640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9d4101a40 0x7fe9d419f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:02.704 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d3fff640 1 -- 172.21.15.143:0/2849776348 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8009560 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d8983640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9d4101a40 0x7fe9d419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:58:02.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d3fff640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d40fe0a0 0x7fe9d41980e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400d950 tx=0x7fe9c400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:58:02.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d17fa640 1 -- 172.21.15.143:0/2849776348 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4009c30 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d41a01f0 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d17fa640 1 -- 172.21.15.143:0/2849776348 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe9c4009d90 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9d17fa640 1 -- 172.21.15.143:0/2849776348 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c400f740 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.705 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.700+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d41a0670 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.701+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d410b860 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.702+0000 7fe9d17fa640 1 -- 172.21.15.143:0/2849776348 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe9c4010460 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.703+0000 7fe9d17fa640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9bc0a10b0 0x7fe9bc0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.703+0000 7fe9d17fa640 1 -- 172.21.15.143:0/2849776348 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fe9c40cb670 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.703+0000 7fe9d37fe640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9bc0a10b0 0x7fe9bc0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:02.706 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.703+0000 7fe9d37fe640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9bc0a10b0 0x7fe9bc0a3570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8005ab0 tx=0x7fe9c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:58:02.709 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.707+0000 7fe9d17fa640 1 -- 172.21.15.143:0/2849776348 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe9c4095e70 con 0x7fe9d40fe0a0 2024-09-13T17:58:02.880 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:02.878+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9d4100590 con 0x7fe9bc0a10b0 2024-09-13T17:58:03.240 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:02 smithi143 ceph-mon[38210]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:58:03.241 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:02 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi122 2024-09-13T17:58:03.241 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:02 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi122 to 8543M 2024-09-13T17:58:03.241 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:02 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:58:03.241 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:02 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:58:03.241 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:02 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:03.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:02 smithi027 ceph-mon[30611]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:58:03.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:02 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi122 2024-09-13T17:58:03.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:02 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi122 to 8543M 2024-09-13T17:58:03.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:02 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:58:03.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:02 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:58:03.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:02 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:02 smithi122 ceph-mon[35310]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-13T17:58:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:02 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi122 2024-09-13T17:58:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:02 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi122 to 8543M 2024-09-13T17:58:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:02 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:58:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:02 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:58:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:02 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:04.184 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:03 smithi143 ceph-mon[38210]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:58:04.184 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:03 smithi143 ceph-mon[38210]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T17:58:04.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:03 smithi027 ceph-mon[30611]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:58:04.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:03 smithi027 ceph-mon[30611]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T17:58:04.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:04 smithi122 ceph-mon[35310]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:58:04.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:04 smithi122 ceph-mon[35310]: osdmap e35: 5 total, 5 up, 5 in 2024-09-13T17:58:05.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:05 smithi143 ceph-mon[38210]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:05.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:05 smithi027 ceph-mon[30611]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:05.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:05 smithi122 ceph-mon[35310]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:06.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:06 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/3722414961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5676151a-5792-4ec2-b503-b9ca28b51dd6"}]: dispatch 2024-09-13T17:58:06.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:06 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5676151a-5792-4ec2-b503-b9ca28b51dd6"}]: dispatch 2024-09-13T17:58:06.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:06 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5676151a-5792-4ec2-b503-b9ca28b51dd6"}]': finished 2024-09-13T17:58:06.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:06 smithi027 ceph-mon[30611]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T17:58:06.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:06.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:06 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/2490488482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:58:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:06 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/3722414961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5676151a-5792-4ec2-b503-b9ca28b51dd6"}]: dispatch 2024-09-13T17:58:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:06 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5676151a-5792-4ec2-b503-b9ca28b51dd6"}]: dispatch 2024-09-13T17:58:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:06 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5676151a-5792-4ec2-b503-b9ca28b51dd6"}]': finished 2024-09-13T17:58:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:06 smithi122 ceph-mon[35310]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T17:58:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:06.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:06 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/2490488482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:58:06.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:06 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/3722414961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5676151a-5792-4ec2-b503-b9ca28b51dd6"}]: dispatch 2024-09-13T17:58:06.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:06 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5676151a-5792-4ec2-b503-b9ca28b51dd6"}]: dispatch 2024-09-13T17:58:06.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:06 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5676151a-5792-4ec2-b503-b9ca28b51dd6"}]': finished 2024-09-13T17:58:06.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:06 smithi143 ceph-mon[38210]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T17:58:06.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:06.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:06 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/2490488482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:58:07.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:07 smithi122 ceph-mon[35310]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:07.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:07 smithi143 ceph-mon[38210]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:07.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:07 smithi027 ceph-mon[30611]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:09.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:09 smithi122 ceph-mon[35310]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:09.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:09 smithi143 ceph-mon[38210]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:09.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:09 smithi027 ceph-mon[30611]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:11.463 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:11 smithi143 ceph-mon[38210]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:11.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:11 smithi122 ceph-mon[35310]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:11 smithi027 ceph-mon[30611]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:12.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:58:12.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:12.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:58:12.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:12.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T17:58:12.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:13.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:13 smithi027 ceph-mon[30611]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:13 smithi027 ceph-mon[30611]: Deploying daemon osd.5 on smithi143 2024-09-13T17:58:13.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:13 smithi122 ceph-mon[35310]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:13.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:13 smithi122 ceph-mon[35310]: Deploying daemon osd.5 on smithi143 2024-09-13T17:58:13.470 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:13 smithi143 ceph-mon[38210]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:13.470 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:13 smithi143 ceph-mon[38210]: Deploying daemon osd.5 on smithi143 2024-09-13T17:58:15.442 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:15 smithi143 ceph-mon[38210]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:15.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:15 smithi122 ceph-mon[35310]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:15.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:15 smithi027 ceph-mon[30611]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:17.434 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:17 smithi143 ceph-mon[38210]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:17.434 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:17.434 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:17.434 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:17.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:17 smithi122 ceph-mon[35310]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:17.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:17.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:17.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:17.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:17 smithi027 ceph-mon[30611]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:17.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:17.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:17.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:19.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:19 smithi122 ceph-mon[35310]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:19.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:19 smithi143 ceph-mon[38210]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:19 smithi027 ceph-mon[30611]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:20.030 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.028+0000 7fe9d17fa640 1 -- 172.21.15.143:0/2849776348 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe9d4100590 con 0x7fe9bc0a10b0 2024-09-13T17:58:20.030 INFO:teuthology.orchestra.run.smithi143.stdout:Created osd(s) 5 on host 'smithi143' 2024-09-13T17:58:20.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.030+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9bc0a10b0 msgr2=0x7fe9bc0a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:20.032 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.030+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9bc0a10b0 0x7fe9bc0a3570 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8005ab0 tx=0x7fe9c8005a20 comp rx=0 tx=0).stop 2024-09-13T17:58:20.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.030+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d40fe0a0 msgr2=0x7fe9d41980e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:20.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.030+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d40fe0a0 0x7fe9d41980e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400d950 tx=0x7fe9c400de10 comp rx=0 tx=0).stop 2024-09-13T17:58:20.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.031+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 shutdown_connections 2024-09-13T17:58:20.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.031+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9bc0a10b0 0x7fe9bc0a3570 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:20.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.031+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9d4101a40 0x7fe9d419f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:20.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.031+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9d4101080 0x7fe9d4198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:20.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.031+0000 7fe9da3e6640 1 --2- 172.21.15.143:0/2849776348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9d40fe0a0 0x7fe9d41980e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:20.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.031+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 >> 172.21.15.143:0/2849776348 conn(0x7fe9d40f9c10 msgr2=0x7fe9d40fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:58:20.033 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.031+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 shutdown_connections 2024-09-13T17:58:20.034 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:58:20.031+0000 7fe9da3e6640 1 -- 172.21.15.143:0/2849776348 wait complete. 2024-09-13T17:58:20.702 DEBUG:teuthology.orchestra.run.smithi143:osd.5> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T17:58:20.704 INFO:tasks.cephadm:Deploying osd.6 on smithi027 with /dev/vg_nvme/lv_2... 2024-09-13T17:58:20.705 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T17:58:20.955 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 17:58:20 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T17:58:20.820+0000 7fcaf5623640 -1 osd.5 0 log_to_monitors true 2024-09-13T17:58:21.038 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:58:21.250 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:21 smithi143 ceph-mon[38210]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:21.250 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.251 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.251 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.251 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.251 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:21 smithi143 ceph-mon[38210]: from='osd.5 [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:58:21.251 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:21 smithi143 ceph-mon[38210]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:58:21.291 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:21 smithi122 ceph-mon[35310]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:21.291 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.291 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.291 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.291 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.291 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:21 smithi122 ceph-mon[35310]: from='osd.5 [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:58:21.291 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:21 smithi122 ceph-mon[35310]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:58:21.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:21 smithi027 ceph-mon[30611]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:21.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:21 smithi027 ceph-mon[30611]: from='osd.5 [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:58:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:21 smithi027 ceph-mon[30611]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T17:58:22.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:22 smithi027 ceph-mon[30611]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:58:22.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:22 smithi027 ceph-mon[30611]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T17:58:22.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:22 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:22.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:22 smithi027 ceph-mon[30611]: from='osd.5 [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:58:22.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:22 smithi027 ceph-mon[30611]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:58:22.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:22 smithi143 ceph-mon[38210]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:58:22.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:22 smithi143 ceph-mon[38210]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T17:58:22.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:22 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:22.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:22 smithi143 ceph-mon[38210]: from='osd.5 [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:58:22.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:22 smithi143 ceph-mon[38210]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:58:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:22 smithi122 ceph-mon[35310]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T17:58:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:22 smithi122 ceph-mon[35310]: osdmap e37: 6 total, 5 up, 6 in 2024-09-13T17:58:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:22 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:22 smithi122 ceph-mon[35310]: from='osd.5 [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:58:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:22 smithi122 ceph-mon[35310]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:58:23.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T17:58:23.102+0000 7fcaf0d81640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T17:58:23.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T17:58:23.113+0000 7fcae93b4640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:58:23.407 INFO:teuthology.orchestra.run.smithi027.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T17:58:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:23 smithi027 ceph-mon[30611]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:23 smithi027 ceph-mon[30611]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T17:58:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:23 smithi027 ceph-mon[30611]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T17:58:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:23 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:23 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:23 smithi027 ceph-mon[30611]: from='osd.5 ' entity='osd.5' 2024-09-13T17:58:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:23 smithi027 ceph-mon[30611]: osd.5 [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] boot 2024-09-13T17:58:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:23 smithi027 ceph-mon[30611]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T17:58:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:23 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:23.563 INFO:teuthology.orchestra.run.smithi027.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T17:58:23.597 INFO:teuthology.orchestra.run.smithi027.stderr: stderr: 10+0 records in 2024-09-13T17:58:23.597 INFO:teuthology.orchestra.run.smithi027.stderr:10+0 records out 2024-09-13T17:58:23.597 INFO:teuthology.orchestra.run.smithi027.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0271296 s, 387 MB/s 2024-09-13T17:58:23.597 INFO:teuthology.orchestra.run.smithi027.stderr: stderr: 2024-09-13T17:58:23.597 INFO:teuthology.orchestra.run.smithi027.stderr:--> Zapping successful for: 2024-09-13T17:58:23.695 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-mon[38210]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:23.695 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-mon[38210]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T17:58:23.695 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-mon[38210]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T17:58:23.695 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:23.695 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:23.695 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-mon[38210]: from='osd.5 ' entity='osd.5' 2024-09-13T17:58:23.695 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-mon[38210]: osd.5 [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] boot 2024-09-13T17:58:23.695 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-mon[38210]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T17:58:23.695 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:23 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:23 smithi122 ceph-mon[35310]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-13T17:58:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:23 smithi122 ceph-mon[35310]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T17:58:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:23 smithi122 ceph-mon[35310]: osdmap e38: 6 total, 5 up, 6 in 2024-09-13T17:58:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:23 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:23 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:23 smithi122 ceph-mon[35310]: from='osd.5 ' entity='osd.5' 2024-09-13T17:58:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:23 smithi122 ceph-mon[35310]: osd.5 [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] boot 2024-09-13T17:58:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:23 smithi122 ceph-mon[35310]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T17:58:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:23 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T17:58:24.417 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi027:vg_nvme/lv_2 2024-09-13T17:58:24.737 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:58:25.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T17:58:25.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T17:58:25.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 583 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:25.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi143 2024-09-13T17:58:25.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:25.027 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:25.027 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi143 to 8544M 2024-09-13T17:58:25.027 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.027 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:25.027 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:25.027 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.028 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:25.028 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:25.028 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:25.028 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.028 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:24 smithi143 ceph-mon[38210]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T17:58:25.055 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T17:58:25.055 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 583 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi143 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi143 to 8544M 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:25.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:25.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:24 smithi027 ceph-mon[30611]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T17:58:25.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T17:58:25.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T17:58:25.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: pgmap v143: 1 pgs: 1 peering; 577 KiB data, 583 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:25.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi143 2024-09-13T17:58:25.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi143 to 8544M 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:25.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:24 smithi122 ceph-mon[35310]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T17:58:26.454 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:26 smithi027 ceph-mon[30611]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T17:58:26.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.568+0000 7f6823e00640 1 -- 172.21.15.27:0/3303452651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824076a50 msgr2=0x7f68240772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:26.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.568+0000 7f6823e00640 1 --2- 172.21.15.27:0/3303452651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824076a50 0x7f68240772f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f681c009ca0 tx=0x7f681c02a8c0 comp rx=0 tx=0).stop 2024-09-13T17:58:26.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.568+0000 7f6823e00640 1 -- 172.21.15.27:0/3303452651 shutdown_connections 2024-09-13T17:58:26.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.568+0000 7f6823e00640 1 --2- 172.21.15.27:0/3303452651 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824076a50 0x7f68240772f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:26.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.568+0000 7f6823e00640 1 --2- 172.21.15.27:0/3303452651 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68240760b0 0x7f6824076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:26.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.568+0000 7f6823e00640 1 --2- 172.21.15.27:0/3303452651 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6824074e60 0x7f6824075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:26.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.568+0000 7f6823e00640 1 -- 172.21.15.27:0/3303452651 >> 172.21.15.27:0/3303452651 conn(0x7f68240fd5e0 msgr2=0x7f68240ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:58:26.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.568+0000 7f6823e00640 1 -- 172.21.15.27:0/3303452651 shutdown_connections 2024-09-13T17:58:26.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.568+0000 7f6823e00640 1 -- 172.21.15.27:0/3303452651 wait complete. 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.569+0000 7f6823e00640 1 Processor -- start 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.569+0000 7f6823e00640 1 -- start start 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.569+0000 7f6823e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824074e60 0x7f682419c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.569+0000 7f6823e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68240760b0 0x7f682419c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.569+0000 7f6823e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6824076a50 0x7f68241a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.569+0000 7f6823e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68241a3d40 con 0x7f6824074e60 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.569+0000 7f6823e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68241a3eb0 con 0x7f6824076a50 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6823e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68241a4070 con 0x7f68240760b0 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6822a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824074e60 0x7f682419c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6822a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824074e60 0x7f682419c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44384/0 (socket says 172.21.15.27:44384) 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6822a00640 1 -- 172.21.15.27:0/3634552434 learned_addr learned my addr 172.21.15.27:0/3634552434 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:58:26.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f681a000640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68240760b0 0x7f682419c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6823400640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6824076a50 0x7f68241a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6822a00640 1 -- 172.21.15.27:0/3634552434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68240760b0 msgr2=0x7f682419c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6822a00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68240760b0 0x7f682419c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6822a00640 1 -- 172.21.15.27:0/3634552434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6824076a50 msgr2=0x7f68241a3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6822a00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6824076a50 0x7f68241a3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f6822a00640 1 -- 172.21.15.27:0/3634552434 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c009900 con 0x7f6824074e60 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.570+0000 7f681a000640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68240760b0 0x7f682419c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.571+0000 7f6822a00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824074e60 0x7f682419c240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f681400e9f0 tx=0x7f681400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.571+0000 7f681be00640 1 -- 172.21.15.27:0/3634552434 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814009700 con 0x7f6824074e60 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.571+0000 7f681be00640 1 -- 172.21.15.27:0/3634552434 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f681400cd80 con 0x7f6824074e60 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.571+0000 7f681be00640 1 -- 172.21.15.27:0/3634552434 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814018920 con 0x7f6824074e60 2024-09-13T17:58:26.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.571+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68241a4350 con 0x7f6824074e60 2024-09-13T17:58:26.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.571+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68241a4850 con 0x7f6824074e60 2024-09-13T17:58:26.576 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.572+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682410e7b0 con 0x7f6824074e60 2024-09-13T17:58:26.577 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.574+0000 7f681be00640 1 -- 172.21.15.27:0/3634552434 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6814018a80 con 0x7f6824074e60 2024-09-13T17:58:26.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.575+0000 7f681be00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68080a1120 0x7f68080a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:26.578 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.576+0000 7f681be00640 1 -- 172.21.15.27:0/3634552434 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4533+0+0 (secure 0 0 0) 0x7f6814014070 con 0x7f6824074e60 2024-09-13T17:58:26.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.576+0000 7f681a000640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68080a1120 0x7f68080a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:26.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.576+0000 7f681a000640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68080a1120 0x7f68080a35e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f682419d760 tx=0x7f680c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:58:26.581 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.579+0000 7f681be00640 1 -- 172.21.15.27:0/3634552434 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6814096840 con 0x7f6824074e60 2024-09-13T17:58:26.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:26 smithi122 ceph-mon[35310]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T17:58:26.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:26 smithi143 ceph-mon[38210]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T17:58:26.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:26.774+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f682402c4f0 con 0x7f68080a1120 2024-09-13T17:58:27.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:27 smithi027 ceph-mon[30611]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 583 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:27.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:27 smithi027 ceph-mon[30611]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T17:58:27.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:27 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:58:27.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:27 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:58:27.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:27 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:27.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:27 smithi122 ceph-mon[35310]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 583 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:27.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:27 smithi122 ceph-mon[35310]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T17:58:27.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:27 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:58:27.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:27 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:58:27.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:27 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:27.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:27 smithi143 ceph-mon[38210]: pgmap v146: 1 pgs: 1 peering; 577 KiB data, 583 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:27.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:27 smithi143 ceph-mon[38210]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T17:58:27.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:27 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:58:27.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:27 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:58:27.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:27 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:28.429 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:28 smithi027 ceph-mon[30611]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:58:28.429 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:28 smithi027 ceph-mon[30611]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T17:58:28.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:28 smithi143 ceph-mon[38210]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:58:28.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:28 smithi143 ceph-mon[38210]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T17:58:28.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:28 smithi122 ceph-mon[35310]: from='client.14304 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:58:28.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:28 smithi122 ceph-mon[35310]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T17:58:29.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:29 smithi027 ceph-mon[30611]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 583 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:58:29.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:29 smithi122 ceph-mon[35310]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 583 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:58:29.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:29 smithi143 ceph-mon[38210]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 583 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-13T17:58:30.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:30 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2219018818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34db282b-ab45-44ce-9bc1-de0de6c820e3"}]: dispatch 2024-09-13T17:58:30.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:30 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2219018818' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34db282b-ab45-44ce-9bc1-de0de6c820e3"}]': finished 2024-09-13T17:58:30.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:30 smithi122 ceph-mon[35310]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T17:58:30.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:30 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:30.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:30 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2219018818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34db282b-ab45-44ce-9bc1-de0de6c820e3"}]: dispatch 2024-09-13T17:58:30.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:30 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2219018818' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34db282b-ab45-44ce-9bc1-de0de6c820e3"}]': finished 2024-09-13T17:58:30.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:30 smithi143 ceph-mon[38210]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T17:58:30.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:30 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:30.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:30 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2219018818' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34db282b-ab45-44ce-9bc1-de0de6c820e3"}]: dispatch 2024-09-13T17:58:30.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:30 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2219018818' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34db282b-ab45-44ce-9bc1-de0de6c820e3"}]': finished 2024-09-13T17:58:30.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:30 smithi027 ceph-mon[30611]: osdmap e44: 7 total, 6 up, 7 in 2024-09-13T17:58:30.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:30 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:31.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:31 smithi122 ceph-mon[35310]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-13T17:58:31.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:31 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1165991842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:58:31.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:31 smithi143 ceph-mon[38210]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-13T17:58:31.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:31 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1165991842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:58:31.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:31 smithi027 ceph-mon[30611]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-13T17:58:31.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:31 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1165991842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:58:32.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:32 smithi122 ceph-mon[35310]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:58:32.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:32 smithi143 ceph-mon[38210]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:58:32.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:32 smithi027 ceph-mon[30611]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:58:34.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:34 smithi027 ceph-mon[30611]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-13T17:58:34.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:34 smithi122 ceph-mon[35310]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-13T17:58:34.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:34 smithi143 ceph-mon[38210]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-13T17:58:36.536 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:36 smithi027 ceph-mon[30611]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:58:36.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:36 smithi122 ceph-mon[35310]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:58:36.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:36 smithi143 ceph-mon[38210]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:58:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:38 smithi027 ceph-mon[30611]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T17:58:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:38 smithi027 ceph-mon[30611]: Deploying daemon osd.6 on smithi027 2024-09-13T17:58:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:38 smithi122 ceph-mon[35310]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T17:58:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:38 smithi122 ceph-mon[35310]: Deploying daemon osd.6 on smithi027 2024-09-13T17:58:38.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:38 smithi143 ceph-mon[38210]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:38.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-13T17:58:38.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:38.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:38 smithi143 ceph-mon[38210]: Deploying daemon osd.6 on smithi027 2024-09-13T17:58:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:40 smithi027 ceph-mon[30611]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:40.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:40 smithi122 ceph-mon[35310]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:40.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:40 smithi143 ceph-mon[38210]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:42.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:42 smithi027 ceph-mon[30611]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:42.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:42 smithi122 ceph-mon[35310]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:42.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:42 smithi143 ceph-mon[38210]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:44.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:44 smithi122 ceph-mon[35310]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:44.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:44 smithi143 ceph-mon[38210]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:44.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:44 smithi027 ceph-mon[30611]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:45.656 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:45 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:45.656 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:45 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:45.656 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:45 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:45.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:45 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:45.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:45 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:45.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:45 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:45.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:45 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:45.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:45 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:45.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:45 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:47.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:47 smithi027 ceph-mon[30611]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:47.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:47 smithi143 ceph-mon[38210]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:47 smithi122 ceph-mon[35310]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:49 smithi027 ceph-mon[30611]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:49 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:49.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.491+0000 7f681be00640 1 -- 172.21.15.27:0/3634552434 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f682402c4f0 con 0x7f68080a1120 2024-09-13T17:58:49.494 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 6 on host 'smithi027' 2024-09-13T17:58:49.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68080a1120 msgr2=0x7f68080a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:49.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68080a1120 0x7f68080a35e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f682419d760 tx=0x7f680c005f90 comp rx=0 tx=0).stop 2024-09-13T17:58:49.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824074e60 msgr2=0x7f682419c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:49.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824074e60 0x7f682419c240 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f681400e9f0 tx=0x7f681400eeb0 comp rx=0 tx=0).stop 2024-09-13T17:58:49.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 shutdown_connections 2024-09-13T17:58:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68080a1120 0x7f68080a35e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6824076a50 0x7f68241a3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68240760b0 0x7f682419c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 --2- 172.21.15.27:0/3634552434 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6824074e60 0x7f682419c240 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 >> 172.21.15.27:0/3634552434 conn(0x7f68240fd5e0 msgr2=0x7f68240ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:58:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 shutdown_connections 2024-09-13T17:58:49.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:58:49.494+0000 7f6823e00640 1 -- 172.21.15.27:0/3634552434 wait complete. 2024-09-13T17:58:49.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:49 smithi143 ceph-mon[38210]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:49.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:49 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:49.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:49 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:49.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:49 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:49.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:49 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:49.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:49 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:49.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:49 smithi122 ceph-mon[35310]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:49.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:49 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:49.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:49 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:49.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:49 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:49.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:49 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:49.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:49 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:50.394 DEBUG:teuthology.orchestra.run.smithi027:osd.6> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.6.service 2024-09-13T17:58:50.399 INFO:tasks.cephadm:Deploying osd.7 on smithi122 with /dev/vg_nvme/lv_2... 2024-09-13T17:58:50.399 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T17:58:50.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:50 smithi143 ceph-mon[38210]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T17:58:50.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:50.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:50 smithi027 ceph-mon[30611]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T17:58:50.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:50.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:50.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:50.602 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:58:50.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:50 smithi122 ceph-mon[35310]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-13T17:58:50.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:58:50.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:50.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:51.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:51 smithi143 ceph-mon[38210]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:51.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:51 smithi143 ceph-mon[38210]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T17:58:51.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:51 smithi143 ceph-mon[38210]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T17:58:51.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:51 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:51.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:51 smithi143 ceph-mon[38210]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T17:58:51.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:51 smithi027 ceph-mon[30611]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:51.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:51 smithi027 ceph-mon[30611]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T17:58:51.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:51 smithi027 ceph-mon[30611]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T17:58:51.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:51 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:51.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:51 smithi027 ceph-mon[30611]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T17:58:51.557 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 17:58:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T17:58:51.264+0000 7f3a67600640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T17:58:51.558 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 17:58:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T17:58:51.277+0000 7f3a63000640 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:58:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:51 smithi122 ceph-mon[35310]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:51 smithi122 ceph-mon[35310]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-13T17:58:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:51 smithi122 ceph-mon[35310]: osdmap e45: 7 total, 6 up, 7 in 2024-09-13T17:58:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:51 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:51 smithi122 ceph-mon[35310]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T17:58:52.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:52 smithi027 ceph-mon[30611]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T17:58:52.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:52 smithi027 ceph-mon[30611]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T17:58:52.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:52 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:52.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:52 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:52.394 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:52 smithi122 ceph-mon[35310]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T17:58:52.394 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:52 smithi122 ceph-mon[35310]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T17:58:52.394 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:52 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:52.394 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:52 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:52.498 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T17:58:52.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:52 smithi143 ceph-mon[38210]: from='osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T17:58:52.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:52 smithi143 ceph-mon[38210]: osdmap e46: 7 total, 6 up, 7 in 2024-09-13T17:58:52.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:52 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:52.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:52 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:52.597 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T17:58:52.610 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-09-13T17:58:52.610 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-09-13T17:58:52.611 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011211 s, 935 MB/s 2024-09-13T17:58:52.611 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-09-13T17:58:53.203 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_2 2024-09-13T17:58:53.400 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T17:58:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:53 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T17:58:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:53 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T17:58:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:53 smithi122 ceph-mon[35310]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:53 smithi122 ceph-mon[35310]: osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] boot 2024-09-13T17:58:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:53 smithi122 ceph-mon[35310]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T17:58:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:53.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:53 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T17:58:53.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:53 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T17:58:53.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:53 smithi143 ceph-mon[38210]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:53.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:53.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:53 smithi143 ceph-mon[38210]: osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] boot 2024-09-13T17:58:53.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:53 smithi143 ceph-mon[38210]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T17:58:53.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:53.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:53 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T17:58:53.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:53 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T17:58:53.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:53 smithi027 ceph-mon[30611]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-09-13T17:58:53.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:53.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:53 smithi027 ceph-mon[30611]: osd.6 [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] boot 2024-09-13T17:58:53.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:53 smithi027 ceph-mon[30611]: osdmap e47: 7 total, 7 up, 7 in 2024-09-13T17:58:53.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-13T17:58:54.563 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T17:58:54.563 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.563 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.564 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:54.564 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:54.564 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:54.564 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.564 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:54.564 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:54.564 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:54 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:54 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: osdmap e48: 7 total, 7 up, 7 in 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:58:54.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:54 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:58:55.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.045+0000 7fa4cf946640 1 -- 172.21.15.122:0/1095857543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c8100040 msgr2=0x7fa4c81068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:55.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.045+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1095857543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c8100040 0x7fa4c81068d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009ca0 tx=0x7fa4c002a8c0 comp rx=0 tx=0).stop 2024-09-13T17:58:55.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.045+0000 7fa4cf946640 1 -- 172.21.15.122:0/1095857543 shutdown_connections 2024-09-13T17:58:55.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.045+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1095857543 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c8100040 0x7fa4c81068d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:55.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.045+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1095857543 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4c80ff680 0x7fa4c80ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:55.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.045+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1095857543 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4c80fe480 0x7fa4c80fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:55.050 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.045+0000 7fa4cf946640 1 -- 172.21.15.122:0/1095857543 >> 172.21.15.122:0/1095857543 conn(0x7fa4c80f9c10 msgr2=0x7fa4c80fc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.045+0000 7fa4cf946640 1 -- 172.21.15.122:0/1095857543 shutdown_connections 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.045+0000 7fa4cf946640 1 -- 172.21.15.122:0/1095857543 wait complete. 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cf946640 1 Processor -- start 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cf946640 1 -- start start 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cf946640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80fe480 0x7fa4c8195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cf946640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4c80ff680 0x7fa4c81963b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cf946640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4c8100040 0x7fa4c819d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cf946640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c819d8d0 con 0x7fa4c80ff680 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cf946640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c819da40 con 0x7fa4c80fe480 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cf946640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c819dc00 con 0x7fa4c8100040 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cd6e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80fe480 0x7fa4c8195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:55.051 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cd6e2640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80fe480 0x7fa4c8195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:34578/0 (socket says 172.21.15.122:34578) 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4cd6e2640 1 -- 172.21.15.122:0/1537304015 learned_addr learned my addr 172.21.15.122:0/1537304015 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.046+0000 7fa4ccee1640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4c80ff680 0x7fa4c81963b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cdee3640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4c8100040 0x7fa4c819d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cd6e2640 1 -- 172.21.15.122:0/1537304015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4c8100040 msgr2=0x7fa4c819d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cd6e2640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4c8100040 0x7fa4c819d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cd6e2640 1 -- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4c80ff680 msgr2=0x7fa4c81963b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cd6e2640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4c80ff680 0x7fa4c81963b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cd6e2640 1 -- 172.21.15.122:0/1537304015 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c0009900 con 0x7fa4c80fe480 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cdee3640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4c8100040 0x7fa4c819d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cd6e2640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80fe480 0x7fa4c8195e70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00d770 tx=0x7fa4bc00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:58:55.052 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4ba7fc640 1 -- 172.21.15.122:0/1537304015 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc009c30 con 0x7fa4c80fe480 2024-09-13T17:58:55.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4ba7fc640 1 -- 172.21.15.122:0/1537304015 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa4bc00de80 con 0x7fa4c80fe480 2024-09-13T17:58:55.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c819dee0 con 0x7fa4c80fe480 2024-09-13T17:58:55.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4ba7fc640 1 -- 172.21.15.122:0/1537304015 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc010460 con 0x7fa4c80fe480 2024-09-13T17:58:55.053 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.047+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c819e2f0 con 0x7fa4c80fe480 2024-09-13T17:58:55.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.048+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c80fe8f0 con 0x7fa4c80fe480 2024-09-13T17:58:55.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.049+0000 7fa4ba7fc640 1 -- 172.21.15.122:0/1537304015 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa4bc003f60 con 0x7fa4c80fe480 2024-09-13T17:58:55.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.049+0000 7fa4ba7fc640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4b40a10b0 0x7fa4b40a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:58:55.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.050+0000 7fa4ba7fc640 1 -- 172.21.15.122:0/1537304015 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fa4bc0cb630 con 0x7fa4c80fe480 2024-09-13T17:58:55.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.050+0000 7fa4ccee1640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4b40a10b0 0x7fa4b40a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:58:55.054 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.051+0000 7fa4ccee1640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4b40a10b0 0x7fa4b40a3570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa4c81972f0 tx=0x7fa4c400b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:58:55.056 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.054+0000 7fa4ba7fc640 1 -- 172.21.15.122:0/1537304015 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4c80fe8f0 con 0x7fa4c80fe480 2024-09-13T17:58:55.228 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:58:55.226+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4c80fe880 con 0x7fa4b40a10b0 2024-09-13T17:58:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:55 smithi027 ceph-mon[30611]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:58:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:55 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi027 2024-09-13T17:58:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:55 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi027 to 5696M 2024-09-13T17:58:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:58:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:58:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:55.576 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:55 smithi122 ceph-mon[35310]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:58:55.576 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:55 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi027 2024-09-13T17:58:55.576 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:55 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi027 to 5696M 2024-09-13T17:58:55.576 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:58:55.576 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:58:55.576 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:55.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:55 smithi143 ceph-mon[38210]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:58:55.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:55 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi027 2024-09-13T17:58:55.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:55 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi027 to 5696M 2024-09-13T17:58:55.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:58:55.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:58:55.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:58:56.499 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:56 smithi122 ceph-mon[35310]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:58:56.499 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:56 smithi122 ceph-mon[35310]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:58:56.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:56 smithi143 ceph-mon[38210]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:58:56.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:56 smithi143 ceph-mon[38210]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:58:56.794 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:56 smithi027 ceph-mon[30611]: from='client.24299 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:58:56.794 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:56 smithi027 ceph-mon[30611]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:58:58.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:58 smithi122 ceph-mon[35310]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:58:58.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:58 smithi122 ceph-mon[35310]: from='client.? 172.21.15.122:0/51681649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b75e0da-1e0f-425c-abd6-36f99a066e11"}]: dispatch 2024-09-13T17:58:58.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:58 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b75e0da-1e0f-425c-abd6-36f99a066e11"}]: dispatch 2024-09-13T17:58:58.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:58 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b75e0da-1e0f-425c-abd6-36f99a066e11"}]': finished 2024-09-13T17:58:58.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:58 smithi122 ceph-mon[35310]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T17:58:58.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:58 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:58:58.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:58:58 smithi122 ceph-mon[35310]: from='client.? 172.21.15.122:0/226846116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:58:58.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:58 smithi143 ceph-mon[38210]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:58:58.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:58 smithi143 ceph-mon[38210]: from='client.? 172.21.15.122:0/51681649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b75e0da-1e0f-425c-abd6-36f99a066e11"}]: dispatch 2024-09-13T17:58:58.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:58 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b75e0da-1e0f-425c-abd6-36f99a066e11"}]: dispatch 2024-09-13T17:58:58.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:58 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b75e0da-1e0f-425c-abd6-36f99a066e11"}]': finished 2024-09-13T17:58:58.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:58 smithi143 ceph-mon[38210]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T17:58:58.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:58 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:58:58.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:58:58 smithi143 ceph-mon[38210]: from='client.? 172.21.15.122:0/226846116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:58:58.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:58 smithi027 ceph-mon[30611]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:58:58.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:58 smithi027 ceph-mon[30611]: from='client.? 172.21.15.122:0/51681649' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b75e0da-1e0f-425c-abd6-36f99a066e11"}]: dispatch 2024-09-13T17:58:58.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:58 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b75e0da-1e0f-425c-abd6-36f99a066e11"}]: dispatch 2024-09-13T17:58:58.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:58 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b75e0da-1e0f-425c-abd6-36f99a066e11"}]': finished 2024-09-13T17:58:58.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:58 smithi027 ceph-mon[30611]: osdmap e49: 8 total, 7 up, 8 in 2024-09-13T17:58:58.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:58 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:58:58.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:58:58 smithi027 ceph-mon[30611]: from='client.? 172.21.15.122:0/226846116' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:59:00.717 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:00 smithi122 ceph-mon[35310]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:00.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:00 smithi143 ceph-mon[38210]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:00.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:00 smithi027 ceph-mon[30611]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:02.537 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:02 smithi122 ceph-mon[35310]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:02.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:02 smithi143 ceph-mon[38210]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:02.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:02 smithi027 ceph-mon[30611]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:04.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:04 smithi122 ceph-mon[35310]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:04.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:04 smithi143 ceph-mon[38210]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:04.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:04 smithi027 ceph-mon[30611]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:05.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T17:59:05.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:05.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:05 smithi122 ceph-mon[35310]: Deploying daemon osd.7 on smithi122 2024-09-13T17:59:05.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T17:59:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:05 smithi143 ceph-mon[38210]: Deploying daemon osd.7 on smithi122 2024-09-13T17:59:05.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-13T17:59:05.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:05.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:05 smithi027 ceph-mon[30611]: Deploying daemon osd.7 on smithi122 2024-09-13T17:59:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:06 smithi027 ceph-mon[30611]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:06.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:06 smithi122 ceph-mon[35310]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:06.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:06 smithi143 ceph-mon[38210]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:08.664 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:08 smithi122 ceph-mon[35310]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:08.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:08 smithi143 ceph-mon[38210]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:08.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:08 smithi027 ceph-mon[30611]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:10.567 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:10 smithi122 ceph-mon[35310]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:10.567 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:10.567 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:10.567 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:10.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:10 smithi143 ceph-mon[38210]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:10.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:10.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:10.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:10 smithi027 ceph-mon[30611]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:12.577 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.573+0000 7fa4ba7fc640 1 -- 172.21.15.122:0/1537304015 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa4c80fe880 con 0x7fa4b40a10b0 2024-09-13T17:59:12.577 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 7 on host 'smithi122' 2024-09-13T17:59:12.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4b40a10b0 msgr2=0x7fa4b40a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:12.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4b40a10b0 0x7fa4b40a3570 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa4c81972f0 tx=0x7fa4c400b590 comp rx=0 tx=0).stop 2024-09-13T17:59:12.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80fe480 msgr2=0x7fa4c8195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:12.578 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80fe480 0x7fa4c8195e70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00d770 tx=0x7fa4bc00dc30 comp rx=0 tx=0).stop 2024-09-13T17:59:12.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 shutdown_connections 2024-09-13T17:59:12.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4b40a10b0 0x7fa4b40a3570 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:12.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4c8100040 0x7fa4c819d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:12.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4c80ff680 0x7fa4c81963b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:12.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 --2- 172.21.15.122:0/1537304015 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4c80fe480 0x7fa4c8195e70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:12.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 >> 172.21.15.122:0/1537304015 conn(0x7fa4c80f9c10 msgr2=0x7fa4c8102a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:59:12.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 shutdown_connections 2024-09-13T17:59:12.579 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T17:59:12.576+0000 7fa4cf946640 1 -- 172.21.15.122:0/1537304015 wait complete. 2024-09-13T17:59:12.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:12 smithi122 ceph-mon[35310]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:12.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:12 smithi143 ceph-mon[38210]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:12.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:12 smithi027 ceph-mon[30611]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:13.272 DEBUG:teuthology.orchestra.run.smithi122:osd.7> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.7.service 2024-09-13T17:59:13.274 INFO:tasks.cephadm:Deploying osd.8 on smithi143 with /dev/vg_nvme/lv_2... 2024-09-13T17:59:13.275 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-09-13T17:59:13.482 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:59:13.570 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 17:59:13 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T17:59:13.358+0000 7fef21bba640 -1 osd.7 0 log_to_monitors true 2024-09-13T17:59:13.825 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:13.825 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:13.825 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:13.825 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:13.826 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:13 smithi143 ceph-mon[38210]: from='osd.7 [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:59:13.826 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:13 smithi143 ceph-mon[38210]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:59:13.933 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:13.933 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:13.933 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:13.933 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:13.933 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:13 smithi122 ceph-mon[35310]: from='osd.7 [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:59:13.934 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:13 smithi122 ceph-mon[35310]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:59:14.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:14.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:14.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:14.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:14.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:13 smithi027 ceph-mon[30611]: from='osd.7 [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:59:14.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:13 smithi027 ceph-mon[30611]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-13T17:59:14.767 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:14 smithi122 ceph-mon[35310]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:14.767 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:14 smithi122 ceph-mon[35310]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T17:59:14.767 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:14 smithi122 ceph-mon[35310]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T17:59:14.767 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:14 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:14.767 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:14 smithi122 ceph-mon[35310]: from='osd.7 [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:59:14.767 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:14 smithi122 ceph-mon[35310]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:59:14.828 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:14 smithi143 ceph-mon[38210]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:14.828 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:14 smithi143 ceph-mon[38210]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T17:59:14.828 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:14 smithi143 ceph-mon[38210]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T17:59:14.829 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:14 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:14.829 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:14 smithi143 ceph-mon[38210]: from='osd.7 [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:59:14.829 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:14 smithi143 ceph-mon[38210]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:59:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:14 smithi027 ceph-mon[30611]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:14 smithi027 ceph-mon[30611]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-13T17:59:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:14 smithi027 ceph-mon[30611]: osdmap e50: 8 total, 7 up, 8 in 2024-09-13T17:59:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:14 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:14 smithi027 ceph-mon[30611]: from='osd.7 [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:59:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:14 smithi027 ceph-mon[30611]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T17:59:15.521 INFO:teuthology.orchestra.run.smithi143.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-09-13T17:59:15.614 INFO:teuthology.orchestra.run.smithi143.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-09-13T17:59:15.627 INFO:teuthology.orchestra.run.smithi143.stderr: stderr: 10+0 records in 2024-09-13T17:59:15.627 INFO:teuthology.orchestra.run.smithi143.stderr:10+0 records out 2024-09-13T17:59:15.627 INFO:teuthology.orchestra.run.smithi143.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114879 s, 913 MB/s 2024-09-13T17:59:15.627 INFO:teuthology.orchestra.run.smithi143.stderr:--> Zapping successful for: 2024-09-13T17:59:16.376 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:16 smithi143 ceph-mon[38210]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:16.376 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:16 smithi143 ceph-mon[38210]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T17:59:16.377 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:16 smithi143 ceph-mon[38210]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T17:59:16.377 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:16.377 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:16 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:16.377 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:16 smithi143 ceph-mon[38210]: from='osd.7 ' entity='osd.7' 2024-09-13T17:59:16.378 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi143:vg_nvme/lv_2 2024-09-13T17:59:16.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:16 smithi122 ceph-mon[35310]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:16.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:16 smithi122 ceph-mon[35310]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T17:59:16.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:16 smithi122 ceph-mon[35310]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T17:59:16.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:16.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:16 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:16.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:16 smithi122 ceph-mon[35310]: from='osd.7 ' entity='osd.7' 2024-09-13T17:59:16.465 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 17:59:16 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T17:59:16.165+0000 7fef1d318640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T17:59:16.465 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 17:59:16 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T17:59:16.180+0000 7fef1594b640 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:59:16.575 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T17:59:16.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:16 smithi027 ceph-mon[30611]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:16.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:16 smithi027 ceph-mon[30611]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T17:59:16.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:16 smithi027 ceph-mon[30611]: osdmap e51: 8 total, 7 up, 8 in 2024-09-13T17:59:16.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:16.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:16 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:16.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:16 smithi027 ceph-mon[30611]: from='osd.7 ' entity='osd.7' 2024-09-13T17:59:17.628 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T17:59:17.629 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T17:59:17.629 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: osd.7 [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] boot 2024-09-13T17:59:17.629 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T17:59:17.629 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:17.629 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi122 2024-09-13T17:59:17.629 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.629 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.629 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:17.629 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi122 to 5695M 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.630 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:17 smithi143 ceph-mon[38210]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T17:59:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T17:59:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T17:59:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: osd.7 [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] boot 2024-09-13T17:59:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T17:59:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi122 2024-09-13T17:59:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi122 to 5695M 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:17 smithi122 ceph-mon[35310]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T17:59:17.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T17:59:17.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T17:59:17.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: osd.7 [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] boot 2024-09-13T17:59:17.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: osdmap e52: 8 total, 8 up, 8 in 2024-09-13T17:59:17.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-13T17:59:17.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi122 2024-09-13T17:59:17.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi122 to 5695M 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:17.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:17 smithi027 ceph-mon[30611]: osdmap e53: 8 total, 8 up, 8 in 2024-09-13T17:59:18.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 -- 172.21.15.143:0/994404017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e240ffee0 msgr2=0x7f3e24100360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:18.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/994404017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e240ffee0 0x7f3e24100360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009900 tx=0x7f3e0c02a410 comp rx=0 tx=0).stop 2024-09-13T17:59:18.100 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 -- 172.21.15.143:0/994404017 shutdown_connections 2024-09-13T17:59:18.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/994404017 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e241008a0 0x7f3e24107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:18.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/994404017 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e240ffee0 0x7f3e24100360 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:18.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/994404017 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e240fece0 0x7f3e240ff0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:18.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 -- 172.21.15.143:0/994404017 >> 172.21.15.143:0/994404017 conn(0x7f3e240fa490 msgr2=0x7f3e240fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:59:18.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 -- 172.21.15.143:0/994404017 shutdown_connections 2024-09-13T17:59:18.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 -- 172.21.15.143:0/994404017 wait complete. 2024-09-13T17:59:18.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 Processor -- start 2024-09-13T17:59:18.101 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.098+0000 7f3e29cf3640 1 -- start start 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e29cf3640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e240fece0 0x7f3e24195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e29cf3640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e240ffee0 0x7f3e241963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e29cf3640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e241008a0 0x7f3e2419d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e29cf3640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2419d9a0 con 0x7f3e240ffee0 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e29cf3640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2419db10 con 0x7f3e240fece0 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e29cf3640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2419dcd0 con 0x7f3e241008a0 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e241008a0 0x7f3e2419d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e237fe640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e240fece0 0x7f3e24195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e23fff640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e241008a0 0x7f3e2419d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40062/0 (socket says 172.21.15.143:40062) 2024-09-13T17:59:18.106 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e23fff640 1 -- 172.21.15.143:0/4035752473 learned_addr learned my addr 172.21.15.143:0/4035752473 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e1affd640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e240ffee0 0x7f3e241963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e237fe640 1 -- 172.21.15.143:0/4035752473 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e241008a0 msgr2=0x7f3e2419d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e237fe640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e241008a0 0x7f3e2419d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e237fe640 1 -- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e240ffee0 msgr2=0x7f3e241963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e237fe640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e240ffee0 0x7f3e241963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e237fe640 1 -- 172.21.15.143:0/4035752473 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0c009560 con 0x7f3e240fece0 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e23fff640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e241008a0 0x7f3e2419d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.099+0000 7f3e237fe640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e240fece0 0x7f3e24195ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c940 tx=0x7f3e1400ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.100+0000 7f3e217fa640 1 -- 172.21.15.143:0/4035752473 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14004220 con 0x7f3e240fece0 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.100+0000 7f3e217fa640 1 -- 172.21.15.143:0/4035752473 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3e14007e90 con 0x7f3e240fece0 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.100+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e2419dfb0 con 0x7f3e240fece0 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.100+0000 7f3e217fa640 1 -- 172.21.15.143:0/4035752473 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1400f450 con 0x7f3e240fece0 2024-09-13T17:59:18.107 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.100+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e2419e3c0 con 0x7f3e240fece0 2024-09-13T17:59:18.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.101+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e2410a750 con 0x7f3e240fece0 2024-09-13T17:59:18.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.102+0000 7f3e217fa640 1 -- 172.21.15.143:0/4035752473 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3e140079b0 con 0x7f3e240fece0 2024-09-13T17:59:18.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.102+0000 7f3e217fa640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3e100a10b0 0x7f3e100a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:59:18.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.103+0000 7f3e217fa640 1 -- 172.21.15.143:0/4035752473 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f3e140cb990 con 0x7f3e240fece0 2024-09-13T17:59:18.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.103+0000 7f3e1affd640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3e100a10b0 0x7f3e100a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:59:18.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.103+0000 7f3e1affd640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3e100a10b0 0x7f3e100a3570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c006010 tx=0x7f3e0c0314d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:59:18.108 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.105+0000 7f3e217fa640 1 -- 172.21.15.143:0/4035752473 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3e14095c40 con 0x7f3e240fece0 2024-09-13T17:59:18.280 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:18.278+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e2419e610 con 0x7f3e100a10b0 2024-09-13T17:59:19.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:19 smithi143 ceph-mon[38210]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:19.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:19 smithi143 ceph-mon[38210]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T17:59:19.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:19 smithi143 ceph-mon[38210]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:59:19.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:59:19.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:59:19.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:19.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:19 smithi027 ceph-mon[30611]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:19.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:19 smithi027 ceph-mon[30611]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T17:59:19.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:19 smithi027 ceph-mon[30611]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:59:19.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:59:19.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:59:19.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:19 smithi122 ceph-mon[35310]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-09-13T17:59:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:19 smithi122 ceph-mon[35310]: osdmap e54: 8 total, 8 up, 8 in 2024-09-13T17:59:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:19 smithi122 ceph-mon[35310]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:59:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:59:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:59:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:20.219 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:20 smithi143 ceph-mon[38210]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T17:59:20.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:20 smithi027 ceph-mon[30611]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T17:59:20.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:20 smithi122 ceph-mon[35310]: osdmap e55: 8 total, 8 up, 8 in 2024-09-13T17:59:21.033 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:21 smithi143 ceph-mon[38210]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:21.033 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:21 smithi143 ceph-mon[38210]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T17:59:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:21 smithi027 ceph-mon[30611]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:21 smithi027 ceph-mon[30611]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T17:59:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:21 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/3873588337' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba26500a-70ee-4016-bbbe-6b625a329bd7"}]: dispatch 2024-09-13T17:59:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:21 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba26500a-70ee-4016-bbbe-6b625a329bd7"}]: dispatch 2024-09-13T17:59:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:21 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba26500a-70ee-4016-bbbe-6b625a329bd7"}]': finished 2024-09-13T17:59:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:21 smithi027 ceph-mon[30611]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T17:59:21.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:21.365 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:21 smithi122 ceph-mon[35310]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:21.365 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:21 smithi122 ceph-mon[35310]: osdmap e56: 8 total, 8 up, 8 in 2024-09-13T17:59:21.365 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:21 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/3873588337' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba26500a-70ee-4016-bbbe-6b625a329bd7"}]: dispatch 2024-09-13T17:59:21.365 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:21 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba26500a-70ee-4016-bbbe-6b625a329bd7"}]: dispatch 2024-09-13T17:59:21.365 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:21 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba26500a-70ee-4016-bbbe-6b625a329bd7"}]': finished 2024-09-13T17:59:21.365 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:21 smithi122 ceph-mon[35310]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T17:59:21.365 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:21.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:21 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/3873588337' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba26500a-70ee-4016-bbbe-6b625a329bd7"}]: dispatch 2024-09-13T17:59:21.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:21 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba26500a-70ee-4016-bbbe-6b625a329bd7"}]: dispatch 2024-09-13T17:59:21.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:21 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba26500a-70ee-4016-bbbe-6b625a329bd7"}]': finished 2024-09-13T17:59:21.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:21 smithi143 ceph-mon[38210]: osdmap e57: 9 total, 8 up, 9 in 2024-09-13T17:59:21.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:22.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:22 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/3603248904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:59:22.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:22 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/3603248904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:59:22.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:22 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/3603248904' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:59:23.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:23 smithi027 ceph-mon[30611]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:23.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:23 smithi122 ceph-mon[35310]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:23 smithi143 ceph-mon[38210]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:25.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:25 smithi143 ceph-mon[38210]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:25.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:25 smithi027 ceph-mon[30611]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:25.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:25 smithi122 ceph-mon[35310]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:27.188 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:27 smithi143 ceph-mon[38210]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:27.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:27 smithi027 ceph-mon[30611]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:27.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:27 smithi122 ceph-mon[35310]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:28.211 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:28 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T17:59:28.211 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:28 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:28.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:28 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T17:59:28.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:28 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:28.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:28 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-13T17:59:28.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:28 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:29.125 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:29 smithi143 ceph-mon[38210]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:29.125 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:29 smithi143 ceph-mon[38210]: Deploying daemon osd.8 on smithi143 2024-09-13T17:59:29.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:29 smithi122 ceph-mon[35310]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:29.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:29 smithi122 ceph-mon[35310]: Deploying daemon osd.8 on smithi143 2024-09-13T17:59:29.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:29 smithi027 ceph-mon[30611]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:29.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:29 smithi027 ceph-mon[30611]: Deploying daemon osd.8 on smithi143 2024-09-13T17:59:31.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:31 smithi143 ceph-mon[38210]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:31.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:31 smithi122 ceph-mon[35310]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:31.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:31 smithi027 ceph-mon[30611]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:33.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:33 smithi143 ceph-mon[38210]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:33.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:33 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:33.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:33 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:33.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:33 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:33.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:33 smithi122 ceph-mon[35310]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:33.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:33 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:33.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:33 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:33.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:33 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:33 smithi027 ceph-mon[30611]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:33 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:33 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:33 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:35.166 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:35 smithi143 ceph-mon[38210]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:35.200 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.198+0000 7f3e217fa640 1 -- 172.21.15.143:0/4035752473 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3e2419e610 con 0x7f3e100a10b0 2024-09-13T17:59:35.200 INFO:teuthology.orchestra.run.smithi143.stdout:Created osd(s) 8 on host 'smithi143' 2024-09-13T17:59:35.202 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3e100a10b0 msgr2=0x7f3e100a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3e100a10b0 0x7f3e100a3570 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c006010 tx=0x7f3e0c0314d0 comp rx=0 tx=0).stop 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e240fece0 msgr2=0x7f3e24195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e240fece0 0x7f3e24195ea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c940 tx=0x7f3e1400ce00 comp rx=0 tx=0).stop 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 shutdown_connections 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3e100a10b0 0x7f3e100a3570 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3e241008a0 0x7f3e2419d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3e240ffee0 0x7f3e241963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 --2- 172.21.15.143:0/4035752473 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3e240fece0 0x7f3e24195ea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 >> 172.21.15.143:0/4035752473 conn(0x7f3e240fa490 msgr2=0x7f3e24067f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 shutdown_connections 2024-09-13T17:59:35.203 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T17:59:35.200+0000 7f3e29cf3640 1 -- 172.21.15.143:0/4035752473 wait complete. 2024-09-13T17:59:35.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:35 smithi122 ceph-mon[35310]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:35 smithi027 ceph-mon[30611]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:36.152 DEBUG:teuthology.orchestra.run.smithi143:osd.8> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.8.service 2024-09-13T17:59:36.154 INFO:tasks.cephadm:Deploying osd.9 on smithi027 with /dev/vg_nvme/lv_1... 2024-09-13T17:59:36.154 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T17:59:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:36 smithi122 ceph-mon[35310]: from='osd.8 [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:59:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:36 smithi122 ceph-mon[35310]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:59:36.492 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:59:36.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:36.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:36.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:36 smithi143 ceph-mon[38210]: from='osd.8 [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:59:36.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:36 smithi143 ceph-mon[38210]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:59:36.528 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 17:59:36 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T17:59:36.184+0000 7fb5ecfd1640 -1 osd.8 0 log_to_monitors true 2024-09-13T17:59:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:36 smithi027 ceph-mon[30611]: from='osd.8 [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:59:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:36 smithi027 ceph-mon[30611]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-13T17:59:37.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T17:59:37.216+0000 7fb5e872f640 -1 osd.8 0 waiting for initial osdmap 2024-09-13T17:59:37.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T17:59:37.229+0000 7fb5e4d6a640 -1 osd.8 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T17:59:37.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-mon[38210]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:37.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-mon[38210]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T17:59:37.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-mon[38210]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T17:59:37.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:37.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-mon[38210]: from='osd.8 [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:59:37.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-mon[38210]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:59:37.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:37.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:37.545 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:37 smithi027 ceph-mon[30611]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:37.546 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:37 smithi027 ceph-mon[30611]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T17:59:37.546 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:37 smithi027 ceph-mon[30611]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T17:59:37.546 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:37.546 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:37 smithi027 ceph-mon[30611]: from='osd.8 [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:59:37.546 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:37 smithi027 ceph-mon[30611]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:59:37.546 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:37.546 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:37 smithi122 ceph-mon[35310]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:37 smithi122 ceph-mon[35310]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-13T17:59:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:37 smithi122 ceph-mon[35310]: osdmap e58: 9 total, 8 up, 9 in 2024-09-13T17:59:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:37 smithi122 ceph-mon[35310]: from='osd.8 [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:59:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:37 smithi122 ceph-mon[35310]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T17:59:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:38.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:38 smithi027 ceph-mon[30611]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T17:59:38.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:38 smithi027 ceph-mon[30611]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T17:59:38.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:38.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:38.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:38 smithi027 ceph-mon[30611]: osd.8 [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] boot 2024-09-13T17:59:38.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:38 smithi027 ceph-mon[30611]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T17:59:38.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:38.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:38 smithi143 ceph-mon[38210]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T17:59:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:38 smithi143 ceph-mon[38210]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T17:59:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:38 smithi143 ceph-mon[38210]: osd.8 [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] boot 2024-09-13T17:59:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:38 smithi143 ceph-mon[38210]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T17:59:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:38.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:38 smithi122 ceph-mon[35310]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T17:59:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:38 smithi122 ceph-mon[35310]: osdmap e59: 9 total, 8 up, 9 in 2024-09-13T17:59:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:38 smithi122 ceph-mon[35310]: osd.8 [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] boot 2024-09-13T17:59:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:38 smithi122 ceph-mon[35310]: osdmap e60: 9 total, 9 up, 9 in 2024-09-13T17:59:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-13T17:59:39.134 INFO:teuthology.orchestra.run.smithi027.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T17:59:39.282 INFO:teuthology.orchestra.run.smithi027.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T17:59:39.324 INFO:teuthology.orchestra.run.smithi027.stderr: stderr: 10+0 records in 2024-09-13T17:59:39.325 INFO:teuthology.orchestra.run.smithi027.stderr:10+0 records out 2024-09-13T17:59:39.325 INFO:teuthology.orchestra.run.smithi027.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0369176 s, 284 MB/s 2024-09-13T17:59:39.329 INFO:teuthology.orchestra.run.smithi027.stderr:--> Zapping successful for: 2024-09-13T17:59:39.402 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:39 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T17:59:39.402 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:39 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T17:59:39.403 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:39 smithi027 ceph-mon[30611]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:39.403 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:39 smithi027 ceph-mon[30611]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T17:59:39.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:39 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T17:59:39.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:39 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T17:59:39.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:39 smithi143 ceph-mon[38210]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:39.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:39 smithi143 ceph-mon[38210]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T17:59:39.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:39 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T17:59:39.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:39 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T17:59:39.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:39 smithi122 ceph-mon[35310]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-09-13T17:59:39.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:39 smithi122 ceph-mon[35310]: osdmap e61: 9 total, 9 up, 9 in 2024-09-13T17:59:40.212 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi027:vg_nvme/lv_1 2024-09-13T17:59:40.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi143 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi143 to 5696M 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:40 smithi143 ceph-mon[38210]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T17:59:40.538 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T17:59:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi143 2024-09-13T17:59:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi143 to 5696M 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:40.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.559 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:40 smithi027 ceph-mon[30611]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T17:59:40.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi143 2024-09-13T17:59:40.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi143 to 5696M 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T17:59:40.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:40 smithi122 ceph-mon[35310]: osdmap e62: 9 total, 9 up, 9 in 2024-09-13T17:59:41.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:41 smithi027 ceph-mon[30611]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:41.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:41 smithi143 ceph-mon[38210]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:41.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:41 smithi122 ceph-mon[35310]: pgmap v203: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:42.400 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:42 smithi027 ceph-mon[30611]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T17:59:42.518 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.515+0000 7ff3f5400640 1 -- 172.21.15.27:0/3850401423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3f0103bb0 msgr2=0x7ff3f010a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.515+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3850401423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3f0103bb0 0x7ff3f010a440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009ca0 tx=0x7ff3e802a8c0 comp rx=0 tx=0).stop 2024-09-13T17:59:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.515+0000 7ff3f5400640 1 -- 172.21.15.27:0/3850401423 shutdown_connections 2024-09-13T17:59:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.515+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3850401423 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3f0103bb0 0x7ff3f010a440 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.515+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3850401423 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3f01031f0 0x7ff3f0103670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.515+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3850401423 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f0101ff0 0x7ff3f01023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.515+0000 7ff3f5400640 1 -- 172.21.15.27:0/3850401423 >> 172.21.15.27:0/3850401423 conn(0x7ff3f00fd7a0 msgr2=0x7ff3f00ffbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T17:59:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.515+0000 7ff3f5400640 1 -- 172.21.15.27:0/3850401423 shutdown_connections 2024-09-13T17:59:42.519 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.515+0000 7ff3f5400640 1 -- 172.21.15.27:0/3850401423 wait complete. 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.516+0000 7ff3f5400640 1 Processor -- start 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.516+0000 7ff3f5400640 1 -- start start 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3f5400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3f0101ff0 0x7ff3f0197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3f5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f01031f0 0x7ff3f0198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3f5400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3f0103bb0 0x7ff3f019f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3f5400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f019faf0 con 0x7ff3f0103bb0 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3f5400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f019fc60 con 0x7ff3f01031f0 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3f5400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f019fe20 con 0x7ff3f0101ff0 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3ee800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3f0101ff0 0x7ff3f0197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3ef200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3f0103bb0 0x7ff3f019f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:59:42.521 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3ee800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3f0101ff0 0x7ff3f0197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:41872/0 (socket says 172.21.15.27:41872) 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3ee800640 1 -- 172.21.15.27:0/3257501137 learned_addr learned my addr 172.21.15.27:0/3257501137 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.517+0000 7ff3e5e00640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f01031f0 0x7ff3f0198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3ee800640 1 -- 172.21.15.27:0/3257501137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f01031f0 msgr2=0x7ff3f0198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3ee800640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f01031f0 0x7ff3f0198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3ee800640 1 -- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3f0103bb0 msgr2=0x7ff3f019f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3ee800640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3f0103bb0 0x7ff3f019f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3ee800640 1 -- 172.21.15.27:0/3257501137 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8009900 con 0x7ff3f0101ff0 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3ef200640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3f0103bb0 0x7ff3f019f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3e5e00640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f01031f0 0x7ff3f0198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T17:59:42.522 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3ee800640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3f0101ff0 0x7ff3f0197ff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000e9c0 tx=0x7ff3e000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:59:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3e7e00640 1 -- 172.21.15.27:0/3257501137 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0009700 con 0x7ff3f0101ff0 2024-09-13T17:59:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3e7e00640 1 -- 172.21.15.27:0/3257501137 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff3e000cd80 con 0x7ff3f0101ff0 2024-09-13T17:59:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f01a0100 con 0x7ff3f0101ff0 2024-09-13T17:59:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.518+0000 7ff3e7e00640 1 -- 172.21.15.27:0/3257501137 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e0010430 con 0x7ff3f0101ff0 2024-09-13T17:59:42.523 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.519+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f01a0600 con 0x7ff3f0101ff0 2024-09-13T17:59:42.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.520+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f0109370 con 0x7ff3f0101ff0 2024-09-13T17:59:42.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.522+0000 7ff3e7e00640 1 -- 172.21.15.27:0/3257501137 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff3e0003680 con 0x7ff3f0101ff0 2024-09-13T17:59:42.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:42 smithi143 ceph-mon[38210]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T17:59:42.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.523+0000 7ff3e7e00640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff3d40a10b0 0x7ff3d40a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T17:59:42.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.523+0000 7ff3e7e00640 1 -- 172.21.15.27:0/3257501137 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5829+0+0 (secure 0 0 0) 0x7ff3e0014070 con 0x7ff3f0101ff0 2024-09-13T17:59:42.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.524+0000 7ff3e5e00640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff3d40a10b0 0x7ff3d40a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T17:59:42.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.524+0000 7ff3e5e00640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff3d40a10b0 0x7ff3d40a3570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0199510 tx=0x7ff3d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T17:59:42.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.526+0000 7ff3e7e00640 1 -- 172.21.15.27:0/3257501137 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff3e0096b80 con 0x7ff3f0101ff0 2024-09-13T17:59:42.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:42 smithi122 ceph-mon[35310]: osdmap e63: 9 total, 9 up, 9 in 2024-09-13T17:59:42.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T17:59:42.714+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3f002c480 con 0x7ff3d40a10b0 2024-09-13T17:59:43.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:43 smithi143 ceph-mon[38210]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:43.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:43 smithi143 ceph-mon[38210]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T17:59:43.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:59:43.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:59:43.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:43.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:43 smithi027 ceph-mon[30611]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:43.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:43 smithi027 ceph-mon[30611]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T17:59:43.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:59:43.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:59:43.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:43.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:43 smithi122 ceph-mon[35310]: pgmap v206: 1 pgs: 1 peering; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:43.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:43 smithi122 ceph-mon[35310]: osdmap e64: 9 total, 9 up, 9 in 2024-09-13T17:59:43.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T17:59:43.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T17:59:43.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:44.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:44 smithi027 ceph-mon[30611]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:59:44.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:44 smithi143 ceph-mon[38210]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:59:44.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:44 smithi122 ceph-mon[35310]: from='client.24343 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi027:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T17:59:45.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:45 smithi027 ceph-mon[30611]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-13T17:59:45.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:45 smithi122 ceph-mon[35310]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-13T17:59:45.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:45 smithi143 ceph-mon[38210]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 139 KiB/s, 0 objects/s recovering 2024-09-13T17:59:46.430 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:46 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2713441317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6044d334-8e68-415d-b23b-ca534e3fdd5b"}]: dispatch 2024-09-13T17:59:46.430 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:46 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2713441317' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6044d334-8e68-415d-b23b-ca534e3fdd5b"}]': finished 2024-09-13T17:59:46.431 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:46 smithi027 ceph-mon[30611]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T17:59:46.431 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:59:46.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:46 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2713441317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6044d334-8e68-415d-b23b-ca534e3fdd5b"}]: dispatch 2024-09-13T17:59:46.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:46 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2713441317' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6044d334-8e68-415d-b23b-ca534e3fdd5b"}]': finished 2024-09-13T17:59:46.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:46 smithi122 ceph-mon[35310]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T17:59:46.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:59:46.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:46 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2713441317' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6044d334-8e68-415d-b23b-ca534e3fdd5b"}]: dispatch 2024-09-13T17:59:46.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:46 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2713441317' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6044d334-8e68-415d-b23b-ca534e3fdd5b"}]': finished 2024-09-13T17:59:46.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:46 smithi143 ceph-mon[38210]: osdmap e65: 10 total, 9 up, 10 in 2024-09-13T17:59:46.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T17:59:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:47 smithi027 ceph-mon[30611]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:59:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:47 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3605914133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:59:47.677 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:47 smithi143 ceph-mon[38210]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:59:47.677 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:47 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3605914133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:59:47.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:47 smithi122 ceph-mon[35310]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T17:59:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:47 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3605914133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T17:59:49.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:49 smithi027 ceph-mon[30611]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-13T17:59:49.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:49 smithi122 ceph-mon[35310]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-13T17:59:49.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:49 smithi143 ceph-mon[38210]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-13T17:59:51.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:51 smithi027 ceph-mon[30611]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:59:51.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:51 smithi122 ceph-mon[35310]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:59:51.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:51 smithi143 ceph-mon[38210]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T17:59:53.508 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:53 smithi027 ceph-mon[30611]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-13T17:59:53.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:53 smithi122 ceph-mon[35310]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-13T17:59:53.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:53 smithi143 ceph-mon[38210]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 63 KiB/s, 0 objects/s recovering 2024-09-13T17:59:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:55 smithi027 ceph-mon[30611]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T17:59:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:55 smithi027 ceph-mon[30611]: Deploying daemon osd.9 on smithi027 2024-09-13T17:59:55.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:55 smithi122 ceph-mon[35310]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:55.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T17:59:55.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:55.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:55 smithi122 ceph-mon[35310]: Deploying daemon osd.9 on smithi027 2024-09-13T17:59:55.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:55 smithi143 ceph-mon[38210]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:55.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-13T17:59:55.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T17:59:55.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:55 smithi143 ceph-mon[38210]: Deploying daemon osd.9 on smithi027 2024-09-13T17:59:57.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:57 smithi027 ceph-mon[30611]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:57.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:57 smithi122 ceph-mon[35310]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:57.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:57 smithi143 ceph-mon[38210]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:59.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 17:59:59 smithi027 ceph-mon[30611]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:59.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 17:59:59 smithi122 ceph-mon[35310]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T17:59:59.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 17:59:59 smithi143 ceph-mon[38210]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:00.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:00 smithi122 ceph-mon[35310]: overall HEALTH_OK 2024-09-13T18:00:00.761 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:00 smithi027 ceph-mon[30611]: overall HEALTH_OK 2024-09-13T18:00:00.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:00 smithi143 ceph-mon[38210]: overall HEALTH_OK 2024-09-13T18:00:01.599 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:01 smithi027 ceph-mon[30611]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:01.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:01.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:01.600 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:01 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:01.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:01 smithi122 ceph-mon[35310]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:01.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:01.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:01.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:01 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:01.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:01 smithi143 ceph-mon[38210]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:01.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:01.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:01.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:01 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:03.657 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:03 smithi027 ceph-mon[30611]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:03.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:03 smithi122 ceph-mon[35310]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:03.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:03 smithi143 ceph-mon[38210]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:05.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:05 smithi027 ceph-mon[30611]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:05.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:05.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:05.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:05.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:05.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:05 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:05.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:05 smithi027 ceph-mon[30611]: from='osd.9 [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T18:00:05.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:05 smithi027 ceph-mon[30611]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T18:00:05.611 INFO:teuthology.orchestra.run.smithi027.stdout:Created osd(s) 9 on host 'smithi027' 2024-09-13T18:00:05.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.608+0000 7ff3e7e00640 1 -- 172.21.15.27:0/3257501137 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff3f002c480 con 0x7ff3d40a10b0 2024-09-13T18:00:05.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff3d40a10b0 msgr2=0x7ff3d40a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:05.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff3d40a10b0 0x7ff3d40a3570 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0199510 tx=0x7ff3d800b390 comp rx=0 tx=0).stop 2024-09-13T18:00:05.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3f0101ff0 msgr2=0x7ff3f0197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:05.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3f0101ff0 0x7ff3f0197ff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000e9c0 tx=0x7ff3e000ee80 comp rx=0 tx=0).stop 2024-09-13T18:00:05.614 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 shutdown_connections 2024-09-13T18:00:05.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff3d40a10b0 0x7ff3d40a3570 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:05.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff3f0103bb0 0x7ff3f019f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:05.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff3f01031f0 0x7ff3f0198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:05.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 --2- 172.21.15.27:0/3257501137 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff3f0101ff0 0x7ff3f0197ff0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:05.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 >> 172.21.15.27:0/3257501137 conn(0x7ff3f00fd7a0 msgr2=0x7ff3f0106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:00:05.615 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 shutdown_connections 2024-09-13T18:00:05.616 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:05.611+0000 7ff3f5400640 1 -- 172.21.15.27:0/3257501137 wait complete. 2024-09-13T18:00:05.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:05 smithi122 ceph-mon[35310]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:05.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:05.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:05.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:05.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:05.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:05 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:05.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:05 smithi122 ceph-mon[35310]: from='osd.9 [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T18:00:05.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:05 smithi122 ceph-mon[35310]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T18:00:05.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:05 smithi143 ceph-mon[38210]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:05 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:05 smithi143 ceph-mon[38210]: from='osd.9 [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T18:00:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:05 smithi143 ceph-mon[38210]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-13T18:00:06.304 DEBUG:teuthology.orchestra.run.smithi027:osd.9> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.9.service 2024-09-13T18:00:06.308 INFO:tasks.cephadm:Deploying osd.10 on smithi122 with /dev/vg_nvme/lv_1... 2024-09-13T18:00:06.308 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T18:00:06.521 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:00:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:06 smithi027 ceph-mon[30611]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T18:00:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:06 smithi027 ceph-mon[30611]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T18:00:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:06 smithi027 ceph-mon[30611]: from='osd.9 [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T18:00:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:06 smithi027 ceph-mon[30611]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T18:00:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:06.642 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:06.642 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:06 smithi122 ceph-mon[35310]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T18:00:06.642 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:06 smithi122 ceph-mon[35310]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T18:00:06.642 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:06.642 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:06 smithi122 ceph-mon[35310]: from='osd.9 [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T18:00:06.642 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:06.642 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:06 smithi122 ceph-mon[35310]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T18:00:06.642 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:06.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:06.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:06 smithi143 ceph-mon[38210]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-13T18:00:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:06 smithi143 ceph-mon[38210]: osdmap e66: 10 total, 9 up, 10 in 2024-09-13T18:00:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:06 smithi143 ceph-mon[38210]: from='osd.9 [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T18:00:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:06 smithi143 ceph-mon[38210]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]: dispatch 2024-09-13T18:00:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:07.515 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:07 smithi027 ceph-mon[30611]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:07.515 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:07 smithi027 ceph-mon[30611]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T18:00:07.515 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:07 smithi027 ceph-mon[30611]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T18:00:07.516 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:07.516 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:07.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:07 smithi122 ceph-mon[35310]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:07.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:07 smithi122 ceph-mon[35310]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T18:00:07.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:07 smithi122 ceph-mon[35310]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T18:00:07.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:07.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:07.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:07 smithi143 ceph-mon[38210]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:07.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:07 smithi143 ceph-mon[38210]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi027", "root=default"]}]': finished 2024-09-13T18:00:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:07 smithi143 ceph-mon[38210]: osdmap e67: 10 total, 9 up, 10 in 2024-09-13T18:00:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:07.807 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:00:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:00:07.560+0000 7fb086a00640 -1 osd.9 0 waiting for initial osdmap 2024-09-13T18:00:07.807 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:00:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:00:07.600+0000 7fb07d400640 -1 osd.9 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:00:08.347 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T18:00:08.433 INFO:teuthology.orchestra.run.smithi122.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T18:00:08.446 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10+0 records in 2024-09-13T18:00:08.446 INFO:teuthology.orchestra.run.smithi122.stderr:10+0 records out 2024-09-13T18:00:08.446 INFO:teuthology.orchestra.run.smithi122.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110112 s, 952 MB/s 2024-09-13T18:00:08.446 INFO:teuthology.orchestra.run.smithi122.stderr:--> Zapping successful for: 2024-09-13T18:00:08.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:08 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T18:00:08.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:08 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T18:00:08.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:08 smithi122 ceph-mon[35310]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:08.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:08 smithi122 ceph-mon[35310]: from='osd.9 ' entity='osd.9' 2024-09-13T18:00:08.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:08 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:08 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T18:00:08.980 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:08 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T18:00:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:08 smithi027 ceph-mon[30611]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:08 smithi027 ceph-mon[30611]: from='osd.9 ' entity='osd.9' 2024-09-13T18:00:08.981 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:08 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:09.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:08 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T18:00:09.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:08 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T18:00:09.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:08 smithi143 ceph-mon[38210]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-09-13T18:00:09.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:08 smithi143 ceph-mon[38210]: from='osd.9 ' entity='osd.9' 2024-09-13T18:00:09.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:08 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:09.164 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi122:vg_nvme/lv_1 2024-09-13T18:00:09.361 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:00:09.827 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:09 smithi122 ceph-mon[35310]: osd.9 [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] boot 2024-09-13T18:00:09.828 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:09 smithi122 ceph-mon[35310]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T18:00:09.828 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:10.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:09 smithi143 ceph-mon[38210]: osd.9 [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] boot 2024-09-13T18:00:10.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:09 smithi143 ceph-mon[38210]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T18:00:10.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:10.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:09 smithi027 ceph-mon[30611]: osd.9 [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] boot 2024-09-13T18:00:10.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:09 smithi027 ceph-mon[30611]: osdmap e68: 10 total, 10 up, 10 in 2024-09-13T18:00:10.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-13T18:00:10.741 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:10.741 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi027 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi027 to 4272M 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:10.742 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T18:00:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi027 2024-09-13T18:00:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:10.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:10.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:10.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi027 to 4272M 2024-09-13T18:00:10.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:10.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:10.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:10.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:10.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.939+0000 7f8274d9b640 1 -- 172.21.15.122:0/2513771295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 msgr2=0x7f8270108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:10.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.939+0000 7f8274d9b640 1 --2- 172.21.15.122:0/2513771295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 0x7f8270108240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8268009ca0 tx=0x7f826802a8c0 comp rx=0 tx=0).stop 2024-09-13T18:00:10.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.939+0000 7f8274d9b640 1 -- 172.21.15.122:0/2513771295 shutdown_connections 2024-09-13T18:00:10.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.939+0000 7f8274d9b640 1 --2- 172.21.15.122:0/2513771295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 0x7f8270108240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:10.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.939+0000 7f8274d9b640 1 --2- 172.21.15.122:0/2513771295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8270100f60 0x7f82701013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:10.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.939+0000 7f8274d9b640 1 --2- 172.21.15.122:0/2513771295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f82700ffe00 0x7f8270100200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:10.944 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.939+0000 7f8274d9b640 1 -- 172.21.15.122:0/2513771295 >> 172.21.15.122:0/2513771295 conn(0x7f82700fb5d0 msgr2=0x7f82700fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.939+0000 7f8274d9b640 1 -- 172.21.15.122:0/2513771295 shutdown_connections 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.939+0000 7f8274d9b640 1 -- 172.21.15.122:0/2513771295 wait complete. 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f8274d9b640 1 Processor -- start 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f8274d9b640 1 -- start start 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f8274d9b640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82700ffe00 0x7f8270074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f8274d9b640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8270100f60 0x7f82700728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f8274d9b640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 0x7f8270072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f8274d9b640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8270073570 con 0x7f8270100f60 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f8274d9b640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82700736e0 con 0x7f8270101920 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f8274d9b640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827019fec0 con 0x7f82700ffe00 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f826ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 0x7f8270072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f826ed9d640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 0x7f8270072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.122:37772/0 (socket says 172.21.15.122:37772) 2024-09-13T18:00:10.945 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f826ed9d640 1 -- 172.21.15.122:0/3756956047 learned_addr learned my addr 172.21.15.122:0/3756956047 (peer_addr_for_me v2:172.21.15.122:0/0) 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.940+0000 7f826dd9b640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8270100f60 0x7f82700728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f826e59c640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82700ffe00 0x7f8270074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f826ed9d640 1 -- 172.21.15.122:0/3756956047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82700ffe00 msgr2=0x7f8270074250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f826ed9d640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82700ffe00 0x7f8270074250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f826ed9d640 1 -- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8270100f60 msgr2=0x7f82700728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f826ed9d640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8270100f60 0x7f82700728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f826ed9d640 1 -- 172.21.15.122:0/3756956047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8268009900 con 0x7f8270101920 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f826ed9d640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 0x7f8270072de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8268031040 tx=0x7f8268003d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f825f7fe640 1 -- 172.21.15.122:0/3756956047 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268031650 con 0x7f8270101920 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f825f7fe640 1 -- 172.21.15.122:0/3756956047 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8268040070 con 0x7f8270101920 2024-09-13T18:00:10.946 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82701a0110 con 0x7f8270101920 2024-09-13T18:00:10.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f825f7fe640 1 -- 172.21.15.122:0/3756956047 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268030940 con 0x7f8270101920 2024-09-13T18:00:10.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.941+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82701a06e0 con 0x7f8270101920 2024-09-13T18:00:10.947 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.942+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82701071a0 con 0x7f8270101920 2024-09-13T18:00:10.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.943+0000 7f825f7fe640 1 -- 172.21.15.122:0/3756956047 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8268042030 con 0x7f8270101920 2024-09-13T18:00:10.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.944+0000 7f825f7fe640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f82580a1100 0x7f82580a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:10.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.944+0000 7f825f7fe640 1 -- 172.21.15.122:0/3756956047 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f82680ed780 con 0x7f8270101920 2024-09-13T18:00:10.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.944+0000 7f826e59c640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f82580a1100 0x7f82580a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:10.948 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.945+0000 7f826e59c640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f82580a1100 0x7f82580a35c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8260005fd0 tx=0x7f8260005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:00:10.950 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:10.948+0000 7f825f7fe640 1 -- 172.21.15.122:0/3756956047 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f82680b7830 con 0x7f8270101920 2024-09-13T18:00:11.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: osdmap e69: 10 total, 10 up, 10 in 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi027 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi027 to 4272M 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:11.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:11.117 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:11.115+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f827002c450 con 0x7f82580a1100 2024-09-13T18:00:11.788 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:11 smithi122 ceph-mon[35310]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:00:11.789 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:11 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:00:11.789 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:11 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:00:11.789 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:11 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:12.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:11 smithi143 ceph-mon[38210]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:00:12.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:11 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:00:12.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:11 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:00:12.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:11 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:12.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:11 smithi027 ceph-mon[30611]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi122:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:00:12.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:11 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:00:12.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:11 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:00:12.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:11 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:12.710 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:12 smithi122 ceph-mon[35310]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:12.958 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:12 smithi027 ceph-mon[30611]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:13.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:12 smithi143 ceph-mon[38210]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:13.944 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:13 smithi122 ceph-mon[35310]: from='client.? 172.21.15.122:0/4214514358' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd55cd55-918b-4927-ab29-1f0e04d05c8f"}]: dispatch 2024-09-13T18:00:13.945 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:13 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd55cd55-918b-4927-ab29-1f0e04d05c8f"}]: dispatch 2024-09-13T18:00:13.945 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:13 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd55cd55-918b-4927-ab29-1f0e04d05c8f"}]': finished 2024-09-13T18:00:13.945 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:13 smithi122 ceph-mon[35310]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T18:00:13.945 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:13.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:13 smithi027 ceph-mon[30611]: from='client.? 172.21.15.122:0/4214514358' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd55cd55-918b-4927-ab29-1f0e04d05c8f"}]: dispatch 2024-09-13T18:00:13.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:13 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd55cd55-918b-4927-ab29-1f0e04d05c8f"}]: dispatch 2024-09-13T18:00:13.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:13 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd55cd55-918b-4927-ab29-1f0e04d05c8f"}]': finished 2024-09-13T18:00:13.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:13 smithi027 ceph-mon[30611]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T18:00:13.972 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:14.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:13 smithi143 ceph-mon[38210]: from='client.? 172.21.15.122:0/4214514358' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd55cd55-918b-4927-ab29-1f0e04d05c8f"}]: dispatch 2024-09-13T18:00:14.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:13 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cd55cd55-918b-4927-ab29-1f0e04d05c8f"}]: dispatch 2024-09-13T18:00:14.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:13 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cd55cd55-918b-4927-ab29-1f0e04d05c8f"}]': finished 2024-09-13T18:00:14.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:13 smithi143 ceph-mon[38210]: osdmap e70: 11 total, 10 up, 11 in 2024-09-13T18:00:14.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:14.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:14 smithi122 ceph-mon[35310]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:14.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:14 smithi122 ceph-mon[35310]: from='client.? 172.21.15.122:0/2998243429' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:00:15.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:14 smithi143 ceph-mon[38210]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:15.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:14 smithi143 ceph-mon[38210]: from='client.? 172.21.15.122:0/2998243429' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:00:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:14 smithi027 ceph-mon[30611]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:14 smithi027 ceph-mon[30611]: from='client.? 172.21.15.122:0/2998243429' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:00:16.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:16 smithi122 ceph-mon[35310]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:17.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:16 smithi143 ceph-mon[38210]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:17.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:16 smithi027 ceph-mon[30611]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:18.928 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:18 smithi122 ceph-mon[35310]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:19.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:18 smithi143 ceph-mon[38210]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:19.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:18 smithi027 ceph-mon[30611]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:20.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:20 smithi122 ceph-mon[35310]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:21.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:20 smithi143 ceph-mon[38210]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:21.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:20 smithi027 ceph-mon[30611]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:21.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T18:00:21.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:21.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:21 smithi122 ceph-mon[35310]: Deploying daemon osd.10 on smithi122 2024-09-13T18:00:22.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T18:00:22.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:22.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:21 smithi143 ceph-mon[38210]: Deploying daemon osd.10 on smithi122 2024-09-13T18:00:22.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-13T18:00:22.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:22.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:21 smithi027 ceph-mon[30611]: Deploying daemon osd.10 on smithi122 2024-09-13T18:00:22.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:22 smithi122 ceph-mon[35310]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:23.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:22 smithi143 ceph-mon[38210]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:23.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:22 smithi027 ceph-mon[30611]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:24.944 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:24 smithi122 ceph-mon[35310]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:25.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:24 smithi143 ceph-mon[38210]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:25.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:24 smithi027 ceph-mon[30611]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:26.923 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:26 smithi122 ceph-mon[35310]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:26.923 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:26.923 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:26.923 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:27.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:26 smithi143 ceph-mon[38210]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:27.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:27.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:27.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:26 smithi027 ceph-mon[30611]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:27.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:27.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:27.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:28.819 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:28 smithi122 ceph-mon[35310]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:29.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:28 smithi143 ceph-mon[38210]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:29.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:28 smithi027 ceph-mon[30611]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:29.170 INFO:teuthology.orchestra.run.smithi122.stdout:Created osd(s) 10 on host 'smithi122' 2024-09-13T18:00:29.171 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.169+0000 7f825f7fe640 1 -- 172.21.15.122:0/3756956047 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f827002c450 con 0x7f82580a1100 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f82580a1100 msgr2=0x7f82580a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f82580a1100 0x7f82580a35c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8260005fd0 tx=0x7f8260005850 comp rx=0 tx=0).stop 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 msgr2=0x7f8270072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 0x7f8270072de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8268031040 tx=0x7f8268003d60 comp rx=0 tx=0).stop 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 shutdown_connections 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f82580a1100 0x7f82580a35c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8270101920 0x7f8270072de0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8270100f60 0x7f82700728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 --2- 172.21.15.122:0/3756956047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f82700ffe00 0x7f8270074250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 >> 172.21.15.122:0/3756956047 conn(0x7f82700fb5d0 msgr2=0x7f8270104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 shutdown_connections 2024-09-13T18:00:29.173 INFO:teuthology.orchestra.run.smithi122.stderr:2024-09-13T18:00:29.171+0000 7f8274d9b640 1 -- 172.21.15.122:0/3756956047 wait complete. 2024-09-13T18:00:29.827 DEBUG:teuthology.orchestra.run.smithi122:osd.10> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.10.service 2024-09-13T18:00:29.830 INFO:tasks.cephadm:Deploying osd.11 on smithi143 with /dev/vg_nvme/lv_1... 2024-09-13T18:00:29.831 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-09-13T18:00:30.037 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:00:30.429 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:30 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.429 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:30 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.429 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:30 smithi143 ceph-mon[38210]: from='osd.10 [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:00:30.430 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:30 smithi143 ceph-mon[38210]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:00:30.430 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:30 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.430 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:30 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:30 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:30 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:30 smithi122 ceph-mon[35310]: from='osd.10 [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:00:30.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:30 smithi122 ceph-mon[35310]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:00:30.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:30 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:30 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:30 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:30 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:30 smithi027 ceph-mon[30611]: from='osd.10 [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:00:30.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:30 smithi027 ceph-mon[30611]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-13T18:00:30.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:30 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:30.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:30 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:31.374 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:31 smithi143 ceph-mon[38210]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:31.375 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:31 smithi143 ceph-mon[38210]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T18:00:31.375 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:31 smithi143 ceph-mon[38210]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T18:00:31.375 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:31.375 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:31 smithi143 ceph-mon[38210]: from='osd.10 [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T18:00:31.375 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:31 smithi143 ceph-mon[38210]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T18:00:31.415 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:31 smithi122 ceph-mon[35310]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:31.415 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:31 smithi122 ceph-mon[35310]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T18:00:31.415 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:31 smithi122 ceph-mon[35310]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T18:00:31.415 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:31.415 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:31 smithi122 ceph-mon[35310]: from='osd.10 [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T18:00:31.415 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:31 smithi122 ceph-mon[35310]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T18:00:31.416 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:00:31 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:00:31.184+0000 7f70dee3c640 -1 osd.10 0 waiting for initial osdmap 2024-09-13T18:00:31.416 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:00:31 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:00:31.203+0000 7f70db477640 -1 osd.10 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:00:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:31 smithi027 ceph-mon[30611]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:31 smithi027 ceph-mon[30611]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-13T18:00:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:31 smithi027 ceph-mon[30611]: osdmap e71: 11 total, 10 up, 11 in 2024-09-13T18:00:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:31 smithi027 ceph-mon[30611]: from='osd.10 [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T18:00:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:31 smithi027 ceph-mon[30611]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]: dispatch 2024-09-13T18:00:31.832 INFO:teuthology.orchestra.run.smithi143.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-09-13T18:00:31.925 INFO:teuthology.orchestra.run.smithi143.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-09-13T18:00:31.938 INFO:teuthology.orchestra.run.smithi143.stderr: stderr: 10+0 records in 2024-09-13T18:00:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:10+0 records out 2024-09-13T18:00:31.939 INFO:teuthology.orchestra.run.smithi143.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0115072 s, 911 MB/s 2024-09-13T18:00:31.939 INFO:teuthology.orchestra.run.smithi143.stderr:--> Zapping successful for: 2024-09-13T18:00:32.388 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:32 smithi122 ceph-mon[35310]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T18:00:32.389 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:32 smithi122 ceph-mon[35310]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T18:00:32.389 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:32 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:32.389 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:32 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:32.389 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:32 smithi122 ceph-mon[35310]: osd.10 [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] boot 2024-09-13T18:00:32.389 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:32 smithi122 ceph-mon[35310]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T18:00:32.389 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:32 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:32.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:32 smithi143 ceph-mon[38210]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T18:00:32.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:32 smithi143 ceph-mon[38210]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T18:00:32.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:32 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:32.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:32 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:32.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:32 smithi143 ceph-mon[38210]: osd.10 [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] boot 2024-09-13T18:00:32.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:32 smithi143 ceph-mon[38210]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T18:00:32.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:32 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:32.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:32 smithi027 ceph-mon[30611]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi122", "root=default"]}]': finished 2024-09-13T18:00:32.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:32 smithi027 ceph-mon[30611]: osdmap e72: 11 total, 10 up, 11 in 2024-09-13T18:00:32.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:32 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:32.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:32 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:32.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:32 smithi027 ceph-mon[30611]: osd.10 [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] boot 2024-09-13T18:00:32.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:32 smithi027 ceph-mon[30611]: osdmap e73: 11 total, 11 up, 11 in 2024-09-13T18:00:32.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:32 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-13T18:00:32.647 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi143:vg_nvme/lv_1 2024-09-13T18:00:32.847 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:00:33.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:33 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T18:00:33.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:33 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T18:00:33.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:33 smithi122 ceph-mon[35310]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:33.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:33 smithi122 ceph-mon[35310]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T18:00:33.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:33 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T18:00:33.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:33 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T18:00:33.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:33 smithi143 ceph-mon[38210]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:33.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:33 smithi143 ceph-mon[38210]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T18:00:33.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:33 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T18:00:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:33 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T18:00:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:33 smithi027 ceph-mon[30611]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-13T18:00:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:33 smithi027 ceph-mon[30611]: osdmap e74: 11 total, 11 up, 11 in 2024-09-13T18:00:34.303 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi122 2024-09-13T18:00:34.303 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.303 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.303 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.303 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi122 to 4271M 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.304 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:34 smithi143 ceph-mon[38210]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 -- 172.21.15.143:0/1494575882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fff00 msgr2=0x7f0810100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 --2- 172.21.15.143:0/1494575882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fff00 0x7f0810100380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009900 tx=0x7f07f802a410 comp rx=0 tx=0).stop 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 -- 172.21.15.143:0/1494575882 shutdown_connections 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 --2- 172.21.15.143:0/1494575882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08101008c0 0x7f0810107150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 --2- 172.21.15.143:0/1494575882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fff00 0x7f0810100380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 --2- 172.21.15.143:0/1494575882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08100fed00 0x7f08100ff100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 -- 172.21.15.143:0/1494575882 >> 172.21.15.143:0/1494575882 conn(0x7f08100fa490 msgr2=0x7f08100fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 -- 172.21.15.143:0/1494575882 shutdown_connections 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 -- 172.21.15.143:0/1494575882 wait complete. 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.383+0000 7f08151a0640 1 Processor -- start 2024-09-13T18:00:34.403 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f08151a0640 1 -- start start 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f08151a0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fed00 0x7f0810102e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f08151a0640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08100fff00 0x7f0810101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f08151a0640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08101008c0 0x7f08101019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f08151a0640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810102150 con 0x7f08100fff00 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f08151a0640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08101022c0 con 0x7f08101008c0 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f08151a0640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081019ff80 con 0x7f08100fed00 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fed00 0x7f0810102e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080ed9d640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fed00 0x7f0810102e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:40016/0 (socket says 172.21.15.143:40016) 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080ed9d640 1 -- 172.21.15.143:0/2904096507 learned_addr learned my addr 172.21.15.143:0/2904096507 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080f59e640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08101008c0 0x7f08101019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080e59c640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08100fff00 0x7f0810101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:34.404 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080ed9d640 1 -- 172.21.15.143:0/2904096507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08101008c0 msgr2=0x7f08101019c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080ed9d640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08101008c0 0x7f08101019c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080ed9d640 1 -- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08100fff00 msgr2=0x7f0810101480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080ed9d640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08100fff00 0x7f0810101480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080ed9d640 1 -- 172.21.15.143:0/2904096507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f8009560 con 0x7f08100fed00 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.384+0000 7f080ed9d640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fed00 0x7f0810102e30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f080000b480 tx=0x7f080000b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.385+0000 7f0807fff640 1 -- 172.21.15.143:0/2904096507 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800010870 con 0x7f08100fed00 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.385+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08101a0230 con 0x7f08100fed00 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.385+0000 7f0807fff640 1 -- 172.21.15.143:0/2904096507 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f080000f3c0 con 0x7f08100fed00 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.385+0000 7f0807fff640 1 -- 172.21.15.143:0/2904096507 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000175c0 con 0x7f08100fed00 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.385+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08101a0750 con 0x7f08100fed00 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.386+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081010a7a0 con 0x7f08100fed00 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.387+0000 7f0807fff640 1 -- 172.21.15.143:0/2904096507 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f080000f8c0 con 0x7f08100fed00 2024-09-13T18:00:34.405 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.387+0000 7f0807fff640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07fc0a1080 0x7f07fc0a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:34.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.388+0000 7f0807fff640 1 -- 172.21.15.143:0/2904096507 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f08000cc030 con 0x7f08100fed00 2024-09-13T18:00:34.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.388+0000 7f080e59c640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07fc0a1080 0x7f07fc0a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:34.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.388+0000 7f080e59c640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07fc0a1080 0x7f07fc0a3540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f07f8006010 tx=0x7f07f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:00:34.406 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.391+0000 7f0807fff640 1 -- 172.21.15.143:0/2904096507 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0800095e80 con 0x7f08100fed00 2024-09-13T18:00:34.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi122 2024-09-13T18:00:34.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi122 to 4271M 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:34 smithi122 ceph-mon[35310]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi122 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi122 to 4271M 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:34.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:34.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:34.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:34.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:34.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:34.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:34 smithi027 ceph-mon[30611]: osdmap e75: 11 total, 11 up, 11 in 2024-09-13T18:00:34.562 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:34.560+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0810068e30 con 0x7f07fc0a1080 2024-09-13T18:00:35.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:35 smithi143 ceph-mon[38210]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:00:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:00:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:35 smithi143 ceph-mon[38210]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T18:00:35.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:35 smithi027 ceph-mon[30611]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:00:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:00:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:35 smithi027 ceph-mon[30611]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T18:00:35.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:35 smithi122 ceph-mon[35310]: pgmap v243: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:35.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T18:00:35.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T18:00:35.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:35.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:35 smithi122 ceph-mon[35310]: osdmap e76: 11 total, 11 up, 11 in 2024-09-13T18:00:36.489 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:36 smithi143 ceph-mon[38210]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:00:36.489 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:36 smithi143 ceph-mon[38210]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T18:00:36.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:36 smithi027 ceph-mon[30611]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:00:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:36 smithi027 ceph-mon[30611]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T18:00:36.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:36 smithi122 ceph-mon[35310]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi143:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:00:36.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:36 smithi122 ceph-mon[35310]: osdmap e77: 11 total, 11 up, 11 in 2024-09-13T18:00:37.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:37 smithi143 ceph-mon[38210]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:37.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:37 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/1555338071' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f6c673e-6209-4e56-b97d-50419c0e0500"}]: dispatch 2024-09-13T18:00:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:37 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f6c673e-6209-4e56-b97d-50419c0e0500"}]: dispatch 2024-09-13T18:00:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:37 smithi143 ceph-mon[38210]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f6c673e-6209-4e56-b97d-50419c0e0500"}]': finished 2024-09-13T18:00:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:37 smithi143 ceph-mon[38210]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T18:00:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:37.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:37 smithi027 ceph-mon[30611]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:37.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:37 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/1555338071' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f6c673e-6209-4e56-b97d-50419c0e0500"}]: dispatch 2024-09-13T18:00:37.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:37 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f6c673e-6209-4e56-b97d-50419c0e0500"}]: dispatch 2024-09-13T18:00:37.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:37 smithi027 ceph-mon[30611]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f6c673e-6209-4e56-b97d-50419c0e0500"}]': finished 2024-09-13T18:00:37.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:37 smithi027 ceph-mon[30611]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T18:00:37.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:37 smithi122 ceph-mon[35310]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:37 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/1555338071' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f6c673e-6209-4e56-b97d-50419c0e0500"}]: dispatch 2024-09-13T18:00:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:37 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5f6c673e-6209-4e56-b97d-50419c0e0500"}]: dispatch 2024-09-13T18:00:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:37 smithi122 ceph-mon[35310]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5f6c673e-6209-4e56-b97d-50419c0e0500"}]': finished 2024-09-13T18:00:37.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:37 smithi122 ceph-mon[35310]: osdmap e78: 12 total, 11 up, 12 in 2024-09-13T18:00:37.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:38.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:38 smithi143 ceph-mon[38210]: from='client.? 172.21.15.143:0/2902570855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:00:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:38 smithi027 ceph-mon[30611]: from='client.? 172.21.15.143:0/2902570855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:00:38.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:38 smithi122 ceph-mon[35310]: from='client.? 172.21.15.143:0/2902570855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T18:00:39.529 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:39 smithi143 ceph-mon[38210]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:39.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:39 smithi027 ceph-mon[30611]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:39.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:39 smithi122 ceph-mon[35310]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:41.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:41 smithi143 ceph-mon[38210]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-13T18:00:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:41 smithi027 ceph-mon[30611]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-13T18:00:41.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:41 smithi122 ceph-mon[35310]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-13T18:00:43.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:43 smithi143 ceph-mon[38210]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-13T18:00:43.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:43 smithi027 ceph-mon[30611]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-13T18:00:43.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:43 smithi122 ceph-mon[35310]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-13T18:00:44.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:44 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T18:00:44.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:44 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:44.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:44 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T18:00:44.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:44 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:44.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:44 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-13T18:00:44.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:44 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:45.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:45 smithi027 ceph-mon[30611]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T18:00:45.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:45 smithi027 ceph-mon[30611]: Deploying daemon osd.11 on smithi143 2024-09-13T18:00:45.576 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:45 smithi143 ceph-mon[38210]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T18:00:45.576 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:45 smithi143 ceph-mon[38210]: Deploying daemon osd.11 on smithi143 2024-09-13T18:00:45.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:45 smithi122 ceph-mon[35310]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T18:00:45.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:45 smithi122 ceph-mon[35310]: Deploying daemon osd.11 on smithi143 2024-09-13T18:00:47.454 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:47 smithi143 ceph-mon[38210]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-13T18:00:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:47 smithi027 ceph-mon[30611]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-13T18:00:47.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:47 smithi122 ceph-mon[35310]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-13T18:00:49.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:49 smithi143 ceph-mon[38210]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-13T18:00:49.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:49 smithi027 ceph-mon[30611]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-13T18:00:49.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:49 smithi122 ceph-mon[35310]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-13T18:00:50.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:50.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:50.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:50 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:50.755 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:50.755 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:50.755 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:50 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:50.806 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:50.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:50.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:50 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:51.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:51 smithi143 ceph-mon[38210]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:00:51.615 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:51 smithi122 ceph-mon[35310]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:00:51.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:51 smithi027 ceph-mon[30611]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-13T18:00:52.828 INFO:teuthology.orchestra.run.smithi143.stdout:Created osd(s) 11 on host 'smithi143' 2024-09-13T18:00:52.828 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.824+0000 7f0807fff640 1 -- 172.21.15.143:0/2904096507 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f0810068e30 con 0x7f07fc0a1080 2024-09-13T18:00:52.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07fc0a1080 msgr2=0x7f07fc0a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:52.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07fc0a1080 0x7f07fc0a3540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f07f8006010 tx=0x7f07f8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:00:52.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fed00 msgr2=0x7f0810102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:52.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fed00 0x7f0810102e30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f080000b480 tx=0x7f080000b940 comp rx=0 tx=0).stop 2024-09-13T18:00:52.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 shutdown_connections 2024-09-13T18:00:52.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07fc0a1080 0x7f07fc0a3540 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:52.830 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f08101008c0 0x7f08101019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:52.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f08100fff00 0x7f0810101480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:52.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 --2- 172.21.15.143:0/2904096507 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f08100fed00 0x7f0810102e30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:52.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 >> 172.21.15.143:0/2904096507 conn(0x7f08100fa490 msgr2=0x7f0810068720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:00:52.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 shutdown_connections 2024-09-13T18:00:52.831 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:00:52.827+0000 7f08151a0640 1 -- 172.21.15.143:0/2904096507 wait complete. 2024-09-13T18:00:53.405 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:53 smithi143 ceph-mon[38210]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:53.405 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.405 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.406 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:53.406 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:53.406 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.406 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:53.406 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.406 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:53 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.426 DEBUG:teuthology.orchestra.run.smithi143:osd.11> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.11.service 2024-09-13T18:00:53.428 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-13T18:00:53.428 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T18:00:53.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:53 smithi122 ceph-mon[35310]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:53 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:53 smithi027 ceph-mon[30611]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:53.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:53.485 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:53.486 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.486 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:00:53.486 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.486 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:53 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:53.781 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:00:54.192 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:54 smithi027 ceph-mon[30611]: from='osd.11 [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:00:54.192 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:54 smithi027 ceph-mon[30611]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:00:54.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:54 smithi143 ceph-mon[38210]: from='osd.11 [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:00:54.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:54 smithi143 ceph-mon[38210]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:00:54.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:54 smithi122 ceph-mon[35310]: from='osd.11 [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:00:54.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:54 smithi122 ceph-mon[35310]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-13T18:00:55.126 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:55 smithi143 ceph-mon[38210]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:55.126 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:55 smithi143 ceph-mon[38210]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T18:00:55.126 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:55 smithi143 ceph-mon[38210]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T18:00:55.126 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:55 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:55.127 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:55 smithi143 ceph-mon[38210]: from='osd.11 [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T18:00:55.127 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:55 smithi143 ceph-mon[38210]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T18:00:55.127 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:00:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:00:55.103+0000 7f8d8d7ce640 -1 osd.11 0 waiting for initial osdmap 2024-09-13T18:00:55.127 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:00:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:00:55.122+0000 7f8d89e09640 -1 osd.11 80 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:00:55.366 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:55 smithi027 ceph-mon[30611]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:55.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:55 smithi027 ceph-mon[30611]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T18:00:55.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:55 smithi027 ceph-mon[30611]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T18:00:55.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:55 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:55.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:55 smithi027 ceph-mon[30611]: from='osd.11 [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T18:00:55.367 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:55 smithi027 ceph-mon[30611]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T18:00:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:55 smithi122 ceph-mon[35310]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:55 smithi122 ceph-mon[35310]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-13T18:00:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:55 smithi122 ceph-mon[35310]: osdmap e79: 12 total, 11 up, 12 in 2024-09-13T18:00:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:55 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:55 smithi122 ceph-mon[35310]: from='osd.11 [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T18:00:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:55 smithi122 ceph-mon[35310]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]: dispatch 2024-09-13T18:00:55.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.935+0000 7ff5f2400640 1 -- 172.21.15.27:0/3228568831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5ec0ffc30 msgr2=0x7ff5ec100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.935+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3228568831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5ec0ffc30 0x7ff5ec100030 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009900 tx=0x7ff5e002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:00:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.935+0000 7ff5f2400640 1 -- 172.21.15.27:0/3228568831 shutdown_connections 2024-09-13T18:00:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.935+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3228568831 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5ec1017f0 0x7ff5ec108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.935+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3228568831 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5ec100e30 0x7ff5ec1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.935+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3228568831 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5ec0ffc30 0x7ff5ec100030 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.935+0000 7ff5f2400640 1 -- 172.21.15.27:0/3228568831 >> 172.21.15.27:0/3228568831 conn(0x7ff5ec0fb3c0 msgr2=0x7ff5ec0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:00:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.935+0000 7ff5f2400640 1 -- 172.21.15.27:0/3228568831 shutdown_connections 2024-09-13T18:00:55.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.935+0000 7ff5f2400640 1 -- 172.21.15.27:0/3228568831 wait complete. 2024-09-13T18:00:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.936+0000 7ff5f2400640 1 Processor -- start 2024-09-13T18:00:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f2400640 1 -- start start 2024-09-13T18:00:55.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f2400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5ec0ffc30 0x7ff5ec074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f2400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5ec100e30 0x7ff5ec0728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f2400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5ec1017f0 0x7ff5ec072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f2400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec0734e0 con 0x7ff5ec1017f0 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f2400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec073650 con 0x7ff5ec100e30 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f2400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec19fd70 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f1a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5ec1017f0 0x7ff5ec072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f1a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5ec1017f0 0x7ff5ec072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49780/0 (socket says 172.21.15.27:49780) 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f1a00640 1 -- 172.21.15.27:0/3622615141 learned_addr learned my addr 172.21.15.27:0/3622615141 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5f1000640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5ec0ffc30 0x7ff5ec074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:55.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.937+0000 7ff5ebe00640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5ec100e30 0x7ff5ec0728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:55.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.938+0000 7ff5f1000640 1 -- 172.21.15.27:0/3622615141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5ec100e30 msgr2=0x7ff5ec0728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:55.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.938+0000 7ff5f1000640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5ec100e30 0x7ff5ec0728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:55.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.938+0000 7ff5f1000640 1 -- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5ec1017f0 msgr2=0x7ff5ec072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.938+0000 7ff5f1000640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5ec1017f0 0x7ff5ec072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.938+0000 7ff5f1000640 1 -- 172.21.15.27:0/3622615141 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e0009560 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.938+0000 7ff5f1a00640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5ec1017f0 0x7ff5ec072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.938+0000 7ff5f1000640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5ec0ffc30 0x7ff5ec074200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0031400 tx=0x7ff5e0005690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.938+0000 7ff5e9600640 1 -- 172.21.15.27:0/3622615141 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0004c50 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.939+0000 7ff5e9600640 1 -- 172.21.15.27:0/3622615141 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff5e0004db0 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.939+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec19ff70 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.939+0000 7ff5e9600640 1 -- 172.21.15.27:0/3622615141 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0031c50 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.939+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec1a0320 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.940+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ec1070f0 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.942+0000 7ff5e9600640 1 -- 172.21.15.27:0/3622615141 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff5e00035f0 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.943+0000 7ff5e9600640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff5d40a1070 0x7ff5d40a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.943+0000 7ff5e9600640 1 -- 172.21.15.27:0/3622615141 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6847+0+0 (secure 0 0 0) 0x7ff5e00ed2d0 con 0x7ff5ec0ffc30 2024-09-13T18:00:55.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.943+0000 7ff5ebe00640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff5d40a1070 0x7ff5d40a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:55.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.944+0000 7ff5ebe00640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff5d40a1070 0x7ff5d40a3530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec073f80 tx=0x7ff5d800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:00:55.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:55.945+0000 7ff5e9600640 1 -- 172.21.15.27:0/3622615141 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff5e00b7150 con 0x7ff5ec0ffc30 2024-09-13T18:00:56.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.131+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff5ec10b670 con 0x7ff5ec0ffc30 2024-09-13T18:00:56.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.131+0000 7ff5e9600640 1 -- 172.21.15.27:0/3622615141 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7ff5e00ba770 con 0x7ff5ec0ffc30 2024-09-13T18:00:56.134 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:00:56.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.133+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff5d40a1070 msgr2=0x7ff5d40a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:56.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff5d40a1070 0x7ff5d40a3530 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec073f80 tx=0x7ff5d800b390 comp rx=0 tx=0).stop 2024-09-13T18:00:56.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5ec0ffc30 msgr2=0x7ff5ec074200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:56.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5ec0ffc30 0x7ff5ec074200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0031400 tx=0x7ff5e0005690 comp rx=0 tx=0).stop 2024-09-13T18:00:56.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 shutdown_connections 2024-09-13T18:00:56.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff5d40a1070 0x7ff5d40a3530 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:56.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff5ec1017f0 0x7ff5ec072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:56.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff5ec100e30 0x7ff5ec0728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:56.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 --2- 172.21.15.27:0/3622615141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff5ec0ffc30 0x7ff5ec074200 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:56.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 >> 172.21.15.27:0/3622615141 conn(0x7ff5ec0fb3c0 msgr2=0x7ff5ec1042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:00:56.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 shutdown_connections 2024-09-13T18:00:56.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:56.134+0000 7ff5f2400640 1 -- 172.21.15.27:0/3622615141 wait complete. 2024-09-13T18:00:56.181 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:56 smithi027 ceph-mon[30611]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T18:00:56.181 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:56 smithi027 ceph-mon[30611]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T18:00:56.181 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:56.181 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:56 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:56.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:56 smithi143 ceph-mon[38210]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T18:00:56.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:56 smithi143 ceph-mon[38210]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T18:00:56.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:56.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:56 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:56.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:56 smithi122 ceph-mon[35310]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi143", "root=default"]}]': finished 2024-09-13T18:00:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:56 smithi122 ceph-mon[35310]: osdmap e80: 12 total, 11 up, 12 in 2024-09-13T18:00:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:56 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:57.013 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1726250456,"num_in_osds":12,"osd_in_since":1726250436,"num_remapped_pgs":0} 2024-09-13T18:00:57.013 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T18:00:57.352 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:00:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: purged_snaps scrub starts 2024-09-13T18:00:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: purged_snaps scrub ok 2024-09-13T18:00:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: osd.11 [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] boot 2024-09-13T18:00:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T18:00:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3622615141' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:00:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: Detected new or changed devices on smithi143 2024-09-13T18:00:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: Adjusting osd_memory_target on smithi143 to 4272M 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:57.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:57 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.492 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: purged_snaps scrub starts 2024-09-13T18:00:57.492 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: purged_snaps scrub ok 2024-09-13T18:00:57.492 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: osd.11 [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] boot 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3622615141' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: Detected new or changed devices on smithi143 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: Adjusting osd_memory_target on smithi143 to 4272M 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.493 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:57.494 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:57.494 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:57 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: purged_snaps scrub starts 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: purged_snaps scrub ok 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: osd.11 [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] boot 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: osdmap e81: 12 total, 12 up, 12 in 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3622615141' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: Detected new or changed devices on smithi143 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-13T18:00:57.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: Adjusting osd_memory_target on smithi143 to 4272M 2024-09-13T18:00:57.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:57.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:00:57.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:00:57.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:57 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:00:58.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:58 smithi122 ceph-mon[35310]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T18:00:58.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:58 smithi143 ceph-mon[38210]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T18:00:58.534 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:58 smithi027 ceph-mon[30611]: osdmap e82: 12 total, 12 up, 12 in 2024-09-13T18:00:59.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.274+0000 7f8973e00640 1 -- 172.21.15.27:0/24032509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8974073200 msgr2=0x7f897410beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.274+0000 7f8973e00640 1 --2- 172.21.15.27:0/24032509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8974073200 0x7f897410beb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f895c009900 tx=0x7f895c02a480 comp rx=0 tx=0).stop 2024-09-13T18:00:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.274+0000 7f8973e00640 1 -- 172.21.15.27:0/24032509 shutdown_connections 2024-09-13T18:00:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.274+0000 7f8973e00640 1 --2- 172.21.15.27:0/24032509 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f897410c3f0 0x7f897410e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.274+0000 7f8973e00640 1 --2- 172.21.15.27:0/24032509 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8974073200 0x7f897410beb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.274+0000 7f8973e00640 1 --2- 172.21.15.27:0/24032509 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f89740728e0 0x7f8974072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.274+0000 7f8973e00640 1 -- 172.21.15.27:0/24032509 >> 172.21.15.27:0/24032509 conn(0x7f89740fb870 msgr2=0x7f89740fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:00:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.274+0000 7f8973e00640 1 -- 172.21.15.27:0/24032509 shutdown_connections 2024-09-13T18:00:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.274+0000 7f8973e00640 1 -- 172.21.15.27:0/24032509 wait complete. 2024-09-13T18:00:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.275+0000 7f8973e00640 1 Processor -- start 2024-09-13T18:00:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973e00640 1 -- start start 2024-09-13T18:00:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89740728e0 0x7f8974198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8974073200 0x7f8974198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f897410c3f0 0x7f897419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897419d380 con 0x7f897410c3f0 2024-09-13T18:00:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897419d4f0 con 0x7f8974073200 2024-09-13T18:00:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897419d660 con 0x7f89740728e0 2024-09-13T18:00:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f897410c3f0 0x7f897419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f896a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8974073200 0x7f8974198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f897410c3f0 0x7f897419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49804/0 (socket says 172.21.15.27:49804) 2024-09-13T18:00:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8972a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89740728e0 0x7f8974198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.276+0000 7f8973400640 1 -- 172.21.15.27:0/1944873158 learned_addr learned my addr 172.21.15.27:0/1944873158 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:00:59.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f8972a00640 1 -- 172.21.15.27:0/1944873158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8974073200 msgr2=0x7f8974198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:59.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f8972a00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8974073200 0x7f8974198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f8972a00640 1 -- 172.21.15.27:0/1944873158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f897410c3f0 msgr2=0x7f897419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:59.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f8972a00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f897410c3f0 0x7f897419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f8972a00640 1 -- 172.21.15.27:0/1944873158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009560 con 0x7f89740728e0 2024-09-13T18:00:59.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f8972a00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89740728e0 0x7f8974198440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f896400e9f0 tx=0x7f896400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:00:59.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f896be00640 1 -- 172.21.15.27:0/1944873158 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896400ccc0 con 0x7f89740728e0 2024-09-13T18:00:59.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897419d940 con 0x7f89740728e0 2024-09-13T18:00:59.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f896be00640 1 -- 172.21.15.27:0/1944873158 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f896400ce20 con 0x7f89740728e0 2024-09-13T18:00:59.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f896be00640 1 -- 172.21.15.27:0/1944873158 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8964018920 con 0x7f89740728e0 2024-09-13T18:00:59.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.277+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89741a5200 con 0x7f89740728e0 2024-09-13T18:00:59.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.279+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8974073f90 con 0x7f89740728e0 2024-09-13T18:00:59.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.280+0000 7f896be00640 1 -- 172.21.15.27:0/1944873158 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8964018a80 con 0x7f89740728e0 2024-09-13T18:00:59.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.282+0000 7f896be00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f89580a10f0 0x7f89580a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:00:59.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.282+0000 7f896be00640 1 -- 172.21.15.27:0/1944873158 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8964014070 con 0x7f89740728e0 2024-09-13T18:00:59.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.282+0000 7f896a000640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f89580a10f0 0x7f89580a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:00:59.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.282+0000 7f896a000640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f89580a10f0 0x7f89580a35b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f895c005ec0 tx=0x7f895c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:00:59.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.286+0000 7f896be00640 1 -- 172.21.15.27:0/1944873158 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8964052e20 con 0x7f89740728e0 2024-09-13T18:00:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:00:59 smithi122 ceph-mon[35310]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:00:59.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.467+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89741997a0 con 0x7f89740728e0 2024-09-13T18:00:59.470 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:00:59 smithi027 ceph-mon[30611]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:00:59.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.468+0000 7f896be00640 1 -- 172.21.15.27:0/1944873158 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18398 (secure 0 0 0) 0x7f8964099e00 con 0x7f89740728e0 2024-09-13T18:00:59.472 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:00:59.472 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":82,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:00:57.110565+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f89580a10f0 msgr2=0x7f89580a35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f89580a10f0 0x7f89580a35b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f895c005ec0 tx=0x7f895c005a20 comp rx=0 tx=0).stop 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89740728e0 msgr2=0x7f8974198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89740728e0 0x7f8974198440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f896400e9f0 tx=0x7f896400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 shutdown_connections 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f89580a10f0 0x7f89580a35b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f897410c3f0 0x7f897419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8974073200 0x7f8974198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 --2- 172.21.15.27:0/1944873158 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f89740728e0 0x7f8974198440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:00:59.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 >> 172.21.15.27:0/1944873158 conn(0x7f89740fb870 msgr2=0x7f89740fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:00:59.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 shutdown_connections 2024-09-13T18:00:59.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:00:59.471+0000 7f8973e00640 1 -- 172.21.15.27:0/1944873158 wait complete. 2024-09-13T18:00:59.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:00:59 smithi143 ceph-mon[38210]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:00.403 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:00 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1944873158' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:00.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:00 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1944873158' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:00.475 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:00 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1944873158' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:00.506 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:57:10.088488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:01:00.507 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T18:01:00.829 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:01:01.255 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:01 smithi027 ceph-mon[30611]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:01.387 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:01 smithi143 ceph-mon[38210]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:01.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:01 smithi122 ceph-mon[35310]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:03.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.075+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4279432545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 msgr2=0x7f5b38074dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.075+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4279432545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 0x7f5b38074dc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009ca0 tx=0x7f5b2c02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.075+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4279432545 shutdown_connections 2024-09-13T18:01:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.075+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4279432545 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b38110c40 0x7f5b38113030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.075+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4279432545 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b38075300 0x7f5b38110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.075+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4279432545 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 0x7f5b38074dc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.075+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4279432545 >> 172.21.15.27:0/4279432545 conn(0x7f5b380fdc60 msgr2=0x7f5b38100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.075+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4279432545 shutdown_connections 2024-09-13T18:01:03.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.075+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4279432545 wait complete. 2024-09-13T18:01:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.076+0000 7f5b3fe00640 1 Processor -- start 2024-09-13T18:01:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.076+0000 7f5b3fe00640 1 -- start start 2024-09-13T18:01:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 0x7f5b381a2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:03.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b38075300 0x7f5b381a2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b38110c40 0x7f5b3819c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3fe00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3819cef0 con 0x7f5b380749e0 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3fe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3819d060 con 0x7f5b38075300 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3fe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3819d220 con 0x7f5b38110c40 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3d400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 0x7f5b381a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3d400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 0x7f5b381a2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55330/0 (socket says 172.21.15.27:55330) 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3d400640 1 -- 172.21.15.27:0/4148494864 learned_addr learned my addr 172.21.15.27:0/4148494864 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3ca00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b38075300 0x7f5b381a2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3de00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b38110c40 0x7f5b3819c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3d400640 1 -- 172.21.15.27:0/4148494864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b38110c40 msgr2=0x7f5b3819c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:03.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3d400640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b38110c40 0x7f5b3819c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3d400640 1 -- 172.21.15.27:0/4148494864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b38075300 msgr2=0x7f5b381a2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.077+0000 7f5b3d400640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b38075300 0x7f5b381a2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.078+0000 7f5b3d400640 1 -- 172.21.15.27:0/4148494864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c009900 con 0x7f5b380749e0 2024-09-13T18:01:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.078+0000 7f5b3d400640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 0x7f5b381a2700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005e30 tx=0x7f5b2c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.078+0000 7f5b36000640 1 -- 172.21.15.27:0/4148494864 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c031650 con 0x7f5b380749e0 2024-09-13T18:01:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.078+0000 7f5b36000640 1 -- 172.21.15.27:0/4148494864 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b2c040070 con 0x7f5b380749e0 2024-09-13T18:01:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.078+0000 7f5b36000640 1 -- 172.21.15.27:0/4148494864 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0305e0 con 0x7f5b380749e0 2024-09-13T18:01:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.078+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3819d4a0 con 0x7f5b380749e0 2024-09-13T18:01:03.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.078+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b381a96f0 con 0x7f5b380749e0 2024-09-13T18:01:03.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.080+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b38076120 con 0x7f5b380749e0 2024-09-13T18:01:03.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.081+0000 7f5b36000640 1 -- 172.21.15.27:0/4148494864 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5b2c042030 con 0x7f5b380749e0 2024-09-13T18:01:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.083+0000 7f5b36000640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5b200a1100 0x7f5b200a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.083+0000 7f5b36000640 1 -- 172.21.15.27:0/4148494864 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5b2c0ed770 con 0x7f5b380749e0 2024-09-13T18:01:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.083+0000 7f5b3ca00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5b200a1100 0x7f5b200a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:03.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.084+0000 7f5b3ca00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5b200a1100 0x7f5b200a35c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b3819dc60 tx=0x7f5b24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:03.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.087+0000 7f5b36000640 1 -- 172.21.15.27:0/4148494864 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5b2c0b7300 con 0x7f5b380749e0 2024-09-13T18:01:03.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:03 smithi122 ceph-mon[35310]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:03.271 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.268+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b38116590 con 0x7f5b380749e0 2024-09-13T18:01:03.272 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:03 smithi027 ceph-mon[30611]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:03.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.269+0000 7f5b36000640 1 -- 172.21.15.27:0/4148494864 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b2c0ba920 con 0x7f5b380749e0 2024-09-13T18:01:03.272 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-13T18:01:03.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5b200a1100 msgr2=0x7f5b200a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:03.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5b200a1100 0x7f5b200a35c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5b3819dc60 tx=0x7f5b24005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:03.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 msgr2=0x7f5b381a2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:03.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 0x7f5b381a2700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c005e30 tx=0x7f5b2c003c20 comp rx=0 tx=0).stop 2024-09-13T18:01:03.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 shutdown_connections 2024-09-13T18:01:03.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5b200a1100 0x7f5b200a35c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5b38110c40 0x7f5b3819c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5b38075300 0x7f5b381a2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 --2- 172.21.15.27:0/4148494864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5b380749e0 0x7f5b381a2700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:03.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 >> 172.21.15.27:0/4148494864 conn(0x7f5b380fdc60 msgr2=0x7f5b38100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:03.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 shutdown_connections 2024-09-13T18:01:03.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:03.271+0000 7f5b3fe00640 1 -- 172.21.15.27:0/4148494864 wait complete. 2024-09-13T18:01:03.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:03 smithi143 ceph-mon[38210]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:04.032 INFO:tasks.cephadm:Adding mds.a on smithi027 2024-09-13T18:01:04.032 INFO:tasks.cephadm:Adding mds.d on smithi027 2024-09-13T18:01:04.032 INFO:tasks.cephadm:Adding mds.g on smithi027 2024-09-13T18:01:04.032 INFO:tasks.cephadm:Adding mds.j on smithi027 2024-09-13T18:01:04.032 INFO:tasks.cephadm:Adding mds.b on smithi122 2024-09-13T18:01:04.032 INFO:tasks.cephadm:Adding mds.e on smithi122 2024-09-13T18:01:04.032 INFO:tasks.cephadm:Adding mds.h on smithi122 2024-09-13T18:01:04.032 INFO:tasks.cephadm:Adding mds.k on smithi122 2024-09-13T18:01:04.032 INFO:tasks.cephadm:Adding mds.c on smithi143 2024-09-13T18:01:04.033 INFO:tasks.cephadm:Adding mds.f on smithi143 2024-09-13T18:01:04.033 INFO:tasks.cephadm:Adding mds.i on smithi143 2024-09-13T18:01:04.033 INFO:tasks.cephadm:Adding mds.l on smithi143 2024-09-13T18:01:04.033 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi143=c;smithi143=f;smithi143=i;smithi143=l' 2024-09-13T18:01:04.244 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:01:04.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:04 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/4148494864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:01:04.364 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:04 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/4148494864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:01:04.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:04 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/4148494864' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:01:05.328 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:05 smithi143 ceph-mon[38210]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:05 smithi122 ceph-mon[35310]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:05.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:05 smithi027 ceph-mon[30611]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:05.780 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.776+0000 7f7552423640 1 -- 172.21.15.143:0/1667626037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c072e00 msgr2=0x7f754c073260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.776+0000 7f7552423640 1 --2- 172.21.15.143:0/1667626037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c072e00 0x7f754c073260 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7540009900 tx=0x7f754002a410 comp rx=0 tx=0).stop 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.776+0000 7f7552423640 1 -- 172.21.15.143:0/1667626037 shutdown_connections 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.776+0000 7f7552423640 1 --2- 172.21.15.143:0/1667626037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f754c107c70 0x7f754c10a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.776+0000 7f7552423640 1 --2- 172.21.15.143:0/1667626037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c072e00 0x7f754c073260 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.776+0000 7f7552423640 1 --2- 172.21.15.143:0/1667626037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c074460 0x7f754c0728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.776+0000 7f7552423640 1 -- 172.21.15.143:0/1667626037 >> 172.21.15.143:0/1667626037 conn(0x7f754c0fb5d0 msgr2=0x7f754c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.776+0000 7f7552423640 1 -- 172.21.15.143:0/1667626037 shutdown_connections 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.776+0000 7f7552423640 1 -- 172.21.15.143:0/1667626037 wait complete. 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f7552423640 1 Processor -- start 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f7552423640 1 -- start start 2024-09-13T18:01:05.781 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f7552423640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f754c072e00 0x7f754c198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f7552423640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c074460 0x7f754c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f7552423640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c107c70 0x7f754c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f7552423640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c19fc00 con 0x7f754c072e00 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f7552423640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c19fd70 con 0x7f754c074460 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f7552423640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c19ff30 con 0x7f754c107c70 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f75509c0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c107c70 0x7f754c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f75509c0640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c107c70 0x7f754c19f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.143:54636/0 (socket says 172.21.15.143:54636) 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.777+0000 7f75509c0640 1 -- 172.21.15.143:0/879903283 learned_addr learned my addr 172.21.15.143:0/879903283 (peer_addr_for_me v2:172.21.15.143:0/0) 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f754b7fe640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c074460 0x7f754c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f75509c0640 1 -- 172.21.15.143:0/879903283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c074460 msgr2=0x7f754c198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f75509c0640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c074460 0x7f754c198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f75509c0640 1 -- 172.21.15.143:0/879903283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f754c072e00 msgr2=0x7f754c198150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:05.782 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f75509c0640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f754c072e00 0x7f754c198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:05.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f75509c0640 1 -- 172.21.15.143:0/879903283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7540009560 con 0x7f754c107c70 2024-09-13T18:01:05.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f754b7fe640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c074460 0x7f754c198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:01:05.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f75509c0640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c107c70 0x7f754c19f6c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f754400cad0 tx=0x7f754400cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:05.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f75497fa640 1 -- 172.21.15.143:0/879903283 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754400ae20 con 0x7f754c107c70 2024-09-13T18:01:05.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f75497fa640 1 -- 172.21.15.143:0/879903283 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7544005020 con 0x7f754c107c70 2024-09-13T18:01:05.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f75497fa640 1 -- 172.21.15.143:0/879903283 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754400f6b0 con 0x7f754c107c70 2024-09-13T18:01:05.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c1a0210 con 0x7f754c107c70 2024-09-13T18:01:05.783 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.778+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c1a06c0 con 0x7f754c107c70 2024-09-13T18:01:05.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.779+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c106a80 con 0x7f754c107c70 2024-09-13T18:01:05.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.780+0000 7f75497fa640 1 -- 172.21.15.143:0/879903283 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7544005520 con 0x7f754c107c70 2024-09-13T18:01:05.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.781+0000 7f75497fa640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f75340a1130 0x7f75340a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:05.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.781+0000 7f75497fa640 1 -- 172.21.15.143:0/879903283 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f75440cc470 con 0x7f754c107c70 2024-09-13T18:01:05.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.781+0000 7f754bfff640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f75340a1130 0x7f75340a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:05.784 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.782+0000 7f754bfff640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f75340a1130 0x7f75340a35f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f753c009710 tx=0x7f753c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:05.786 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.785+0000 7f75497fa640 1 -- 172.21.15.143:0/879903283 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f75440960a0 con 0x7f754c107c70 2024-09-13T18:01:05.957 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.955+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi143=c;smithi143=f;smithi143=i;smithi143=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f754c02c450 con 0x7f75340a1130 2024-09-13T18:01:05.966 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.964+0000 7f75497fa640 1 -- 172.21.15.143:0/879903283 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f754c02c450 con 0x7f75340a1130 2024-09-13T18:01:05.966 INFO:teuthology.orchestra.run.smithi143.stdout:Scheduled mds.all update... 2024-09-13T18:01:05.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f75340a1130 msgr2=0x7f75340a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:05.968 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f75340a1130 0x7f75340a35f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f753c009710 tx=0x7f753c006c90 comp rx=0 tx=0).stop 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c107c70 msgr2=0x7f754c19f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c107c70 0x7f754c19f6c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f754400cad0 tx=0x7f754400cf90 comp rx=0 tx=0).stop 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 shutdown_connections 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f75340a1130 0x7f75340a35f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f754c107c70 0x7f754c19f6c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f754c074460 0x7f754c198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 --2- 172.21.15.143:0/879903283 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f754c072e00 0x7f754c198150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 >> 172.21.15.143:0/879903283 conn(0x7f754c0fb5d0 msgr2=0x7f754c103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 shutdown_connections 2024-09-13T18:01:05.969 INFO:teuthology.orchestra.run.smithi143.stderr:2024-09-13T18:01:05.966+0000 7f7552423640 1 -- 172.21.15.143:0/879903283 wait complete. 2024-09-13T18:01:06.601 DEBUG:teuthology.orchestra.run.smithi027:mds.a> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.a.service 2024-09-13T18:01:06.605 DEBUG:teuthology.orchestra.run.smithi027:mds.d> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.d.service 2024-09-13T18:01:06.650 DEBUG:teuthology.orchestra.run.smithi027:mds.g> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.g.service 2024-09-13T18:01:06.696 DEBUG:teuthology.orchestra.run.smithi027:mds.j> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.j.service 2024-09-13T18:01:06.741 DEBUG:teuthology.orchestra.run.smithi122:mds.b> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.b.service 2024-09-13T18:01:06.744 DEBUG:teuthology.orchestra.run.smithi122:mds.e> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.e.service 2024-09-13T18:01:06.787 DEBUG:teuthology.orchestra.run.smithi122:mds.h> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.h.service 2024-09-13T18:01:06.830 DEBUG:teuthology.orchestra.run.smithi122:mds.k> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.k.service 2024-09-13T18:01:06.873 DEBUG:teuthology.orchestra.run.smithi143:mds.c> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.c.service 2024-09-13T18:01:06.875 DEBUG:teuthology.orchestra.run.smithi143:mds.f> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.f.service 2024-09-13T18:01:06.922 DEBUG:teuthology.orchestra.run.smithi143:mds.i> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.i.service 2024-09-13T18:01:06.965 DEBUG:teuthology.orchestra.run.smithi143:mds.l> sudo journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.l.service 2024-09-13T18:01:07.008 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-13T18:01:07.008 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:01:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.179+0000 7f8a48c00640 1 -- 172.21.15.27:0/1676352278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a440744f0 msgr2=0x7f8a44072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.179+0000 7f8a48c00640 1 --2- 172.21.15.27:0/1676352278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a440744f0 0x7f8a44072940 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009900 tx=0x7f8a3402a410 comp rx=0 tx=0).stop 2024-09-13T18:01:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.179+0000 7f8a48c00640 1 -- 172.21.15.27:0/1676352278 shutdown_connections 2024-09-13T18:01:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.179+0000 7f8a48c00640 1 --2- 172.21.15.27:0/1676352278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a4410c370 0x7f8a4410e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.179+0000 7f8a48c00640 1 --2- 172.21.15.27:0/1676352278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a44072f10 0x7f8a44073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.179+0000 7f8a48c00640 1 --2- 172.21.15.27:0/1676352278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a440744f0 0x7f8a44072940 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.179+0000 7f8a48c00640 1 -- 172.21.15.27:0/1676352278 >> 172.21.15.27:0/1676352278 conn(0x7f8a440fb520 msgr2=0x7f8a440fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.179+0000 7f8a48c00640 1 -- 172.21.15.27:0/1676352278 shutdown_connections 2024-09-13T18:01:07.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.179+0000 7f8a48c00640 1 -- 172.21.15.27:0/1676352278 wait complete. 2024-09-13T18:01:07.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.180+0000 7f8a48c00640 1 Processor -- start 2024-09-13T18:01:07.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.180+0000 7f8a48c00640 1 -- start start 2024-09-13T18:01:07.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.180+0000 7f8a48c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a44072f10 0x7f8a4419c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.180+0000 7f8a48c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a440744f0 0x7f8a4419c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.180+0000 7f8a48c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a4410c370 0x7f8a441a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.180+0000 7f8a48c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a441a3f60 con 0x7f8a440744f0 2024-09-13T18:01:07.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.180+0000 7f8a48c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a441a40d0 con 0x7f8a4410c370 2024-09-13T18:01:07.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.180+0000 7f8a48c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a441a4290 con 0x7f8a44072f10 2024-09-13T18:01:07.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.180+0000 7f8a41e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a44072f10 0x7f8a4419c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a44072f10 0x7f8a4419c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:46226/0 (socket says 172.21.15.27:46226) 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41e00640 1 -- 172.21.15.27:0/2177810901 learned_addr learned my addr 172.21.15.27:0/2177810901 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41400640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a440744f0 0x7f8a4419c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a42800640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a4410c370 0x7f8a441a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41e00640 1 -- 172.21.15.27:0/2177810901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a4410c370 msgr2=0x7f8a441a3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41e00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a4410c370 0x7f8a441a3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41e00640 1 -- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a440744f0 msgr2=0x7f8a4419c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41e00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a440744f0 0x7f8a4419c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41e00640 1 -- 172.21.15.27:0/2177810901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a34009560 con 0x7f8a44072f10 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41400640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a440744f0 0x7f8a4419c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a41e00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a44072f10 0x7f8a4419c470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a34031510 tx=0x7f8a34004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.181+0000 7f8a3aa00640 1 -- 172.21.15.27:0/2177810901 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34005000 con 0x7f8a44072f10 2024-09-13T18:01:07.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.182+0000 7f8a3aa00640 1 -- 172.21.15.27:0/2177810901 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8a340046c0 con 0x7f8a44072f10 2024-09-13T18:01:07.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.182+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a441a4510 con 0x7f8a44072f10 2024-09-13T18:01:07.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.182+0000 7f8a3aa00640 1 -- 172.21.15.27:0/2177810901 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a34003a10 con 0x7f8a44072f10 2024-09-13T18:01:07.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.182+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a441a4a10 con 0x7f8a44072f10 2024-09-13T18:01:07.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.183+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a44101d10 con 0x7f8a44072f10 2024-09-13T18:01:07.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.185+0000 7f8a3aa00640 1 -- 172.21.15.27:0/2177810901 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8a34004bc0 con 0x7f8a44072f10 2024-09-13T18:01:07.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.186+0000 7f8a3aa00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8a280a1110 0x7f8a280a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.186+0000 7f8a3aa00640 1 -- 172.21.15.27:0/2177810901 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8a340ed670 con 0x7f8a44072f10 2024-09-13T18:01:07.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.186+0000 7f8a41400640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8a280a1110 0x7f8a280a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.187+0000 7f8a41400640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8a280a1110 0x7f8a280a35d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a4419d980 tx=0x7f8a30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:07.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.188+0000 7f8a3aa00640 1 -- 172.21.15.27:0/2177810901 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8a340b72b0 con 0x7f8a44072f10 2024-09-13T18:01:07.196 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:07.196 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi143=c;smithi143=f;smithi143=i;smithi143=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:07.196 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: Saving service mds.all spec with placement smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi143=c;smithi143=f;smithi143=i;smithi143=l;count:12 2024-09-13T18:01:07.196 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:07.196 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:01:07.196 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:07.196 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:01:07.196 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:07.196 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:07.197 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:07.197 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:06 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:07.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi143=c;smithi143=f;smithi143=i;smithi143=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: Saving service mds.all spec with placement smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi143=c;smithi143=f;smithi143=i;smithi143=l;count:12 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:06 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:07.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:07.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi143=c;smithi143=f;smithi143=i;smithi143=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:07.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: Saving service mds.all spec with placement smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi143=c;smithi143=f;smithi143=i;smithi143=l;count:12 2024-09-13T18:01:07.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:07.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:01:07.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:07.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:01:07.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:07.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:07.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:07.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:06 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:07.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.372+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a44111db0 con 0x7f8a44072f10 2024-09-13T18:01:07.375 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.374+0000 7f8a3aa00640 1 -- 172.21.15.27:0/2177810901 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18398 (secure 0 0 0) 0x7f8a340ba8d0 con 0x7f8a44072f10 2024-09-13T18:01:07.376 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:07.376 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":82,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:00:57.110565+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:01:07.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8a280a1110 msgr2=0x7f8a280a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8a280a1110 0x7f8a280a35d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a4419d980 tx=0x7f8a30005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:07.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a44072f10 msgr2=0x7f8a4419c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a44072f10 0x7f8a4419c470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a34031510 tx=0x7f8a34004270 comp rx=0 tx=0).stop 2024-09-13T18:01:07.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 shutdown_connections 2024-09-13T18:01:07.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8a280a1110 0x7f8a280a35d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8a4410c370 0x7f8a441a3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8a440744f0 0x7f8a4419c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 --2- 172.21.15.27:0/2177810901 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8a44072f10 0x7f8a4419c470 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 >> 172.21.15.27:0/2177810901 conn(0x7f8a440fb520 msgr2=0x7f8a440fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:07.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 shutdown_connections 2024-09-13T18:01:07.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.376+0000 7f8a48c00640 1 -- 172.21.15.27:0/2177810901 wait complete. 2024-09-13T18:01:07.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:57:10.088488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:01:07.395 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:01:07.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.556+0000 7fa500000640 1 -- 172.21.15.27:0/2590927330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4f8107f00 msgr2=0x7fa4f810e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.556+0000 7fa500000640 1 --2- 172.21.15.27:0/2590927330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4f8107f00 0x7fa4f810e820 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009ca0 tx=0x7fa4f002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.556+0000 7fa500000640 1 -- 172.21.15.27:0/2590927330 shutdown_connections 2024-09-13T18:01:07.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.556+0000 7fa500000640 1 --2- 172.21.15.27:0/2590927330 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4f8107f00 0x7fa4f810e820 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.556+0000 7fa500000640 1 --2- 172.21.15.27:0/2590927330 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f8107540 0x7fa4f81079c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.556+0000 7fa500000640 1 --2- 172.21.15.27:0/2590927330 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4f8106680 0x7fa4f8106a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.556+0000 7fa500000640 1 -- 172.21.15.27:0/2590927330 >> 172.21.15.27:0/2590927330 conn(0x7fa4f8075510 msgr2=0x7fa4f8077970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:07.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.556+0000 7fa500000640 1 -- 172.21.15.27:0/2590927330 shutdown_connections 2024-09-13T18:01:07.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.556+0000 7fa500000640 1 -- 172.21.15.27:0/2590927330 wait complete. 2024-09-13T18:01:07.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.557+0000 7fa500000640 1 Processor -- start 2024-09-13T18:01:07.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.557+0000 7fa500000640 1 -- start start 2024-09-13T18:01:07.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.557+0000 7fa500000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4f8106680 0x7fa4f819c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.557+0000 7fa500000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4f8107540 0x7fa4f819c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.557+0000 7fa500000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f8107f00 0x7fa4f81a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.557+0000 7fa500000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81a3f00 con 0x7fa4f8106680 2024-09-13T18:01:07.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.557+0000 7fa500000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81a4070 con 0x7fa4f8107540 2024-09-13T18:01:07.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.557+0000 7fa500000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f81a4230 con 0x7fa4f8107f00 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fd600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4f8106680 0x7fa4f819c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fd600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4f8106680 0x7fa4f819c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55358/0 (socket says 172.21.15.27:55358) 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fd600640 1 -- 172.21.15.27:0/2786950936 learned_addr learned my addr 172.21.15.27:0/2786950936 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fcc00640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4f8107540 0x7fa4f819c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fe000640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f8107f00 0x7fa4f81a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fd600640 1 -- 172.21.15.27:0/2786950936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f8107f00 msgr2=0x7fa4f81a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fd600640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f8107f00 0x7fa4f81a39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fd600640 1 -- 172.21.15.27:0/2786950936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4f8107540 msgr2=0x7fa4f819c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fd600640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4f8107540 0x7fa4f819c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.564 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fd600640 1 -- 172.21.15.27:0/2786950936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f0009900 con 0x7fa4f8106680 2024-09-13T18:01:07.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fe000640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f8107f00 0x7fa4f81a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:01:07.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4fd600640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4f8106680 0x7fa4f819c410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00eb30 tx=0x7fa4ec00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:07.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.558+0000 7fa4f6000640 1 -- 172.21.15.27:0/2786950936 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec009700 con 0x7fa4f8106680 2024-09-13T18:01:07.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.559+0000 7fa4f6000640 1 -- 172.21.15.27:0/2786950936 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa4ec010910 con 0x7fa4f8106680 2024-09-13T18:01:07.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.559+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f81a4510 con 0x7fa4f8106680 2024-09-13T18:01:07.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.559+0000 7fa4f6000640 1 -- 172.21.15.27:0/2786950936 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec018a40 con 0x7fa4f8106680 2024-09-13T18:01:07.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.559+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f81a4a20 con 0x7fa4f8106680 2024-09-13T18:01:07.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.560+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f810d720 con 0x7fa4f8106680 2024-09-13T18:01:07.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.562+0000 7fa4f6000640 1 -- 172.21.15.27:0/2786950936 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa4ec010a80 con 0x7fa4f8106680 2024-09-13T18:01:07.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.563+0000 7fa4f6000640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4e00a1090 0x7fa4e00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.563+0000 7fa4f6000640 1 -- 172.21.15.27:0/2786950936 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa4ec014070 con 0x7fa4f8106680 2024-09-13T18:01:07.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.563+0000 7fa4fcc00640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4e00a1090 0x7fa4e00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.564+0000 7fa4fcc00640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4e00a1090 0x7fa4e00a3550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4f819d920 tx=0x7fa4e400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:07.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.567+0000 7fa4f6000640 1 -- 172.21.15.27:0/2786950936 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa4ec052e20 con 0x7fa4f8106680 2024-09-13T18:01:07.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.747+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4f802c480 con 0x7fa4f8106680 2024-09-13T18:01:07.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.748+0000 7fa4f6000640 1 -- 172.21.15.27:0/2786950936 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4ec096700 con 0x7fa4f8106680 2024-09-13T18:01:07.750 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-13T18:01:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4e00a1090 msgr2=0x7fa4e00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4e00a1090 0x7fa4e00a3550 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa4f819d920 tx=0x7fa4e400b390 comp rx=0 tx=0).stop 2024-09-13T18:01:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4f8106680 msgr2=0x7fa4f819c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4f8106680 0x7fa4f819c410 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00eb30 tx=0x7fa4ec00c2d0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 shutdown_connections 2024-09-13T18:01:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa4e00a1090 0x7fa4e00a3550 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa4f8107f00 0x7fa4f81a39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa4f8107540 0x7fa4f819c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 --2- 172.21.15.27:0/2786950936 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa4f8106680 0x7fa4f819c410 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 >> 172.21.15.27:0/2786950936 conn(0x7fa4f8075510 msgr2=0x7fa4f810a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 shutdown_connections 2024-09-13T18:01:07.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.750+0000 7fa500000640 1 -- 172.21.15.27:0/2786950936 wait complete. 2024-09-13T18:01:07.769 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:07.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.931+0000 7fa1a4000640 1 -- 172.21.15.27:0/2378578634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c100f70 msgr2=0x7fa19c1013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.931+0000 7fa1a4000640 1 --2- 172.21.15.27:0/2378578634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c100f70 0x7fa19c1013f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa188009900 tx=0x7fa18802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.931+0000 7fa1a4000640 1 -- 172.21.15.27:0/2378578634 shutdown_connections 2024-09-13T18:01:07.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.931+0000 7fa1a4000640 1 --2- 172.21.15.27:0/2378578634 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa19c101930 0x7fa19c1081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.931+0000 7fa1a4000640 1 --2- 172.21.15.27:0/2378578634 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c100f70 0x7fa19c1013f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.931+0000 7fa1a4000640 1 --2- 172.21.15.27:0/2378578634 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c0ffd80 0x7fa19c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.931+0000 7fa1a4000640 1 -- 172.21.15.27:0/2378578634 >> 172.21.15.27:0/2378578634 conn(0x7fa19c0fb500 msgr2=0x7fa19c0fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:07.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.931+0000 7fa1a4000640 1 -- 172.21.15.27:0/2378578634 shutdown_connections 2024-09-13T18:01:07.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.931+0000 7fa1a4000640 1 -- 172.21.15.27:0/2378578634 wait complete. 2024-09-13T18:01:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.932+0000 7fa1a4000640 1 Processor -- start 2024-09-13T18:01:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.932+0000 7fa1a4000640 1 -- start start 2024-09-13T18:01:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.932+0000 7fa1a4000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa19c0ffd80 0x7fa19c195e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a4000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c100f70 0x7fa19c196380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a4000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c101930 0x7fa19c19d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a4000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c19d930 con 0x7fa19c101930 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a4000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c19daa0 con 0x7fa19c100f70 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a4000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c19dc60 con 0x7fa19c0ffd80 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a2000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c101930 0x7fa19c19d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a2000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c101930 0x7fa19c19d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:55376/0 (socket says 172.21.15.27:55376) 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a2000640 1 -- 172.21.15.27:0/3288479310 learned_addr learned my addr 172.21.15.27:0/3288479310 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a1600640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa19c0ffd80 0x7fa19c195e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a0c00640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c100f70 0x7fa19c196380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a2000640 1 -- 172.21.15.27:0/3288479310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa19c0ffd80 msgr2=0x7fa19c195e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a2000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa19c0ffd80 0x7fa19c195e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a2000640 1 -- 172.21.15.27:0/3288479310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c100f70 msgr2=0x7fa19c196380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a2000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c100f70 0x7fa19c196380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.933+0000 7fa1a2000640 1 -- 172.21.15.27:0/3288479310 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009560 con 0x7fa19c101930 2024-09-13T18:01:07.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.934+0000 7fa1a2000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c101930 0x7fa19c19d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa194009fd0 tx=0x7fa19400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.934+0000 7fa19a000640 1 -- 172.21.15.27:0/3288479310 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19400bea0 con 0x7fa19c101930 2024-09-13T18:01:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.934+0000 7fa19a000640 1 -- 172.21.15.27:0/3288479310 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa194009940 con 0x7fa19c101930 2024-09-13T18:01:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.934+0000 7fa19a000640 1 -- 172.21.15.27:0/3288479310 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1940106c0 con 0x7fa19c101930 2024-09-13T18:01:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.934+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c19df40 con 0x7fa19c101930 2024-09-13T18:01:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.934+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c19e370 con 0x7fa19c101930 2024-09-13T18:01:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.935+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c107200 con 0x7fa19c101930 2024-09-13T18:01:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.937+0000 7fa19a000640 1 -- 172.21.15.27:0/3288479310 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa194004220 con 0x7fa19c101930 2024-09-13T18:01:07.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.939+0000 7fa19a000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1840a1090 0x7fa1840a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:07.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.939+0000 7fa19a000640 1 -- 172.21.15.27:0/3288479310 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa1940cc160 con 0x7fa19c101930 2024-09-13T18:01:07.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.939+0000 7fa1a1600640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1840a1090 0x7fa1840a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:07.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.940+0000 7fa1a1600640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1840a1090 0x7fa1840a3550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa19c100dd0 tx=0x7fa190005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:07.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:07.942+0000 7fa19a000640 1 -- 172.21.15.27:0/3288479310 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa194095da0 con 0x7fa19c101930 2024-09-13T18:01:08.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:07 smithi027 ceph-mon[30611]: Deploying daemon mds.l on smithi143 2024-09-13T18:01:08.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:07 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2177810901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:08.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:07 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2786950936' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:01:08.068 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:07 smithi143 ceph-mon[38210]: Deploying daemon mds.l on smithi143 2024-09-13T18:01:08.068 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:07 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2177810901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:08.068 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:07 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2786950936' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:01:08.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.157+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa19c10b7c0 con 0x7fa19c101930 2024-09-13T18:01:08.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.158+0000 7fa19a000640 1 -- 172.21.15.27:0/3288479310 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7fa1940993c0 con 0x7fa19c101930 2024-09-13T18:01:08.160 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:08.160 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-13T18:01:08.160 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 1 2024-09-13T18:01:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1840a1090 msgr2=0x7fa1840a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1840a1090 0x7fa1840a3550 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa19c100dd0 tx=0x7fa190005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c101930 msgr2=0x7fa19c19d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c101930 0x7fa19c19d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa194009fd0 tx=0x7fa19400b260 comp rx=0 tx=0).stop 2024-09-13T18:01:08.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 shutdown_connections 2024-09-13T18:01:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1840a1090 0x7fa1840a3550 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa19c101930 0x7fa19c19d3f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa19c100f70 0x7fa19c196380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 --2- 172.21.15.27:0/3288479310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa19c0ffd80 0x7fa19c195e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 >> 172.21.15.27:0/3288479310 conn(0x7fa19c0fb500 msgr2=0x7fa19c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 shutdown_connections 2024-09-13T18:01:08.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:08.160+0000 7fa1a4000640 1 -- 172.21.15.27:0/3288479310 wait complete. 2024-09-13T18:01:08.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:07 smithi122 ceph-mon[35310]: Deploying daemon mds.l on smithi143 2024-09-13T18:01:08.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:07 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2177810901' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:08.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:07 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2786950936' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:01:08.737 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:01:08 smithi143 systemd[1]: Starting Ceph mds.l for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:01:09.008 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:08 smithi143 ceph-mon[38210]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:09.008 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:08 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3288479310' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:09.008 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:01:08 smithi143 podman[68102]: 2024-09-13 18:01:08.637985058 +0000 UTC m=+0.015958211 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:01:09.008 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:01:08 smithi143 podman[68102]: 2024-09-13 18:01:08.769058505 +0000 UTC m=+0.147031660 container create 27f3b385b71654aaf24b71dac0d1f18e5cad6516d84abff025b91c6d492813fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T18:01:09.008 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:01:08 smithi143 podman[68102]: 2024-09-13 18:01:08.980362568 +0000 UTC m=+0.358335720 container init 27f3b385b71654aaf24b71dac0d1f18e5cad6516d84abff025b91c6d492813fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T18:01:09.008 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:01:08 smithi143 podman[68102]: 2024-09-13 18:01:08.983369983 +0000 UTC m=+0.361343145 container start 27f3b385b71654aaf24b71dac0d1f18e5cad6516d84abff025b91c6d492813fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T18:01:09.008 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:01:09 smithi143 ceph-mds[68123]: -- 172.21.15.143:0/1795905930 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563749bb8d00 con 0x563749b8d400 2024-09-13T18:01:09.275 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:01:09 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l[68119]: starting mds.l at 2024-09-13T18:01:09.275 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:01:09 smithi143 bash[68102]: 27f3b385b71654aaf24b71dac0d1f18e5cad6516d84abff025b91c6d492813fe 2024-09-13T18:01:09.276 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:01:09 smithi143 systemd[1]: Started Ceph mds.l for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:09.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:08 smithi027 ceph-mon[30611]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:09.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:08 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3288479310' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:08 smithi122 ceph-mon[35310]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:08 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3288479310' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:10.179 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:10.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] up:boot 2024-09-13T18:01:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: fsmap 1 up:standby 2024-09-13T18:01:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:01:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:10 smithi122 ceph-mon[35310]: Deploying daemon mds.k on smithi122 2024-09-13T18:01:10.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] up:boot 2024-09-13T18:01:10.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: fsmap 1 up:standby 2024-09-13T18:01:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:01:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:10 smithi143 ceph-mon[38210]: Deploying daemon mds.k on smithi122 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] up:boot 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: fsmap 1 up:standby 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:10.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:10 smithi027 ceph-mon[30611]: Deploying daemon mds.k on smithi122 2024-09-13T18:01:10.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.350+0000 7f03ef600640 1 -- 172.21.15.27:0/2986208314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e8103150 msgr2=0x7f03e8105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:10.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.350+0000 7f03ef600640 1 --2- 172.21.15.27:0/2986208314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e8103150 0x7f03e8105540 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f03d4009900 tx=0x7f03d402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.350+0000 7f03ef600640 1 -- 172.21.15.27:0/2986208314 shutdown_connections 2024-09-13T18:01:10.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.350+0000 7f03ef600640 1 --2- 172.21.15.27:0/2986208314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03e8105a80 0x7f03e8107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.350+0000 7f03ef600640 1 --2- 172.21.15.27:0/2986208314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e8103150 0x7f03e8105540 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.350+0000 7f03ef600640 1 --2- 172.21.15.27:0/2986208314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8100820 0x7f03e8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.350+0000 7f03ef600640 1 -- 172.21.15.27:0/2986208314 >> 172.21.15.27:0/2986208314 conn(0x7f03e80fa420 msgr2=0x7f03e80fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:10.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.350+0000 7f03ef600640 1 -- 172.21.15.27:0/2986208314 shutdown_connections 2024-09-13T18:01:10.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.350+0000 7f03ef600640 1 -- 172.21.15.27:0/2986208314 wait complete. 2024-09-13T18:01:10.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.351+0000 7f03ef600640 1 Processor -- start 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.351+0000 7f03ef600640 1 -- start start 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ef600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03e8100820 0x7f03e8198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ef600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e8103150 0x7f03e8198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ef600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8105a80 0x7f03e819f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ef600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e819fc20 con 0x7f03e8103150 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ef600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e819fd90 con 0x7f03e8100820 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ef600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e819ff50 con 0x7f03e8105a80 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03e7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e8103150 0x7f03e8198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ecc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03e8100820 0x7f03e8198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ecc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03e8100820 0x7f03e8198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:60562/0 (socket says 172.21.15.27:60562) 2024-09-13T18:01:10.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03e7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e8103150 0x7f03e8198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60418/0 (socket says 172.21.15.27:60418) 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ecc00640 1 -- 172.21.15.27:0/470375512 learned_addr learned my addr 172.21.15.27:0/470375512 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ed600640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8105a80 0x7f03e819f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ecc00640 1 -- 172.21.15.27:0/470375512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8105a80 msgr2=0x7f03e819f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ecc00640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8105a80 0x7f03e819f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ecc00640 1 -- 172.21.15.27:0/470375512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e8103150 msgr2=0x7f03e8198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ecc00640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e8103150 0x7f03e8198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.352+0000 7f03ecc00640 1 -- 172.21.15.27:0/470375512 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d4009560 con 0x7f03e8100820 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.353+0000 7f03ecc00640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03e8100820 0x7f03e8198130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00e9f0 tx=0x7f03dc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.353+0000 7f03e5600640 1 -- 172.21.15.27:0/470375512 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc009720 con 0x7f03e8100820 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.353+0000 7f03e5600640 1 -- 172.21.15.27:0/470375512 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f03dc00cd80 con 0x7f03e8100820 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.353+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e81a0230 con 0x7f03e8100820 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.353+0000 7f03e5600640 1 -- 172.21.15.27:0/470375512 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03dc010690 con 0x7f03e8100820 2024-09-13T18:01:10.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.353+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e81a06c0 con 0x7f03e8100820 2024-09-13T18:01:10.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.354+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e81075f0 con 0x7f03e8100820 2024-09-13T18:01:10.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.356+0000 7f03e5600640 1 -- 172.21.15.27:0/470375512 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f03dc0046c0 con 0x7f03e8100820 2024-09-13T18:01:10.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.358+0000 7f03e5600640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f03d00a1090 0x7f03d00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:10.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.358+0000 7f03e5600640 1 -- 172.21.15.27:0/470375512 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f03dc014070 con 0x7f03e8100820 2024-09-13T18:01:10.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.358+0000 7f03e7e00640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f03d00a1090 0x7f03d00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:10.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.358+0000 7f03e7e00640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f03d00a1090 0x7f03d00a3550 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03d4031510 tx=0x7f03d40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:10.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.359+0000 7f03e5600640 1 -- 172.21.15.27:0/470375512 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f03dc096bb0 con 0x7f03e8100820 2024-09-13T18:01:10.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.581+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03e810b7d0 con 0x7f03e8100820 2024-09-13T18:01:10.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.581+0000 7f03e5600640 1 -- 172.21.15.27:0/470375512 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f03dc0b8e60 con 0x7f03e8100820 2024-09-13T18:01:10.583 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:10.584 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:01:10.584 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 2 2024-09-13T18:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f03d00a1090 msgr2=0x7f03d00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f03d00a1090 0x7f03d00a3550 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f03d4031510 tx=0x7f03d40058d0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03e8100820 msgr2=0x7f03e8198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03e8100820 0x7f03e8198130 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00e9f0 tx=0x7f03dc00edf0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 shutdown_connections 2024-09-13T18:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f03d00a1090 0x7f03d00a3550 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f03e8105a80 0x7f03e819f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f03e8103150 0x7f03e8198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 --2- 172.21.15.27:0/470375512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f03e8100820 0x7f03e8198130 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:10.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 >> 172.21.15.27:0/470375512 conn(0x7f03e80fa420 msgr2=0x7f03e80ffef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:10.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 shutdown_connections 2024-09-13T18:01:10.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:10.584+0000 7f03ef600640 1 -- 172.21.15.27:0/470375512 wait complete. 2024-09-13T18:01:11.144 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:01:11 smithi122 systemd[1]: Starting Ceph mds.k for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:01:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:11 smithi122 ceph-mon[35310]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:11 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/470375512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:11.464 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:01:11 smithi122 podman[64668]: 2024-09-13 18:01:11.153257448 +0000 UTC m=+0.016336262 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:01:11.464 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:01:11 smithi122 podman[64668]: 2024-09-13 18:01:11.257950259 +0000 UTC m=+0.121029057 container create 894f3c91308dff514c15012b747544469f43347759a1561b7ca65bd1129f8d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:01:11.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:11 smithi143 ceph-mon[38210]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:11.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:11 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/470375512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:11 smithi027 ceph-mon[30611]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:11 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/470375512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:11.964 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:01:11 smithi122 podman[64668]: 2024-09-13 18:01:11.479645861 +0000 UTC m=+0.342724659 container init 894f3c91308dff514c15012b747544469f43347759a1561b7ca65bd1129f8d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:01:11.964 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:01:11 smithi122 podman[64668]: 2024-09-13 18:01:11.482590036 +0000 UTC m=+0.345668844 container start 894f3c91308dff514c15012b747544469f43347759a1561b7ca65bd1129f8d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-13T18:01:11.964 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:01:11 smithi122 ceph-mds[64687]: -- 172.21.15.122:0/122434774 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55722cd62d00 con 0x55722cd36800 2024-09-13T18:01:11.964 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:01:11 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k[64683]: starting mds.k at 2024-09-13T18:01:11.964 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:01:11 smithi122 bash[64668]: 894f3c91308dff514c15012b747544469f43347759a1561b7ca65bd1129f8d3b 2024-09-13T18:01:11.964 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:01:11 smithi122 systemd[1]: Started Ceph mds.k for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:12.603 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:12.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.765+0000 7fd134e00640 1 -- 172.21.15.27:0/743361960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1300ffda0 msgr2=0x7fd1301001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:12.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.765+0000 7fd134e00640 1 --2- 172.21.15.27:0/743361960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1300ffda0 0x7fd1301001a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd120009900 tx=0x7fd12002a410 comp rx=0 tx=0).stop 2024-09-13T18:01:12.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.765+0000 7fd134e00640 1 -- 172.21.15.27:0/743361960 shutdown_connections 2024-09-13T18:01:12.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.765+0000 7fd134e00640 1 --2- 172.21.15.27:0/743361960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd130101950 0x7fd1301081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.765+0000 7fd134e00640 1 --2- 172.21.15.27:0/743361960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd130100f90 0x7fd130101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.765+0000 7fd134e00640 1 --2- 172.21.15.27:0/743361960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd1300ffda0 0x7fd1301001a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.765+0000 7fd134e00640 1 -- 172.21.15.27:0/743361960 >> 172.21.15.27:0/743361960 conn(0x7fd1300fb520 msgr2=0x7fd1300fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:12.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.766+0000 7fd134e00640 1 -- 172.21.15.27:0/743361960 shutdown_connections 2024-09-13T18:01:12.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.766+0000 7fd134e00640 1 -- 172.21.15.27:0/743361960 wait complete. 2024-09-13T18:01:12.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.766+0000 7fd134e00640 1 Processor -- start 2024-09-13T18:01:12.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.766+0000 7fd134e00640 1 -- start start 2024-09-13T18:01:12.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd134e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300ffda0 0x7fd130195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:12.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd134e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd130100f90 0x7fd130196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:12.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd134e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd130101950 0x7fd13019d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd134e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13019d9d0 con 0x7fd130100f90 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd134e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13019db40 con 0x7fd130101950 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd134e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13019dd00 con 0x7fd1300ffda0 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12d400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd130100f90 0x7fd130196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd130101950 0x7fd13019d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12d400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd130100f90 0x7fd130196420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60440/0 (socket says 172.21.15.27:60440) 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12d400640 1 -- 172.21.15.27:0/630776526 learned_addr learned my addr 172.21.15.27:0/630776526 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12de00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300ffda0 0x7fd130195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12e800640 1 -- 172.21.15.27:0/630776526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300ffda0 msgr2=0x7fd130195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12e800640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300ffda0 0x7fd130195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12e800640 1 -- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd130100f90 msgr2=0x7fd130196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12e800640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd130100f90 0x7fd130196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.767+0000 7fd12e800640 1 -- 172.21.15.27:0/630776526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120009560 con 0x7fd130101950 2024-09-13T18:01:12.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.768+0000 7fd12d400640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd130100f90 0x7fd130196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:12.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.768+0000 7fd12e800640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd130101950 0x7fd13019d490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd12800da10 tx=0x7fd12800ded0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:12.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.768+0000 7fd126a00640 1 -- 172.21.15.27:0/630776526 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12800bd70 con 0x7fd130101950 2024-09-13T18:01:12.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.768+0000 7fd126a00640 1 -- 172.21.15.27:0/630776526 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd128003e50 con 0x7fd130101950 2024-09-13T18:01:12.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.768+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13019dfe0 con 0x7fd130101950 2024-09-13T18:01:12.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.768+0000 7fd126a00640 1 -- 172.21.15.27:0/630776526 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1280106c0 con 0x7fd130101950 2024-09-13T18:01:12.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.768+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13019e410 con 0x7fd130101950 2024-09-13T18:01:12.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.769+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130107250 con 0x7fd130101950 2024-09-13T18:01:12.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.771+0000 7fd126a00640 1 -- 172.21.15.27:0/630776526 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd1280042a0 con 0x7fd130101950 2024-09-13T18:01:12.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.772+0000 7fd126a00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd1140a1090 0x7fd1140a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:12.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.772+0000 7fd126a00640 1 -- 172.21.15.27:0/630776526 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd1280cc7b0 con 0x7fd130101950 2024-09-13T18:01:12.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.772+0000 7fd12de00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd1140a1090 0x7fd1140a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:12.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.773+0000 7fd12de00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd1140a1090 0x7fd1140a3550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd120009230 tx=0x7fd120005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:12.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.775+0000 7fd126a00640 1 -- 172.21.15.27:0/630776526 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd128096340 con 0x7fd130101950 2024-09-13T18:01:12.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:12.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:12.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:12.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:12.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:12.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:12.965 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:12.965 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: Deploying daemon mds.j on smithi027 2024-09-13T18:01:12.965 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6832/1100066007,v1:172.21.15.122:6833/1100066007] up:boot 2024-09-13T18:01:12.965 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: fsmap 2 up:standby 2024-09-13T18:01:12.965 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:01:12.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.993+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd13010b7f0 con 0x7fd130101950 2024-09-13T18:01:12.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.994+0000 7fd126a00640 1 -- 172.21.15.27:0/630776526 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7fd128099960 con 0x7fd130101950 2024-09-13T18:01:12.996 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:12.996 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:01:12.996 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 3 2024-09-13T18:01:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd1140a1090 msgr2=0x7fd1140a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd1140a1090 0x7fd1140a3550 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd120009230 tx=0x7fd120005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd130101950 msgr2=0x7fd13019d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd130101950 0x7fd13019d490 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd12800da10 tx=0x7fd12800ded0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 shutdown_connections 2024-09-13T18:01:12.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd1140a1090 0x7fd1140a3550 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd130101950 0x7fd13019d490 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd130100f90 0x7fd130196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 --2- 172.21.15.27:0/630776526 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd1300ffda0 0x7fd130195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:12.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 >> 172.21.15.27:0/630776526 conn(0x7fd1300fb520 msgr2=0x7fd130104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:12.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 shutdown_connections 2024-09-13T18:01:12.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:12.996+0000 7fd134e00640 1 -- 172.21.15.27:0/630776526 wait complete. 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: Deploying daemon mds.j on smithi027 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6832/1100066007,v1:172.21.15.122:6833/1100066007] up:boot 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: fsmap 2 up:standby 2024-09-13T18:01:13.013 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: Deploying daemon mds.j on smithi027 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6832/1100066007,v1:172.21.15.122:6833/1100066007] up:boot 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: fsmap 2 up:standby 2024-09-13T18:01:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:01:13.909 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:13 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/630776526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:14.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:13 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/630776526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:14.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:13 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/630776526' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:14.389 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:01:14 smithi027 systemd[1]: Starting Ceph mds.j for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:01:14.645 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:01:14 smithi027 podman[69816]: 2024-09-13 18:01:14.302107946 +0000 UTC m=+0.028854348 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:01:14.645 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:01:14 smithi027 podman[69816]: 2024-09-13 18:01:14.430945608 +0000 UTC m=+0.157691990 container create b54a53cda8c311bacd431543bdb42f29b090deb7149a8b4ba2d928037bf12c2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T18:01:14.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:14 smithi122 ceph-mon[35310]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:15.016 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:15.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:14 smithi143 ceph-mon[38210]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:14 smithi027 ceph-mon[30611]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:15.057 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:01:14 smithi027 podman[69816]: 2024-09-13 18:01:14.726013235 +0000 UTC m=+0.452759637 container init b54a53cda8c311bacd431543bdb42f29b090deb7149a8b4ba2d928037bf12c2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:01:15.057 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:01:14 smithi027 podman[69816]: 2024-09-13 18:01:14.732766911 +0000 UTC m=+0.459513299 container start b54a53cda8c311bacd431543bdb42f29b090deb7149a8b4ba2d928037bf12c2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True) 2024-09-13T18:01:15.057 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:01:14 smithi027 ceph-mds[69843]: -- 172.21.15.27:0/3580608929 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b7d9b4d00 con 0x564b7d989000 2024-09-13T18:01:15.057 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:01:14 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j[69834]: starting mds.j at 2024-09-13T18:01:15.057 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:01:14 smithi027 bash[69816]: b54a53cda8c311bacd431543bdb42f29b090deb7149a8b4ba2d928037bf12c2f 2024-09-13T18:01:15.057 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:01:14 smithi027 systemd[1]: Started Ceph mds.j for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:15.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.181+0000 7f34f9400640 1 -- 172.21.15.27:0/1037543823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34f4076a50 msgr2=0x7f34f40772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:15.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.181+0000 7f34f9400640 1 --2- 172.21.15.27:0/1037543823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34f4076a50 0x7f34f40772f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009ca0 tx=0x7f34ec02a8b0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.181+0000 7f34f9400640 1 -- 172.21.15.27:0/1037543823 shutdown_connections 2024-09-13T18:01:15.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.181+0000 7f34f9400640 1 --2- 172.21.15.27:0/1037543823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34f4076a50 0x7f34f40772f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.181+0000 7f34f9400640 1 --2- 172.21.15.27:0/1037543823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f40760b0 0x7f34f4076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.181+0000 7f34f9400640 1 --2- 172.21.15.27:0/1037543823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34f4074e70 0x7f34f4075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.181+0000 7f34f9400640 1 -- 172.21.15.27:0/1037543823 >> 172.21.15.27:0/1037543823 conn(0x7f34f40fd730 msgr2=0x7f34f40ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:15.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.182+0000 7f34f9400640 1 -- 172.21.15.27:0/1037543823 shutdown_connections 2024-09-13T18:01:15.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.182+0000 7f34f9400640 1 -- 172.21.15.27:0/1037543823 wait complete. 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.183+0000 7f34f9400640 1 Processor -- start 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.183+0000 7f34f9400640 1 -- start start 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.183+0000 7f34f9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f4074e70 0x7f34f419c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.183+0000 7f34f9400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34f40760b0 0x7f34f419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.183+0000 7f34f9400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34f4076a50 0x7f34f41a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.183+0000 7f34f9400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41a3f40 con 0x7f34f4076a50 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.183+0000 7f34f9400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41a40b0 con 0x7f34f40760b0 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.183+0000 7f34f9400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f41a4270 con 0x7f34f4074e70 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f3200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34f4076a50 0x7f34f41a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:15.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f3200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34f4076a50 0x7f34f41a3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60472/0 (socket says 172.21.15.27:60472) 2024-09-13T18:01:15.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f3200640 1 -- 172.21.15.27:0/1914170115 learned_addr learned my addr 172.21.15.27:0/1914170115 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:15.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f2800640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f4074e70 0x7f34f419c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:15.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f1e00640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34f40760b0 0x7f34f419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:15.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f2800640 1 -- 172.21.15.27:0/1914170115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34f40760b0 msgr2=0x7f34f419c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:15.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f2800640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34f40760b0 0x7f34f419c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f2800640 1 -- 172.21.15.27:0/1914170115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34f4076a50 msgr2=0x7f34f41a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:15.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f2800640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34f4076a50 0x7f34f41a3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f2800640 1 -- 172.21.15.27:0/1914170115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009900 con 0x7f34f4074e70 2024-09-13T18:01:15.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.184+0000 7f34f2800640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f4074e70 0x7f34f419c450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34e4005fd0 tx=0x7f34e400dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:15.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.185+0000 7f34eb400640 1 -- 172.21.15.27:0/1914170115 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4009c30 con 0x7f34f4074e70 2024-09-13T18:01:15.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.185+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f41a4550 con 0x7f34f4074e70 2024-09-13T18:01:15.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.185+0000 7f34eb400640 1 -- 172.21.15.27:0/1914170115 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f34e4004510 con 0x7f34f4074e70 2024-09-13T18:01:15.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.185+0000 7f34eb400640 1 -- 172.21.15.27:0/1914170115 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e4003e60 con 0x7f34f4074e70 2024-09-13T18:01:15.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.185+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f41a4ab0 con 0x7f34f4074e70 2024-09-13T18:01:15.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.186+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f410eb00 con 0x7f34f4074e70 2024-09-13T18:01:15.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.188+0000 7f34eb400640 1 -- 172.21.15.27:0/1914170115 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f34e4004000 con 0x7f34f4074e70 2024-09-13T18:01:15.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.189+0000 7f34eb400640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f34d80a1110 0x7f34d80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:15.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.189+0000 7f34eb400640 1 -- 172.21.15.27:0/1914170115 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f34e40cbf80 con 0x7f34f4074e70 2024-09-13T18:01:15.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.190+0000 7f34f1e00640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f34d80a1110 0x7f34d80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:15.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.190+0000 7f34f1e00640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f34d80a1110 0x7f34d80a35d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34f419d960 tx=0x7f34e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:15.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.193+0000 7f34eb400640 1 -- 172.21.15.27:0/1914170115 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f34e4095bc0 con 0x7f34f4074e70 2024-09-13T18:01:15.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.462+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34f4111e30 con 0x7f34f4074e70 2024-09-13T18:01:15.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.462+0000 7f34eb400640 1 -- 172.21.15.27:0/1914170115 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7f34e40991e0 con 0x7f34f4074e70 2024-09-13T18:01:15.464 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:15.465 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:01:15.465 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 3 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f34d80a1110 msgr2=0x7f34d80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f34d80a1110 0x7f34d80a35d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f34f419d960 tx=0x7f34e0005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f4074e70 msgr2=0x7f34f419c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f4074e70 0x7f34f419c450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f34e4005fd0 tx=0x7f34e400dde0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 shutdown_connections 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f34d80a1110 0x7f34d80a35d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f34f4076a50 0x7f34f41a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f34f40760b0 0x7f34f419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 --2- 172.21.15.27:0/1914170115 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f34f4074e70 0x7f34f419c450 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:15.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 >> 172.21.15.27:0/1914170115 conn(0x7f34f40fd730 msgr2=0x7f34f40fee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 shutdown_connections 2024-09-13T18:01:15.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:15.465+0000 7f34f9400640 1 -- 172.21.15.27:0/1914170115 wait complete. 2024-09-13T18:01:15.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:15.997 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:15.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:15.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:15.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:15.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:15.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: Deploying daemon mds.d on smithi027 2024-09-13T18:01:15.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1914170115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:15.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.27:6834/2543999093,v1:172.21.15.27:6835/2543999093] up:boot 2024-09-13T18:01:15.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: fsmap 3 up:standby 2024-09-13T18:01:15.998 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T18:01:16.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:16.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:16.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:16.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:16.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:16.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:16.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: Deploying daemon mds.d on smithi027 2024-09-13T18:01:16.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1914170115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:16.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.27:6834/2543999093,v1:172.21.15.27:6835/2543999093] up:boot 2024-09-13T18:01:16.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: fsmap 3 up:standby 2024-09-13T18:01:16.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T18:01:16.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:16.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:16.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:16.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:16.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:16.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:16.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: Deploying daemon mds.d on smithi027 2024-09-13T18:01:16.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1914170115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:16.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.27:6834/2543999093,v1:172.21.15.27:6835/2543999093] up:boot 2024-09-13T18:01:16.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: fsmap 3 up:standby 2024-09-13T18:01:16.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-13T18:01:17.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:16 smithi143 ceph-mon[38210]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:17.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:16 smithi027 ceph-mon[30611]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:17.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:16 smithi122 ceph-mon[35310]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:17.484 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:17.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.660+0000 7fda64c00640 1 -- 172.21.15.27:0/1714960171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 msgr2=0x7fda60072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:17.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.660+0000 7fda64c00640 1 --2- 172.21.15.27:0/1714960171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 0x7fda60072940 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fda58009ca0 tx=0x7fda5802a8b0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.661+0000 7fda64c00640 1 -- 172.21.15.27:0/1714960171 shutdown_connections 2024-09-13T18:01:17.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.661+0000 7fda64c00640 1 --2- 172.21.15.27:0/1714960171 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda60107a20 0x7fda60109ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.661+0000 7fda64c00640 1 --2- 172.21.15.27:0/1714960171 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda60072f10 0x7fda60073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.661+0000 7fda64c00640 1 --2- 172.21.15.27:0/1714960171 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 0x7fda60072940 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.661+0000 7fda64c00640 1 -- 172.21.15.27:0/1714960171 >> 172.21.15.27:0/1714960171 conn(0x7fda600fb330 msgr2=0x7fda600fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:17.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.661+0000 7fda64c00640 1 -- 172.21.15.27:0/1714960171 shutdown_connections 2024-09-13T18:01:17.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.661+0000 7fda64c00640 1 -- 172.21.15.27:0/1714960171 wait complete. 2024-09-13T18:01:17.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda64c00640 1 Processor -- start 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda64c00640 1 -- start start 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda64c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda60072f10 0x7fda60197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda64c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 0x7fda601983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda64c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda60107a20 0x7fda6019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda64c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6019f990 con 0x7fda600744f0 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda64c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6019fb00 con 0x7fda60107a20 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda64c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6019fcc0 con 0x7fda60072f10 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda5ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 0x7fda601983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda5ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 0x7fda601983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60498/0 (socket says 172.21.15.27:60498) 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda5ea00640 1 -- 172.21.15.27:0/2777315504 learned_addr learned my addr 172.21.15.27:0/2777315504 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.662+0000 7fda5fe00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda60107a20 0x7fda6019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:17.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda5f400640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda60072f10 0x7fda60197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda5ea00640 1 -- 172.21.15.27:0/2777315504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda60072f10 msgr2=0x7fda60197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda5ea00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda60072f10 0x7fda60197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda5ea00640 1 -- 172.21.15.27:0/2777315504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda60107a20 msgr2=0x7fda6019f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda5ea00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda60107a20 0x7fda6019f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda5ea00640 1 -- 172.21.15.27:0/2777315504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda58009900 con 0x7fda600744f0 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda5fe00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda60107a20 0x7fda6019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda5ea00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 0x7fda601983e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda5000e9f0 tx=0x7fda5000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda57e00640 1 -- 172.21.15.27:0/2777315504 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50009700 con 0x7fda600744f0 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda57e00640 1 -- 172.21.15.27:0/2777315504 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fda5000cd80 con 0x7fda600744f0 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.663+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6019ffa0 con 0x7fda600744f0 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.664+0000 7fda57e00640 1 -- 172.21.15.27:0/2777315504 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50018920 con 0x7fda600744f0 2024-09-13T18:01:17.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.664+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda601a0470 con 0x7fda600744f0 2024-09-13T18:01:17.668 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.665+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda601067a0 con 0x7fda600744f0 2024-09-13T18:01:17.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.667+0000 7fda57e00640 1 -- 172.21.15.27:0/2777315504 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fda50018a80 con 0x7fda600744f0 2024-09-13T18:01:17.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.668+0000 7fda57e00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fda440a1110 0x7fda440a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:17.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.669+0000 7fda57e00640 1 -- 172.21.15.27:0/2777315504 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fda50014070 con 0x7fda600744f0 2024-09-13T18:01:17.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.669+0000 7fda5f400640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fda440a1110 0x7fda440a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:17.671 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.670+0000 7fda5f400640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fda440a1110 0x7fda440a35d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda58006010 tx=0x7fda58004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:17.675 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.673+0000 7fda57e00640 1 -- 172.21.15.27:0/2777315504 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fda50052e20 con 0x7fda600744f0 2024-09-13T18:01:17.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.893+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda6010d7c0 con 0x7fda600744f0 2024-09-13T18:01:17.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.893+0000 7fda57e00640 1 -- 172.21.15.27:0/2777315504 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7fda500963e0 con 0x7fda600744f0 2024-09-13T18:01:17.895 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:17.895 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:01:17.896 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 4 2024-09-13T18:01:17.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fda440a1110 msgr2=0x7fda440a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:17.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fda440a1110 0x7fda440a35d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda58006010 tx=0x7fda58004a40 comp rx=0 tx=0).stop 2024-09-13T18:01:17.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 msgr2=0x7fda601983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:17.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 0x7fda601983e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda5000e9f0 tx=0x7fda5000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 shutdown_connections 2024-09-13T18:01:17.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fda440a1110 0x7fda440a35d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fda60107a20 0x7fda6019f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fda600744f0 0x7fda601983e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 --2- 172.21.15.27:0/2777315504 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fda60072f10 0x7fda60197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:17.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 >> 172.21.15.27:0/2777315504 conn(0x7fda600fb330 msgr2=0x7fda60103970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:17.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 shutdown_connections 2024-09-13T18:01:17.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:17.896+0000 7fda64c00640 1 -- 172.21.15.27:0/2777315504 wait complete. 2024-09-13T18:01:18.093 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:17 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2777315504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:18.093 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:01:18 smithi027 podman[70206]: 2024-09-13 18:01:18.054132131 +0000 UTC m=+0.347118961 container start 0b503c24d687afe8475cc15d915e88d7c0ceb9a9ea2e5eef78a6370370a48363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-d, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T18:01:18.093 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:01:18 smithi027 ceph-mds[70228]: -- 172.21.15.27:0/3261764983 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55ea8c759340 con 0x55ea8c727000 2024-09-13T18:01:18.094 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:01:18 smithi027 ceph-mds[70228]: -- 172.21.15.27:0/3261764983 <== mon.0 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ea8c752d00 con 0x55ea8c727000 2024-09-13T18:01:18.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:17 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2777315504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:18.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:17 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2777315504' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:18.557 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:01:18 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-d[70224]: starting mds.d at 2024-09-13T18:01:18.557 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:01:18 smithi027 bash[70206]: 0b503c24d687afe8475cc15d915e88d7c0ceb9a9ea2e5eef78a6370370a48363 2024-09-13T18:01:18.557 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:01:18 smithi027 systemd[1]: Started Ceph mds.d for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:19.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: Deploying daemon mds.e on smithi122 2024-09-13T18:01:19.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.27:6836/1224306728,v1:172.21.15.27:6837/1224306728] up:boot 2024-09-13T18:01:19.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: fsmap 4 up:standby 2024-09-13T18:01:19.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:19 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: Deploying daemon mds.e on smithi122 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.27:6836/1224306728,v1:172.21.15.27:6837/1224306728] up:boot 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: fsmap 4 up:standby 2024-09-13T18:01:19.493 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:19 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T18:01:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: Deploying daemon mds.e on smithi122 2024-09-13T18:01:19.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.27:6836/1224306728,v1:172.21.15.27:6837/1224306728] up:boot 2024-09-13T18:01:19.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: fsmap 4 up:standby 2024-09-13T18:01:19.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:19 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-13T18:01:19.915 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:20.089 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.087+0000 7fcd07400640 1 -- 172.21.15.27:0/2493419853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00101950 msgr2=0x7fcd001081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:20.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.087+0000 7fcd07400640 1 --2- 172.21.15.27:0/2493419853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00101950 0x7fcd001081e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fccf8009ca0 tx=0x7fccf802a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.087+0000 7fcd07400640 1 -- 172.21.15.27:0/2493419853 shutdown_connections 2024-09-13T18:01:20.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.087+0000 7fcd07400640 1 --2- 172.21.15.27:0/2493419853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00101950 0x7fcd001081e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.087+0000 7fcd07400640 1 --2- 172.21.15.27:0/2493419853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd00100f90 0x7fcd00101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.087+0000 7fcd07400640 1 --2- 172.21.15.27:0/2493419853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000ffda0 0x7fcd001001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.087+0000 7fcd07400640 1 -- 172.21.15.27:0/2493419853 >> 172.21.15.27:0/2493419853 conn(0x7fcd000fb520 msgr2=0x7fcd000fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:20.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.088+0000 7fcd07400640 1 -- 172.21.15.27:0/2493419853 shutdown_connections 2024-09-13T18:01:20.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.088+0000 7fcd07400640 1 -- 172.21.15.27:0/2493419853 wait complete. 2024-09-13T18:01:20.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.088+0000 7fcd07400640 1 Processor -- start 2024-09-13T18:01:20.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fcd07400640 1 -- start start 2024-09-13T18:01:20.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fcd07400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000ffda0 0x7fcd00198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:20.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fcd07400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00100f90 0x7fcd001985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:20.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fcd07400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd00101950 0x7fcd0019f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:20.092 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fcd07400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0019fb70 con 0x7fcd00101950 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fcd07400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0019fce0 con 0x7fcd00100f90 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fcd07400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0019fea0 con 0x7fcd000ffda0 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00100f90 0x7fcd001985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fcd05400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd00101950 0x7fcd0019f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00100f90 0x7fcd001985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:60446/0 (socket says 172.21.15.27:60446) 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fccf7e00640 1 -- 172.21.15.27:0/2896343008 learned_addr learned my addr 172.21.15.27:0/2896343008 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fcd04a00640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000ffda0 0x7fcd00198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.089+0000 7fccf7e00640 1 -- 172.21.15.27:0/2896343008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000ffda0 msgr2=0x7fcd00198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fccf7e00640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000ffda0 0x7fcd00198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fccf7e00640 1 -- 172.21.15.27:0/2896343008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd00101950 msgr2=0x7fcd0019f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fccf7e00640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd00101950 0x7fcd0019f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fccf7e00640 1 -- 172.21.15.27:0/2896343008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce8009490 con 0x7fcd00100f90 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fccf7e00640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00100f90 0x7fcd001985c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcce800ea60 tx=0x7fcce800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:20.093 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fccfe000640 1 -- 172.21.15.27:0/2896343008 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800cde0 con 0x7fcd00100f90 2024-09-13T18:01:20.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fccfe000640 1 -- 172.21.15.27:0/2896343008 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcce80035f0 con 0x7fcd00100f90 2024-09-13T18:01:20.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf8009900 con 0x7fcd00100f90 2024-09-13T18:01:20.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fccfe000640 1 -- 172.21.15.27:0/2896343008 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8010690 con 0x7fcd00100f90 2024-09-13T18:01:20.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.090+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd001a0550 con 0x7fcd00100f90 2024-09-13T18:01:20.094 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.091+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0010b830 con 0x7fcd00100f90 2024-09-13T18:01:20.095 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.093+0000 7fccfe000640 1 -- 172.21.15.27:0/2896343008 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcce8003af0 con 0x7fcd00100f90 2024-09-13T18:01:20.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.094+0000 7fccfe000640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcce40a1110 0x7fcce40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:20.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.094+0000 7fccfe000640 1 -- 172.21.15.27:0/2896343008 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcce8014070 con 0x7fcd00100f90 2024-09-13T18:01:20.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.095+0000 7fcd04a00640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcce40a1110 0x7fcce40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:20.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.095+0000 7fcd04a00640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcce40a1110 0x7fcce40a35d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcd00100df0 tx=0x7fccf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:20.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.096+0000 7fccfe000640 1 -- 172.21.15.27:0/2896343008 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcce8096be0 con 0x7fcd00100f90 2024-09-13T18:01:20.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.314+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd0010b9c0 con 0x7fcd00100f90 2024-09-13T18:01:20.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.315+0000 7fccfe000640 1 -- 172.21.15.27:0/2896343008 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3534 (secure 0 0 0) 0x7fcce809a200 con 0x7fcd00100f90 2024-09-13T18:01:20.317 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:20.317 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:01:20.318 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 5 2024-09-13T18:01:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcce40a1110 msgr2=0x7fcce40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcce40a1110 0x7fcce40a35d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcd00100df0 tx=0x7fccf0005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:20.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00100f90 msgr2=0x7fcd001985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00100f90 0x7fcd001985c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcce800ea60 tx=0x7fcce800ef20 comp rx=0 tx=0).stop 2024-09-13T18:01:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 shutdown_connections 2024-09-13T18:01:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcce40a1110 0x7fcce40a35d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fcd00101950 0x7fcd0019f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fcd00100f90 0x7fcd001985c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 --2- 172.21.15.27:0/2896343008 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fcd000ffda0 0x7fcd00198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 >> 172.21.15.27:0/2896343008 conn(0x7fcd000fb520 msgr2=0x7fcd000726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 shutdown_connections 2024-09-13T18:01:20.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:20.317+0000 7fcd07400640 1 -- 172.21.15.27:0/2896343008 wait complete. 2024-09-13T18:01:20.376 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:01:20 smithi122 systemd[1]: Starting Ceph mds.e for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:01:20.634 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:01:20 smithi122 podman[64982]: 2024-09-13 18:01:20.277674932 +0000 UTC m=+0.016445105 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:01:20.634 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:01:20 smithi122 podman[64982]: 2024-09-13 18:01:20.379346382 +0000 UTC m=+0.118116540 container create f9e4ac08501cb4e62303c95cc8d1bddc3cc4ec46031eb148bcc5ea45ca2be3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T18:01:20.634 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:01:20 smithi122 podman[64982]: 2024-09-13 18:01:20.606832125 +0000 UTC m=+0.345602284 container init f9e4ac08501cb4e62303c95cc8d1bddc3cc4ec46031eb148bcc5ea45ca2be3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-13T18:01:20.634 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:01:20 smithi122 podman[64982]: 2024-09-13 18:01:20.609599549 +0000 UTC m=+0.348369709 container start f9e4ac08501cb4e62303c95cc8d1bddc3cc4ec46031eb148bcc5ea45ca2be3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T18:01:20.634 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:01:20 smithi122 ceph-mds[65001]: -- 172.21.15.122:0/678869412 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bc1f53cd00 con 0x55bc1f511400 2024-09-13T18:01:20.964 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:01:20 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e[64997]: starting mds.e at 2024-09-13T18:01:20.964 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:01:20 smithi122 bash[64982]: f9e4ac08501cb4e62303c95cc8d1bddc3cc4ec46031eb148bcc5ea45ca2be3dd 2024-09-13T18:01:20.964 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:01:20 smithi122 systemd[1]: Started Ceph mds.e for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:21.435 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:21 smithi143 ceph-mon[38210]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:21.435 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:21 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2896343008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:21.435 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:21.435 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:21.435 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:21.435 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:21.436 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:21.436 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:21 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:21 smithi027 ceph-mon[30611]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:21 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2896343008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:21 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:21.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:21 smithi122 ceph-mon[35310]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:21.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:21 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2896343008' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:21.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:21.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:21.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:21.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:21.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:21.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:21 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:22.336 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:22.481 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:22 smithi143 ceph-mon[38210]: Deploying daemon mds.f on smithi143 2024-09-13T18:01:22.481 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:22 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6834/1011366471,v1:172.21.15.122:6835/1011366471] up:boot 2024-09-13T18:01:22.482 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:22 smithi143 ceph-mon[38210]: fsmap 5 up:standby 2024-09-13T18:01:22.482 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:22 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:01:22.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.507+0000 7f9fc5400640 1 -- 172.21.15.27:0/2862544807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc0072f10 msgr2=0x7f9fc0073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.507+0000 7f9fc5400640 1 --2- 172.21.15.27:0/2862544807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc0072f10 0x7f9fc0073370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009900 tx=0x7f9fa802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.507+0000 7f9fc5400640 1 -- 172.21.15.27:0/2862544807 shutdown_connections 2024-09-13T18:01:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.507+0000 7f9fc5400640 1 --2- 172.21.15.27:0/2862544807 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc010c370 0x7f9fc010e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.507+0000 7f9fc5400640 1 --2- 172.21.15.27:0/2862544807 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc0072f10 0x7f9fc0073370 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.507+0000 7f9fc5400640 1 --2- 172.21.15.27:0/2862544807 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc00744f0 0x7f9fc0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.507+0000 7f9fc5400640 1 -- 172.21.15.27:0/2862544807 >> 172.21.15.27:0/2862544807 conn(0x7f9fc00fb520 msgr2=0x7f9fc00fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.508+0000 7f9fc5400640 1 -- 172.21.15.27:0/2862544807 shutdown_connections 2024-09-13T18:01:22.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.508+0000 7f9fc5400640 1 -- 172.21.15.27:0/2862544807 wait complete. 2024-09-13T18:01:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.508+0000 7f9fc5400640 1 Processor -- start 2024-09-13T18:01:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fc5400640 1 -- start start 2024-09-13T18:01:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fc5400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc0072f10 0x7f9fc019c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fc5400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc00744f0 0x7f9fc019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fc5400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc010c370 0x7f9fc01a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fc5400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01a3f70 con 0x7f9fc0072f10 2024-09-13T18:01:22.512 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fc5400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01a40e0 con 0x7f9fc00744f0 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fc5400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc01a42a0 con 0x7f9fc010c370 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fbe800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc0072f10 0x7f9fc019c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fbe800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc0072f10 0x7f9fc019c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:44980/0 (socket says 172.21.15.27:44980) 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fbe800640 1 -- 172.21.15.27:0/3510923135 learned_addr learned my addr 172.21.15.27:0/3510923135 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fb5e00640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc00744f0 0x7f9fc019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fbf200640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc010c370 0x7f9fc01a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fbe800640 1 -- 172.21.15.27:0/3510923135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc010c370 msgr2=0x7f9fc01a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fbe800640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc010c370 0x7f9fc01a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fbe800640 1 -- 172.21.15.27:0/3510923135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc00744f0 msgr2=0x7f9fc019c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fbe800640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc00744f0 0x7f9fc019c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.509+0000 7f9fbe800640 1 -- 172.21.15.27:0/3510923135 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009490 con 0x7f9fc0072f10 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.510+0000 7f9fbe800640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc0072f10 0x7f9fc019c480 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000ea60 tx=0x7f9fb000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.510+0000 7f9fb7e00640 1 -- 172.21.15.27:0/3510923135 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000cde0 con 0x7f9fc0072f10 2024-09-13T18:01:22.513 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.510+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa8009560 con 0x7f9fc0072f10 2024-09-13T18:01:22.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.510+0000 7f9fb7e00640 1 -- 172.21.15.27:0/3510923135 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9fb00035f0 con 0x7f9fc0072f10 2024-09-13T18:01:22.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.510+0000 7f9fb7e00640 1 -- 172.21.15.27:0/3510923135 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0005220 con 0x7f9fc0072f10 2024-09-13T18:01:22.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.510+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc01a4920 con 0x7f9fc0072f10 2024-09-13T18:01:22.514 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.511+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc0102540 con 0x7f9fc0072f10 2024-09-13T18:01:22.515 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.513+0000 7f9fb7e00640 1 -- 172.21.15.27:0/3510923135 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9fb0003af0 con 0x7f9fc0072f10 2024-09-13T18:01:22.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.514+0000 7f9fb7e00640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9fa40a1090 0x7f9fa40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:22.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.515+0000 7f9fb7e00640 1 -- 172.21.15.27:0/3510923135 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9fb0014070 con 0x7f9fc0072f10 2024-09-13T18:01:22.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.515+0000 7f9fb5e00640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9fa40a1090 0x7f9fa40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:22.517 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.516+0000 7f9fb5e00640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9fa40a1090 0x7f9fa40a3550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8005ab0 tx=0x7f9fa8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:22.520 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.519+0000 7f9fb7e00640 1 -- 172.21.15.27:0/3510923135 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9fb0096520 con 0x7f9fc0072f10 2024-09-13T18:01:22.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:22 smithi027 ceph-mon[30611]: Deploying daemon mds.f on smithi143 2024-09-13T18:01:22.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:22 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6834/1011366471,v1:172.21.15.122:6835/1011366471] up:boot 2024-09-13T18:01:22.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:22 smithi027 ceph-mon[30611]: fsmap 5 up:standby 2024-09-13T18:01:22.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:22 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:01:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:22 smithi122 ceph-mon[35310]: Deploying daemon mds.f on smithi143 2024-09-13T18:01:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:22 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6834/1011366471,v1:172.21.15.122:6835/1011366471] up:boot 2024-09-13T18:01:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:22 smithi122 ceph-mon[35310]: fsmap 5 up:standby 2024-09-13T18:01:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:22 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:01:22.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.736+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9fc0111e00 con 0x7f9fc0072f10 2024-09-13T18:01:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.737+0000 7f9fb7e00640 1 -- 172.21.15.27:0/3510923135 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4294 (secure 0 0 0) 0x7f9fb0099b40 con 0x7f9fc0072f10 2024-09-13T18:01:22.739 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:22.739 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-09-13T18:01:22.740 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 6 2024-09-13T18:01:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9fa40a1090 msgr2=0x7f9fa40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9fa40a1090 0x7f9fa40a3550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8005ab0 tx=0x7f9fa8005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc0072f10 msgr2=0x7f9fc019c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc0072f10 0x7f9fc019c480 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000ea60 tx=0x7f9fb000ef20 comp rx=0 tx=0).stop 2024-09-13T18:01:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 shutdown_connections 2024-09-13T18:01:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9fa40a1090 0x7f9fa40a3550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9fc010c370 0x7f9fc01a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9fc00744f0 0x7f9fc019c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 --2- 172.21.15.27:0/3510923135 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9fc0072f10 0x7f9fc019c480 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.739+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 >> 172.21.15.27:0/3510923135 conn(0x7f9fc00fb520 msgr2=0x7f9fc00ff710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.740+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 shutdown_connections 2024-09-13T18:01:22.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:22.740+0000 7f9fc5400640 1 -- 172.21.15.27:0/3510923135 wait complete. 2024-09-13T18:01:22.775 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:01:22 smithi143 systemd[1]: Starting Ceph mds.f for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:01:23.123 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:01:22 smithi143 podman[68418]: 2024-09-13 18:01:22.773185403 +0000 UTC m=+0.015520790 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:01:23.123 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:01:22 smithi143 podman[68418]: 2024-09-13 18:01:22.900043653 +0000 UTC m=+0.142379023 container create 99127e990e2b2c6e845c19f938da84efe97d32cd2df9929a625192eff5d273bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:01:23.123 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:01:23 smithi143 podman[68418]: 2024-09-13 18:01:23.119128839 +0000 UTC m=+0.361464210 container init 99127e990e2b2c6e845c19f938da84efe97d32cd2df9929a625192eff5d273bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T18:01:23.124 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:01:23 smithi143 podman[68418]: 2024-09-13 18:01:23.122045125 +0000 UTC m=+0.364380504 container start 99127e990e2b2c6e845c19f938da84efe97d32cd2df9929a625192eff5d273bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:01:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:23 smithi143 ceph-mon[38210]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:23 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3510923135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:23.525 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:01:23 smithi143 ceph-mds[68437]: -- 172.21.15.143:0/2180487958 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558c5fbacd00 con 0x558c5fb81000 2024-09-13T18:01:23.526 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:01:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f[68433]: starting mds.f at 2024-09-13T18:01:23.526 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:01:23 smithi143 bash[68418]: 99127e990e2b2c6e845c19f938da84efe97d32cd2df9929a625192eff5d273bb 2024-09-13T18:01:23.526 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:01:23 smithi143 systemd[1]: Started Ceph mds.f for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:23 smithi027 ceph-mon[30611]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:23 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3510923135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:23 smithi122 ceph-mon[35310]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:23.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:23 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3510923135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:24.495 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6834/1530941636,v1:172.21.15.143:6835/1530941636] up:boot 2024-09-13T18:01:24.495 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: fsmap 6 up:standby 2024-09-13T18:01:24.495 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:01:24.496 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:24.496 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:24.496 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:24.496 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:24.496 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:24.496 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:24.496 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:24 smithi143 ceph-mon[38210]: Deploying daemon mds.c on smithi143 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6834/1530941636,v1:172.21.15.143:6835/1530941636] up:boot 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: fsmap 6 up:standby 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:24.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:24 smithi027 ceph-mon[30611]: Deploying daemon mds.c on smithi143 2024-09-13T18:01:24.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6834/1530941636,v1:172.21.15.143:6835/1530941636] up:boot 2024-09-13T18:01:24.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: fsmap 6 up:standby 2024-09-13T18:01:24.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:01:24.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:24.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:24.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:24.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:24.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:24.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:24.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:24 smithi122 ceph-mon[35310]: Deploying daemon mds.c on smithi143 2024-09-13T18:01:24.758 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.928+0000 7fe9f1000640 1 -- 172.21.15.27:0/1812067274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec101930 msgr2=0x7fe9ec1081c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.928+0000 7fe9f1000640 1 --2- 172.21.15.27:0/1812067274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec101930 0x7fe9ec1081c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009ca0 tx=0x7fe9e402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:24.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.928+0000 7fe9f1000640 1 -- 172.21.15.27:0/1812067274 shutdown_connections 2024-09-13T18:01:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.928+0000 7fe9f1000640 1 --2- 172.21.15.27:0/1812067274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec101930 0x7fe9ec1081c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.928+0000 7fe9f1000640 1 --2- 172.21.15.27:0/1812067274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9ec100f70 0x7fe9ec1013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.928+0000 7fe9f1000640 1 --2- 172.21.15.27:0/1812067274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9ec0ffd80 0x7fe9ec100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.928+0000 7fe9f1000640 1 -- 172.21.15.27:0/1812067274 >> 172.21.15.27:0/1812067274 conn(0x7fe9ec0fb500 msgr2=0x7fe9ec0fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.928+0000 7fe9f1000640 1 -- 172.21.15.27:0/1812067274 shutdown_connections 2024-09-13T18:01:24.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.928+0000 7fe9f1000640 1 -- 172.21.15.27:0/1812067274 wait complete. 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.929+0000 7fe9f1000640 1 Processor -- start 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.929+0000 7fe9f1000640 1 -- start start 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9f1000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9ec0ffd80 0x7fe9ec197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9f1000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9ec100f70 0x7fe9ec198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9f1000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec101930 0x7fe9ec19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9f1000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec19fae0 con 0x7fe9ec101930 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9f1000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec19fc50 con 0x7fe9ec0ffd80 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9f1000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec19fe10 con 0x7fe9ec100f70 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9e9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9ec100f70 0x7fe9ec198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:24.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9ea800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec101930 0x7fe9ec19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9e9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9ec100f70 0x7fe9ec198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:47908/0 (socket says 172.21.15.27:47908) 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9e9400640 1 -- 172.21.15.27:0/3932839388 learned_addr learned my addr 172.21.15.27:0/3932839388 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9e9e00640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9ec0ffd80 0x7fe9ec197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9e9400640 1 -- 172.21.15.27:0/3932839388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9ec0ffd80 msgr2=0x7fe9ec197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9e9400640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9ec0ffd80 0x7fe9ec197ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9e9400640 1 -- 172.21.15.27:0/3932839388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec101930 msgr2=0x7fe9ec19f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9e9400640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec101930 0x7fe9ec19f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.930+0000 7fe9e9400640 1 -- 172.21.15.27:0/3932839388 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4009900 con 0x7fe9ec100f70 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.931+0000 7fe9e9400640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9ec100f70 0x7fe9ec198530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800e9f0 tx=0x7fe9d800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.931+0000 7fe9e2a00640 1 -- 172.21.15.27:0/3932839388 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8009700 con 0x7fe9ec100f70 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.931+0000 7fe9e2a00640 1 -- 172.21.15.27:0/3932839388 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe9d800cd80 con 0x7fe9ec100f70 2024-09-13T18:01:24.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.931+0000 7fe9e2a00640 1 -- 172.21.15.27:0/3932839388 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8018920 con 0x7fe9ec100f70 2024-09-13T18:01:24.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.931+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec1a00f0 con 0x7fe9ec100f70 2024-09-13T18:01:24.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.931+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec1a0600 con 0x7fe9ec100f70 2024-09-13T18:01:24.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.932+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec10b7c0 con 0x7fe9ec100f70 2024-09-13T18:01:24.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.935+0000 7fe9e2a00640 1 -- 172.21.15.27:0/3932839388 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe9d8018a80 con 0x7fe9ec100f70 2024-09-13T18:01:24.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.936+0000 7fe9e2a00640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9d00a1110 0x7fe9d00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:24.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.936+0000 7fe9e2a00640 1 -- 172.21.15.27:0/3932839388 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe9d8014070 con 0x7fe9ec100f70 2024-09-13T18:01:24.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.936+0000 7fe9e9e00640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9d00a1110 0x7fe9d00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:24.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.937+0000 7fe9e9e00640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9d00a1110 0x7fe9d00a35d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec100dd0 tx=0x7fe9dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:24.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:24.940+0000 7fe9e2a00640 1 -- 172.21.15.27:0/3932839388 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe9d8052e20 con 0x7fe9ec100f70 2024-09-13T18:01:25.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.158+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9ec10b9a0 con 0x7fe9ec100f70 2024-09-13T18:01:25.161 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.159+0000 7fe9e2a00640 1 -- 172.21.15.27:0/3932839388 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5054 (secure 0 0 0) 0x7fe9d8096440 con 0x7fe9ec100f70 2024-09-13T18:01:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:25.161 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2024-09-13T18:01:25.161 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 7 2024-09-13T18:01:25.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.161+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9d00a1110 msgr2=0x7fe9d00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.161+0000 7fe9f1000640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9d00a1110 0x7fe9d00a35d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec100dd0 tx=0x7fe9dc005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.161+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9ec100f70 msgr2=0x7fe9ec198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.161+0000 7fe9f1000640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9ec100f70 0x7fe9ec198530 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe9d800e9f0 tx=0x7fe9d800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.161+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 shutdown_connections 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.161+0000 7fe9f1000640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9d00a1110 0x7fe9d00a35d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.162+0000 7fe9f1000640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe9ec101930 0x7fe9ec19f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.162+0000 7fe9f1000640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe9ec100f70 0x7fe9ec198530 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.162+0000 7fe9f1000640 1 --2- 172.21.15.27:0/3932839388 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe9ec0ffd80 0x7fe9ec197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.162+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 >> 172.21.15.27:0/3932839388 conn(0x7fe9ec0fb500 msgr2=0x7fe9ec0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.162+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 shutdown_connections 2024-09-13T18:01:25.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:25.162+0000 7fe9f1000640 1 -- 172.21.15.27:0/3932839388 wait complete. 2024-09-13T18:01:25.178 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:01:24 smithi143 systemd[1]: Starting Ceph mds.c for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:01:25.434 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:25 smithi143 ceph-mon[38210]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:25.434 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:25 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3932839388' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:25.434 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:01:25 smithi143 podman[68719]: 2024-09-13 18:01:25.079723445 +0000 UTC m=+0.015594505 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:01:25.434 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:01:25 smithi143 podman[68719]: 2024-09-13 18:01:25.204955516 +0000 UTC m=+0.140826559 container create 28518d241256de01e48c552433661e3d0ddc41be966669bc67829d8f2ec10122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T18:01:25.434 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:01:25 smithi143 podman[68719]: 2024-09-13 18:01:25.40744364 +0000 UTC m=+0.343314690 container init 28518d241256de01e48c552433661e3d0ddc41be966669bc67829d8f2ec10122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-13T18:01:25.434 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:01:25 smithi143 podman[68719]: 2024-09-13 18:01:25.410174693 +0000 UTC m=+0.346045738 container start 28518d241256de01e48c552433661e3d0ddc41be966669bc67829d8f2ec10122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T18:01:25.435 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:01:25 smithi143 ceph-mds[68738]: -- 172.21.15.143:0/964012599 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55569fd04d00 con 0x55569fcd9000 2024-09-13T18:01:25.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:25 smithi027 ceph-mon[30611]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:25.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:25 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3932839388' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:25.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:25 smithi122 ceph-mon[35310]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:25.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:25 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3932839388' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:25.775 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:01:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c[68734]: starting mds.c at 2024-09-13T18:01:25.775 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:01:25 smithi143 bash[68719]: 28518d241256de01e48c552433661e3d0ddc41be966669bc67829d8f2ec10122 2024-09-13T18:01:25.776 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:01:25 smithi143 systemd[1]: Started Ceph mds.c for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: Deploying daemon mds.h on smithi122 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6836/3738799013,v1:172.21.15.143:6837/3738799013] up:boot 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: fsmap 7 up:standby 2024-09-13T18:01:26.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:26 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:01:26.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:26.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:26.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:26.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:26.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:26.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:26.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:26.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: Deploying daemon mds.h on smithi122 2024-09-13T18:01:26.965 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6836/3738799013,v1:172.21.15.143:6837/3738799013] up:boot 2024-09-13T18:01:26.965 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: fsmap 7 up:standby 2024-09-13T18:01:26.965 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:26 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: Deploying daemon mds.h on smithi122 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6836/3738799013,v1:172.21.15.143:6837/3738799013] up:boot 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: fsmap 7 up:standby 2024-09-13T18:01:27.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:26 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:01:27.180 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.350+0000 7f947de00640 1 -- 172.21.15.27:0/1699495697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478101290 msgr2=0x7f9478101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.350+0000 7f947de00640 1 --2- 172.21.15.27:0/1699495697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478101290 0x7f9478101690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f946c009900 tx=0x7f946c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.351+0000 7f947de00640 1 -- 172.21.15.27:0/1699495697 shutdown_connections 2024-09-13T18:01:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.351+0000 7f947de00640 1 --2- 172.21.15.27:0/1699495697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9478100180 0x7f9478107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.351+0000 7f947de00640 1 --2- 172.21.15.27:0/1699495697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94780ff7c0 0x7f94780ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.351+0000 7f947de00640 1 --2- 172.21.15.27:0/1699495697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478101290 0x7f9478101690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.351+0000 7f947de00640 1 -- 172.21.15.27:0/1699495697 >> 172.21.15.27:0/1699495697 conn(0x7f94780fb310 msgr2=0x7f94780fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.351+0000 7f947de00640 1 -- 172.21.15.27:0/1699495697 shutdown_connections 2024-09-13T18:01:27.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.351+0000 7f947de00640 1 -- 172.21.15.27:0/1699495697 wait complete. 2024-09-13T18:01:27.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947de00640 1 Processor -- start 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947de00640 1 -- start start 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94780ff7c0 0x7f9478195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478100180 0x7f9478196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947de00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9478101290 0x7f947819d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947de00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947819d8f0 con 0x7f94780ff7c0 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947de00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947819da60 con 0x7f9478100180 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947de00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947819dc20 con 0x7f9478101290 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f9477e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478100180 0x7f9478196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f9477e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478100180 0x7f9478196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:60512/0 (socket says 172.21.15.27:60512) 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f9477e00640 1 -- 172.21.15.27:0/2983067436 learned_addr learned my addr 172.21.15.27:0/2983067436 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:27.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947ca00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94780ff7c0 0x7f9478195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f947d400640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9478101290 0x7f947819d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f9477e00640 1 -- 172.21.15.27:0/2983067436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9478101290 msgr2=0x7f947819d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.352+0000 7f9477e00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9478101290 0x7f947819d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.353+0000 7f9477e00640 1 -- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94780ff7c0 msgr2=0x7f9478195e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.353+0000 7f9477e00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94780ff7c0 0x7f9478195e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.353+0000 7f9477e00640 1 -- 172.21.15.27:0/2983067436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c009560 con 0x7f9478100180 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.353+0000 7f9477e00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478100180 0x7f9478196340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f946400e9f0 tx=0x7f946400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.353+0000 7f9475600640 1 -- 172.21.15.27:0/2983067436 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464009720 con 0x7f9478100180 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.353+0000 7f9475600640 1 -- 172.21.15.27:0/2983067436 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f946400cd80 con 0x7f9478100180 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.353+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947819df00 con 0x7f9478100180 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.353+0000 7f9475600640 1 -- 172.21.15.27:0/2983067436 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9464010690 con 0x7f9478100180 2024-09-13T18:01:27.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.353+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947819e380 con 0x7f9478100180 2024-09-13T18:01:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.354+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94780ffc40 con 0x7f9478100180 2024-09-13T18:01:27.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.356+0000 7f9475600640 1 -- 172.21.15.27:0/2983067436 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f94640046c0 con 0x7f9478100180 2024-09-13T18:01:27.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.357+0000 7f9475600640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94600a1110 0x7f94600a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:27.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.357+0000 7f9475600640 1 -- 172.21.15.27:0/2983067436 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9464014070 con 0x7f9478100180 2024-09-13T18:01:27.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.357+0000 7f947ca00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94600a1110 0x7f94600a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:27.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.358+0000 7f947ca00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94600a1110 0x7f94600a35d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f946c009230 tx=0x7f946c0314d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:27.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.362+0000 7f9475600640 1 -- 172.21.15.27:0/2983067436 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f94640964f0 con 0x7f9478100180 2024-09-13T18:01:27.579 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.577+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f947810b740 con 0x7f9478100180 2024-09-13T18:01:27.580 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.578+0000 7f9475600640 1 -- 172.21.15.27:0/2983067436 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5814 (secure 0 0 0) 0x7f9464099b10 con 0x7f9478100180 2024-09-13T18:01:27.580 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:27.581 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-09-13T18:01:27.581 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 8 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.580+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94600a1110 msgr2=0x7f94600a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.580+0000 7f947de00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94600a1110 0x7f94600a35d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f946c009230 tx=0x7f946c0314d0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.580+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478100180 msgr2=0x7f9478196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.580+0000 7f947de00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478100180 0x7f9478196340 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f946400e9f0 tx=0x7f946400edf0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.581+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 shutdown_connections 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.581+0000 7f947de00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94600a1110 0x7f94600a35d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.581+0000 7f947de00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9478101290 0x7f947819d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.581+0000 7f947de00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9478100180 0x7f9478196340 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.581+0000 7f947de00640 1 --2- 172.21.15.27:0/2983067436 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94780ff7c0 0x7f9478195e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.581+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 >> 172.21.15.27:0/2983067436 conn(0x7f94780fb310 msgr2=0x7f94781041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:27.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.581+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 shutdown_connections 2024-09-13T18:01:27.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:27.581+0000 7f947de00640 1 -- 172.21.15.27:0/2983067436 wait complete. 2024-09-13T18:01:27.714 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:01:27 smithi122 systemd[1]: Starting Ceph mds.h for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:01:28.089 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:01:27 smithi122 podman[65284]: 2024-09-13 18:01:27.686329761 +0000 UTC m=+0.015555695 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:01:28.089 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:01:27 smithi122 podman[65284]: 2024-09-13 18:01:27.826413914 +0000 UTC m=+0.155639844 container create 66dd7dec73693d57eee8b95a6f9a19e6693b5b61a6dc9851129e4da36adae591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T18:01:28.089 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:01:28 smithi122 podman[65284]: 2024-09-13 18:01:28.087547459 +0000 UTC m=+0.416773384 container init 66dd7dec73693d57eee8b95a6f9a19e6693b5b61a6dc9851129e4da36adae591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T18:01:28.464 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:01:28 smithi122 podman[65284]: 2024-09-13 18:01:28.09032788 +0000 UTC m=+0.419553806 container start 66dd7dec73693d57eee8b95a6f9a19e6693b5b61a6dc9851129e4da36adae591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:01:28.464 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mds[65303]: -- 172.21.15.122:0/22184593 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557eb4b64d00 con 0x557eb4b38800 2024-09-13T18:01:28.464 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h[65299]: starting mds.h at 2024-09-13T18:01:28.464 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:01:28 smithi122 bash[65284]: 66dd7dec73693d57eee8b95a6f9a19e6693b5b61a6dc9851129e4da36adae591 2024-09-13T18:01:28.464 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:01:28 smithi122 systemd[1]: Started Ceph mds.h for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:28.890 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:28 smithi143 ceph-mon[38210]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:28.890 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:28 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2983067436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:28.890 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:28 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:28.890 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:28 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:28.891 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:28 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:28.891 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:28 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:28.891 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:28 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:28.891 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:28 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:28.891 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:28 smithi143 ceph-mon[38210]: Deploying daemon mds.i on smithi143 2024-09-13T18:01:28.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mon[35310]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:28.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2983067436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:28.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:28.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:28.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:28.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:28.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:28.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:28.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:28 smithi122 ceph-mon[35310]: Deploying daemon mds.i on smithi143 2024-09-13T18:01:29.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:28 smithi027 ceph-mon[30611]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:29.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:28 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2983067436' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:29.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:28 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:29.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:28 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:29.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:28 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:29.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:28 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:29.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:28 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:29.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:28 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:29.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:28 smithi027 ceph-mon[30611]: Deploying daemon mds.i on smithi143 2024-09-13T18:01:29.600 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:29.666 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:29 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] up:boot 2024-09-13T18:01:29.667 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:29 smithi143 ceph-mon[38210]: fsmap 8 up:standby 2024-09-13T18:01:29.667 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:29 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:01:29.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.770+0000 7f467c400640 1 -- 172.21.15.27:0/186016782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4674105a80 msgr2=0x7f4674107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:29.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.770+0000 7f467c400640 1 --2- 172.21.15.27:0/186016782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4674105a80 0x7f4674107ef0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f466c009be0 tx=0x7f466c02a6c0 comp rx=0 tx=0).stop 2024-09-13T18:01:29.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.770+0000 7f467c400640 1 -- 172.21.15.27:0/186016782 shutdown_connections 2024-09-13T18:01:29.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.770+0000 7f467c400640 1 --2- 172.21.15.27:0/186016782 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4674105a80 0x7f4674107ef0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:29.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.770+0000 7f467c400640 1 --2- 172.21.15.27:0/186016782 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4674103150 0x7f4674105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:29.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.770+0000 7f467c400640 1 --2- 172.21.15.27:0/186016782 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4674100820 0x7f4674102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:29.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.770+0000 7f467c400640 1 -- 172.21.15.27:0/186016782 >> 172.21.15.27:0/186016782 conn(0x7f46740fa420 msgr2=0x7f46740fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:29.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.770+0000 7f467c400640 1 -- 172.21.15.27:0/186016782 shutdown_connections 2024-09-13T18:01:29.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.771+0000 7f467c400640 1 -- 172.21.15.27:0/186016782 wait complete. 2024-09-13T18:01:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f467c400640 1 Processor -- start 2024-09-13T18:01:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f467c400640 1 -- start start 2024-09-13T18:01:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f467c400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4674100820 0x7f4674198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:29.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f467c400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4674103150 0x7f4674198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f467c400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4674105a80 0x7f467419f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f467c400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467419fc10 con 0x7f4674103150 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f467c400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467419fd80 con 0x7f4674105a80 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f467c400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467419ff40 con 0x7f4674100820 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f4679a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4674100820 0x7f4674198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f4679000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4674103150 0x7f4674198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f4679a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4674100820 0x7f4674198120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:47962/0 (socket says 172.21.15.27:47962) 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f4679a00640 1 -- 172.21.15.27:0/4215856843 learned_addr learned my addr 172.21.15.27:0/4215856843 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.772+0000 7f467a400640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4674105a80 0x7f467419f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4679a00640 1 -- 172.21.15.27:0/4215856843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4674105a80 msgr2=0x7f467419f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4679a00640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4674105a80 0x7f467419f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4679a00640 1 -- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4674103150 msgr2=0x7f4674198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:29.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4679a00640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4674103150 0x7f4674198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4679a00640 1 -- 172.21.15.27:0/4215856843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009840 con 0x7f4674100820 2024-09-13T18:01:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f467a400640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4674105a80 0x7f467419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:01:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4679000640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4674103150 0x7f4674198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4679a00640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4674100820 0x7f4674198120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f466800d950 tx=0x7f466800dd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4672000640 1 -- 172.21.15.27:0/4215856843 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800de80 con 0x7f4674100820 2024-09-13T18:01:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46741a0220 con 0x7f4674100820 2024-09-13T18:01:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4672000640 1 -- 172.21.15.27:0/4215856843 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4668004020 con 0x7f4674100820 2024-09-13T18:01:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f4672000640 1 -- 172.21.15.27:0/4215856843 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46680047a0 con 0x7f4674100820 2024-09-13T18:01:29.777 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.773+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46741a0730 con 0x7f4674100820 2024-09-13T18:01:29.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.774+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4674107570 con 0x7f4674100820 2024-09-13T18:01:29.778 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.776+0000 7f4672000640 1 -- 172.21.15.27:0/4215856843 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4668004190 con 0x7f4674100820 2024-09-13T18:01:29.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.778+0000 7f4672000640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f465c0a1090 0x7f465c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.778+0000 7f4672000640 1 -- 172.21.15.27:0/4215856843 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f46680cc5a0 con 0x7f4674100820 2024-09-13T18:01:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.778+0000 7f4679000640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f465c0a1090 0x7f465c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:29.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.779+0000 7f4679000640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f465c0a1090 0x7f465c0a3550 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4674199630 tx=0x7f4660009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:29.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:29.783+0000 7f4672000640 1 -- 172.21.15.27:0/4215856843 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4668096130 con 0x7f4674100820 2024-09-13T18:01:29.963 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:29 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] up:boot 2024-09-13T18:01:29.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:29 smithi122 ceph-mon[35310]: fsmap 8 up:standby 2024-09-13T18:01:29.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:29 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:01:30.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.001+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f467410b7d0 con 0x7f4674100820 2024-09-13T18:01:30.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.003+0000 7f4672000640 1 -- 172.21.15.27:0/4215856843 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6568 (secure 0 0 0) 0x7f4668099750 con 0x7f4674100820 2024-09-13T18:01:30.005 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:30.005 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-09-13T18:01:30.005 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 9 2024-09-13T18:01:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f465c0a1090 msgr2=0x7f465c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f465c0a1090 0x7f465c0a3550 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4674199630 tx=0x7f4660009260 comp rx=0 tx=0).stop 2024-09-13T18:01:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4674100820 msgr2=0x7f4674198120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4674100820 0x7f4674198120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f466800d950 tx=0x7f466800dd50 comp rx=0 tx=0).stop 2024-09-13T18:01:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 shutdown_connections 2024-09-13T18:01:30.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f465c0a1090 0x7f465c0a3550 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4674105a80 0x7f467419f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4674103150 0x7f4674198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 --2- 172.21.15.27:0/4215856843 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4674100820 0x7f4674198120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 >> 172.21.15.27:0/4215856843 conn(0x7f46740fa420 msgr2=0x7f46740fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 shutdown_connections 2024-09-13T18:01:30.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:30.005+0000 7f467c400640 1 -- 172.21.15.27:0/4215856843 wait complete. 2024-09-13T18:01:30.020 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:29 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] up:boot 2024-09-13T18:01:30.020 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:29 smithi027 ceph-mon[30611]: fsmap 8 up:standby 2024-09-13T18:01:30.021 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:29 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:01:30.275 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:01:30 smithi143 systemd[1]: Starting Ceph mds.i for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:01:30.638 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:30 smithi143 ceph-mon[38210]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:30.638 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:30 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/4215856843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:30.639 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:01:30 smithi143 podman[69020]: 2024-09-13 18:01:30.257431169 +0000 UTC m=+0.015832312 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:01:30.639 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:01:30 smithi143 podman[69020]: 2024-09-13 18:01:30.376230298 +0000 UTC m=+0.134631429 container create a121b6f20c09062fe850266b4b97a797dff11f22fd50b7bfd48900031be8d1ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T18:01:30.639 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:01:30 smithi143 podman[69020]: 2024-09-13 18:01:30.637448484 +0000 UTC m=+0.395849614 container init a121b6f20c09062fe850266b4b97a797dff11f22fd50b7bfd48900031be8d1ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T18:01:30.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:30 smithi122 ceph-mon[35310]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:30.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:30 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/4215856843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:31.026 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:01:30 smithi143 podman[69020]: 2024-09-13 18:01:30.640696377 +0000 UTC m=+0.399097509 container start a121b6f20c09062fe850266b4b97a797dff11f22fd50b7bfd48900031be8d1ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T18:01:31.026 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:01:30 smithi143 ceph-mds[69039]: -- 172.21.15.143:0/142238137 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563d23304d00 con 0x563d232d9000 2024-09-13T18:01:31.026 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:01:30 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i[69035]: starting mds.i at 2024-09-13T18:01:31.026 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:01:30 smithi143 bash[69020]: a121b6f20c09062fe850266b4b97a797dff11f22fd50b7bfd48900031be8d1ec 2024-09-13T18:01:31.026 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:01:30 smithi143 systemd[1]: Started Ceph mds.i for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:31.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:30 smithi027 ceph-mon[30611]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:31.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:30 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/4215856843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:32.023 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: Deploying daemon mds.g on smithi027 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] up:boot 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: fsmap 9 up:standby 2024-09-13T18:01:32.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:31 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:01:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.185+0000 7f8f5a000640 1 -- 172.21.15.27:0/2963822422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54072e90 msgr2=0x7f8f540732f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.185+0000 7f8f5a000640 1 --2- 172.21.15.27:0/2963822422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54072e90 0x7f8f540732f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009900 tx=0x7f8f4002a480 comp rx=0 tx=0).stop 2024-09-13T18:01:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.185+0000 7f8f5a000640 1 -- 172.21.15.27:0/2963822422 shutdown_connections 2024-09-13T18:01:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.185+0000 7f8f5a000640 1 --2- 172.21.15.27:0/2963822422 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f54107a70 0x7f8f54109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:32.187 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.185+0000 7f8f5a000640 1 --2- 172.21.15.27:0/2963822422 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54072e90 0x7f8f540732f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:32.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.185+0000 7f8f5a000640 1 --2- 172.21.15.27:0/2963822422 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f54074470 0x7f8f540728c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:32.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.185+0000 7f8f5a000640 1 -- 172.21.15.27:0/2963822422 >> 172.21.15.27:0/2963822422 conn(0x7f8f540fb360 msgr2=0x7f8f540fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:32.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.185+0000 7f8f5a000640 1 -- 172.21.15.27:0/2963822422 shutdown_connections 2024-09-13T18:01:32.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.185+0000 7f8f5a000640 1 -- 172.21.15.27:0/2963822422 wait complete. 2024-09-13T18:01:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.186+0000 7f8f5a000640 1 Processor -- start 2024-09-13T18:01:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.186+0000 7f8f5a000640 1 -- start start 2024-09-13T18:01:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f5a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f54072e90 0x7f8f54197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f5a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54074470 0x7f8f54198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f5a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f54107a70 0x7f8f5419f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f5a000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5419f9d0 con 0x7f8f54074470 2024-09-13T18:01:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f5a000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5419fb40 con 0x7f8f54107a70 2024-09-13T18:01:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f5a000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5419fd00 con 0x7f8f54072e90 2024-09-13T18:01:32.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f53e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54074470 0x7f8f54198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f53e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54074470 0x7f8f54198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40442/0 (socket says 172.21.15.27:40442) 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f53e00640 1 -- 172.21.15.27:0/3897546424 learned_addr learned my addr 172.21.15.27:0/3897546424 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f59600640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f54107a70 0x7f8f5419f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f53e00640 1 -- 172.21.15.27:0/3897546424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f54072e90 msgr2=0x7f8f54197ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f53e00640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f54072e90 0x7f8f54197ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f53e00640 1 -- 172.21.15.27:0/3897546424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f54107a70 msgr2=0x7f8f5419f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f53e00640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f54107a70 0x7f8f5419f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.187+0000 7f8f53e00640 1 -- 172.21.15.27:0/3897546424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40009560 con 0x7f8f54074470 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.188+0000 7f8f53e00640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54074470 0x7f8f54198420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f40031510 tx=0x7f8f40005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.188+0000 7f8f51600640 1 -- 172.21.15.27:0/3897546424 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40004c50 con 0x7f8f54074470 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.188+0000 7f8f51600640 1 -- 172.21.15.27:0/3897546424 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8f40004db0 con 0x7f8f54074470 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.188+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5419ff80 con 0x7f8f54074470 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.188+0000 7f8f51600640 1 -- 172.21.15.27:0/3897546424 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40031cf0 con 0x7f8f54074470 2024-09-13T18:01:32.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.188+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f541a03a0 con 0x7f8f54074470 2024-09-13T18:01:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.189+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f54106830 con 0x7f8f54074470 2024-09-13T18:01:32.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.191+0000 7f8f51600640 1 -- 172.21.15.27:0/3897546424 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8f400035f0 con 0x7f8f54074470 2024-09-13T18:01:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.193+0000 7f8f51600640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8f3c0a1090 0x7f8f3c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.193+0000 7f8f51600640 1 -- 172.21.15.27:0/3897546424 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8f400ed4a0 con 0x7f8f54074470 2024-09-13T18:01:32.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.193+0000 7f8f58c00640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8f3c0a1090 0x7f8f3c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:32.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.194+0000 7f8f58c00640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8f3c0a1090 0x7f8f3c0a3550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800b990 tx=0x7f8f4800b370 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:32.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.197+0000 7f8f51600640 1 -- 172.21.15.27:0/3897546424 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8f400b7030 con 0x7f8f54074470 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: Deploying daemon mds.g on smithi027 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] up:boot 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: fsmap 9 up:standby 2024-09-13T18:01:32.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:31 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:01:32.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:32.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:32.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:32.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:32.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:32.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:32.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: Deploying daemon mds.g on smithi027 2024-09-13T18:01:32.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] up:boot 2024-09-13T18:01:32.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: fsmap 9 up:standby 2024-09-13T18:01:32.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:31 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:01:32.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.415+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f5410d830 con 0x7f8f54074470 2024-09-13T18:01:32.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.416+0000 7f8f51600640 1 -- 172.21.15.27:0/3897546424 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7330 (secure 0 0 0) 0x7f8f400ba650 con 0x7f8f54074470 2024-09-13T18:01:32.418 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:32.418 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-09-13T18:01:32.418 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 10 2024-09-13T18:01:32.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8f3c0a1090 msgr2=0x7f8f3c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:32.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8f3c0a1090 0x7f8f3c0a3550 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800b990 tx=0x7f8f4800b370 comp rx=0 tx=0).stop 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54074470 msgr2=0x7f8f54198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54074470 0x7f8f54198420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f40031510 tx=0x7f8f40005690 comp rx=0 tx=0).stop 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 shutdown_connections 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8f3c0a1090 0x7f8f3c0a3550 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8f54107a70 0x7f8f5419f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8f54074470 0x7f8f54198420 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 --2- 172.21.15.27:0/3897546424 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8f54072e90 0x7f8f54197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 >> 172.21.15.27:0/3897546424 conn(0x7f8f540fb360 msgr2=0x7f8f54103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 shutdown_connections 2024-09-13T18:01:32.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:32.418+0000 7f8f5a000640 1 -- 172.21.15.27:0/3897546424 wait complete. 2024-09-13T18:01:33.053 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:32 smithi027 ceph-mon[30611]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:33.053 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:32 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3897546424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:33.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:32 smithi122 ceph-mon[35310]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:33.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:32 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3897546424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:33.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:32 smithi143 ceph-mon[38210]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:33.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:32 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3897546424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:34.022 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:01:33 smithi027 podman[70759]: 2024-09-13 18:01:33.764521523 +0000 UTC m=+0.185005911 container create 352630ec46bdb43dfe39110d74bab861f529c8596cd49e9dd1306e0cd2fa50d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T18:01:34.022 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:01:34 smithi027 podman[70759]: 2024-09-13 18:01:34.019298862 +0000 UTC m=+0.439783252 container init 352630ec46bdb43dfe39110d74bab861f529c8596cd49e9dd1306e0cd2fa50d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-09-13T18:01:34.307 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:01:34 smithi027 podman[70759]: 2024-09-13 18:01:34.026134786 +0000 UTC m=+0.446619184 container start 352630ec46bdb43dfe39110d74bab861f529c8596cd49e9dd1306e0cd2fa50d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T18:01:34.307 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:01:34 smithi027 ceph-mds[70785]: -- 172.21.15.27:0/312536363 <== mon.0 v2:172.21.15.27:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5606a8892d00 con 0x5606a8867000 2024-09-13T18:01:34.307 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:01:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g[70779]: starting mds.g at 2024-09-13T18:01:34.307 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:01:34 smithi027 bash[70759]: 352630ec46bdb43dfe39110d74bab861f529c8596cd49e9dd1306e0cd2fa50d1 2024-09-13T18:01:34.307 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:01:34 smithi027 systemd[1]: Started Ceph mds.g for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:34.439 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:34.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.619+0000 7f8fe9000640 1 -- 172.21.15.27:0/1235690310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 msgr2=0x7f8fe4102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:34.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.619+0000 7f8fe9000640 1 --2- 172.21.15.27:0/1235690310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 0x7f8fe4102aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009900 tx=0x7f8fd402a410 comp rx=0 tx=0).stop 2024-09-13T18:01:34.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.620+0000 7f8fe9000640 1 -- 172.21.15.27:0/1235690310 shutdown_connections 2024-09-13T18:01:34.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.620+0000 7f8fe9000640 1 --2- 172.21.15.27:0/1235690310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fe4105910 0x7f8fe4107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.620+0000 7f8fe9000640 1 --2- 172.21.15.27:0/1235690310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fe4102fe0 0x7f8fe41053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.620+0000 7f8fe9000640 1 --2- 172.21.15.27:0/1235690310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 0x7f8fe4102aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.620+0000 7f8fe9000640 1 -- 172.21.15.27:0/1235690310 >> 172.21.15.27:0/1235690310 conn(0x7f8fe40fa1f0 msgr2=0x7f8fe40fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.620+0000 7f8fe9000640 1 -- 172.21.15.27:0/1235690310 shutdown_connections 2024-09-13T18:01:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.620+0000 7f8fe9000640 1 -- 172.21.15.27:0/1235690310 wait complete. 2024-09-13T18:01:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.621+0000 7f8fe9000640 1 Processor -- start 2024-09-13T18:01:34.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe9000640 1 -- start start 2024-09-13T18:01:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe9000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 0x7f8fe4197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe9000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fe4102fe0 0x7f8fe4198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe9000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fe4105910 0x7f8fe419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe9000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe419fa30 con 0x7f8fe41006b0 2024-09-13T18:01:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe9000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe419fba0 con 0x7f8fe4105910 2024-09-13T18:01:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe9000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe419fd60 con 0x7f8fe4102fe0 2024-09-13T18:01:34.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe3400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 0x7f8fe4197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe3400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 0x7f8fe4197f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40482/0 (socket says 172.21.15.27:40482) 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.622+0000 7f8fe3400640 1 -- 172.21.15.27:0/2764237852 learned_addr learned my addr 172.21.15.27:0/2764237852 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fe2a00640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fe4102fe0 0x7f8fe4198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fe3e00640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fe4105910 0x7f8fe419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fe3400640 1 -- 172.21.15.27:0/2764237852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fe4102fe0 msgr2=0x7f8fe4198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fe3400640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fe4102fe0 0x7f8fe4198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fe3400640 1 -- 172.21.15.27:0/2764237852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fe4105910 msgr2=0x7f8fe419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fe3400640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fe4105910 0x7f8fe419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fe3400640 1 -- 172.21.15.27:0/2764237852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd0009490 con 0x7f8fe41006b0 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fe3e00640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fe4105910 0x7f8fe419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:01:34.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fe3400640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 0x7f8fe4197f40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4031510 tx=0x7f8fd40055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:34.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.623+0000 7f8fdbe00640 1 -- 172.21.15.27:0/2764237852 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4004b50 con 0x7f8fe41006b0 2024-09-13T18:01:34.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.624+0000 7f8fdbe00640 1 -- 172.21.15.27:0/2764237852 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8fd4004cb0 con 0x7f8fe41006b0 2024-09-13T18:01:34.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.624+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd4009560 con 0x7f8fe41006b0 2024-09-13T18:01:34.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.624+0000 7f8fdbe00640 1 -- 172.21.15.27:0/2764237852 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4031ba0 con 0x7f8fe41006b0 2024-09-13T18:01:34.628 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.624+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe41a0270 con 0x7f8fe41006b0 2024-09-13T18:01:34.629 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.625+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe40fe8f0 con 0x7f8fe41006b0 2024-09-13T18:01:34.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.627+0000 7f8fdbe00640 1 -- 172.21.15.27:0/2764237852 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8fd4031d00 con 0x7f8fe41006b0 2024-09-13T18:01:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.629+0000 7f8fdbe00640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8fc80a1110 0x7f8fc80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:34.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.630+0000 7f8fdbe00640 1 -- 172.21.15.27:0/2764237852 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8fd40ed7a0 con 0x7f8fe41006b0 2024-09-13T18:01:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.630+0000 7f8fe2a00640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8fc80a1110 0x7f8fc80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:34.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.631+0000 7f8fe2a00640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8fc80a1110 0x7f8fc80a35d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4199450 tx=0x7f8fd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:34.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.631+0000 7f8fdbe00640 1 -- 172.21.15.27:0/2764237852 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8fd40b7330 con 0x7f8fe41006b0 2024-09-13T18:01:34.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.876+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fe41a0460 con 0x7f8fe41006b0 2024-09-13T18:01:34.880 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.877+0000 7f8fdbe00640 1 -- 172.21.15.27:0/2764237852 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8082 (secure 0 0 0) 0x7f8fd40ba950 con 0x7f8fe41006b0 2024-09-13T18:01:34.880 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:34.880 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-09-13T18:01:34.880 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 11 2024-09-13T18:01:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8fc80a1110 msgr2=0x7f8fc80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8fc80a1110 0x7f8fc80a35d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4199450 tx=0x7f8fd0005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:34.882 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 msgr2=0x7f8fe4197f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 0x7f8fe4197f40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4031510 tx=0x7f8fd40055a0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 shutdown_connections 2024-09-13T18:01:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8fc80a1110 0x7f8fc80a35d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8fe4105910 0x7f8fe419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8fe4102fe0 0x7f8fe4198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 --2- 172.21.15.27:0/2764237852 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8fe41006b0 0x7f8fe4197f40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 >> 172.21.15.27:0/2764237852 conn(0x7f8fe40fa1f0 msgr2=0x7f8fe4104680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.879+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 shutdown_connections 2024-09-13T18:01:34.883 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:34.880+0000 7f8fe9000640 1 -- 172.21.15.27:0/2764237852 wait complete. 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: Deploying daemon mds.a on smithi027 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.27:6838/91312549,v1:172.21.15.27:6839/91312549] up:boot 2024-09-13T18:01:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: fsmap 10 up:standby 2024-09-13T18:01:35.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T18:01:35.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:35 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2764237852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: Deploying daemon mds.a on smithi027 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.27:6838/91312549,v1:172.21.15.27:6839/91312549] up:boot 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: fsmap 10 up:standby 2024-09-13T18:01:35.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T18:01:35.527 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:35 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2764237852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: Deploying daemon mds.a on smithi027 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.27:6838/91312549,v1:172.21.15.27:6839/91312549] up:boot 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: fsmap 10 up:standby 2024-09-13T18:01:35.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T18:01:35.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:35 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2764237852' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:36.899 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:37.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.068+0000 7fc283200640 1 -- 172.21.15.27:0/2980107973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284103970 msgr2=0x7fc28410a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:37.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.068+0000 7fc283200640 1 --2- 172.21.15.27:0/2980107973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284103970 0x7fc28410a200 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009ca0 tx=0x7fc27c02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.068+0000 7fc283200640 1 -- 172.21.15.27:0/2980107973 shutdown_connections 2024-09-13T18:01:37.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.068+0000 7fc283200640 1 --2- 172.21.15.27:0/2980107973 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284103970 0x7fc28410a200 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.068+0000 7fc283200640 1 --2- 172.21.15.27:0/2980107973 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc284102fb0 0x7fc284103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.068+0000 7fc283200640 1 --2- 172.21.15.27:0/2980107973 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc284101dc0 0x7fc2841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.068+0000 7fc283200640 1 -- 172.21.15.27:0/2980107973 >> 172.21.15.27:0/2980107973 conn(0x7fc2840fd540 msgr2=0x7fc2840ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:37.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.068+0000 7fc283200640 1 -- 172.21.15.27:0/2980107973 shutdown_connections 2024-09-13T18:01:37.072 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.068+0000 7fc283200640 1 -- 172.21.15.27:0/2980107973 wait complete. 2024-09-13T18:01:37.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.069+0000 7fc283200640 1 Processor -- start 2024-09-13T18:01:37.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.069+0000 7fc283200640 1 -- start start 2024-09-13T18:01:37.074 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.069+0000 7fc283200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284101dc0 0x7fc284197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.069+0000 7fc283200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc284102fb0 0x7fc2841983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.069+0000 7fc283200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc284103970 0x7fc28419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.069+0000 7fc283200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28419f950 con 0x7fc284101dc0 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.069+0000 7fc283200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28419fac0 con 0x7fc284103970 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.069+0000 7fc283200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28419fc80 con 0x7fc284102fb0 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc281e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284101dc0 0x7fc284197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc281e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284101dc0 0x7fc284197eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40508/0 (socket says 172.21.15.27:40508) 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc281e00640 1 -- 172.21.15.27:0/1247731921 learned_addr learned my addr 172.21.15.27:0/1247731921 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc279400640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc284102fb0 0x7fc2841983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:37.075 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc282800640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc284103970 0x7fc28419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc281e00640 1 -- 172.21.15.27:0/1247731921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc284102fb0 msgr2=0x7fc2841983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc281e00640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc284102fb0 0x7fc2841983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc281e00640 1 -- 172.21.15.27:0/1247731921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc284103970 msgr2=0x7fc28419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc281e00640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc284103970 0x7fc28419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc281e00640 1 -- 172.21.15.27:0/1247731921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274009490 con 0x7fc284101dc0 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.070+0000 7fc279400640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc284102fb0 0x7fc2841983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.071+0000 7fc281e00640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284101dc0 0x7fc284197eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc27400e9c0 tx=0x7fc27400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.071+0000 7fc27b400640 1 -- 172.21.15.27:0/1247731921 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400cde0 con 0x7fc284101dc0 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.071+0000 7fc27b400640 1 -- 172.21.15.27:0/1247731921 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc274010910 con 0x7fc284101dc0 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.071+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c009900 con 0x7fc284101dc0 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.071+0000 7fc27b400640 1 -- 172.21.15.27:0/1247731921 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274018a10 con 0x7fc284101dc0 2024-09-13T18:01:37.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.071+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2841a0250 con 0x7fc284101dc0 2024-09-13T18:01:37.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.072+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2841091b0 con 0x7fc284101dc0 2024-09-13T18:01:37.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.074+0000 7fc27b400640 1 -- 172.21.15.27:0/1247731921 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc274010a80 con 0x7fc284101dc0 2024-09-13T18:01:37.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.075+0000 7fc27b400640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2680a1110 0x7fc2680a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:37.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.076+0000 7fc27b400640 1 -- 172.21.15.27:0/1247731921 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc274014070 con 0x7fc284101dc0 2024-09-13T18:01:37.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.076+0000 7fc279400640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2680a1110 0x7fc2680a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:37.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.076+0000 7fc279400640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2680a1110 0x7fc2680a35d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc284199370 tx=0x7fc26c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:37.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.078+0000 7fc27b400640 1 -- 172.21.15.27:0/1247731921 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc274096c90 con 0x7fc284101dc0 2024-09-13T18:01:37.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.299+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc28410d850 con 0x7fc284101dc0 2024-09-13T18:01:37.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.300+0000 7fc27b400640 1 -- 172.21.15.27:0/1247731921 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8082 (secure 0 0 0) 0x7fc27409a2b0 con 0x7fc284101dc0 2024-09-13T18:01:37.303 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:37.303 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-09-13T18:01:37.303 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 11 2024-09-13T18:01:37.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2680a1110 msgr2=0x7fc2680a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:37.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2680a1110 0x7fc2680a35d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc284199370 tx=0x7fc26c005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:37.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284101dc0 msgr2=0x7fc284197eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:37.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284101dc0 0x7fc284197eb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc27400e9c0 tx=0x7fc27400ee80 comp rx=0 tx=0).stop 2024-09-13T18:01:37.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 shutdown_connections 2024-09-13T18:01:37.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc2680a1110 0x7fc2680a35d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc284103970 0x7fc28419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc284102fb0 0x7fc2841983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 --2- 172.21.15.27:0/1247731921 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc284101dc0 0x7fc284197eb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:37.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 >> 172.21.15.27:0/1247731921 conn(0x7fc2840fd540 msgr2=0x7fc284106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:37.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 shutdown_connections 2024-09-13T18:01:37.306 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:37.302+0000 7fc283200640 1 -- 172.21.15.27:0/1247731921 wait complete. 2024-09-13T18:01:37.408 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:37 smithi027 ceph-mon[30611]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:37.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:37 smithi122 ceph-mon[35310]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:37.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:37 smithi143 ceph-mon[38210]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:37.807 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:01:37 smithi027 systemd[1]: Started Ceph mds.a for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:38.334 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:38 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1247731921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:38.334 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:38.334 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:38.335 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:38.335 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:38.335 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:38.335 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:38 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:38.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:38 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1247731921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:38.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:38.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:38 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:38 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1247731921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T18:01:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T18:01:38.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:38 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:39.327 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:39.380 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:39 smithi122 ceph-mon[35310]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:39.380 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:39 smithi122 ceph-mon[35310]: Deploying daemon mds.b on smithi122 2024-09-13T18:01:39.380 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:39 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] up:boot 2024-09-13T18:01:39.380 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:39 smithi122 ceph-mon[35310]: fsmap 11 up:standby 2024-09-13T18:01:39.380 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:39 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:01:39.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.497+0000 7f8390a00640 1 -- 172.21.15.27:0/2184311571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c074e70 msgr2=0x7f838c075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:39.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.497+0000 7f8390a00640 1 --2- 172.21.15.27:0/2184311571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c074e70 0x7f838c075270 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f837c009900 tx=0x7f837c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.497+0000 7f8390a00640 1 -- 172.21.15.27:0/2184311571 shutdown_connections 2024-09-13T18:01:39.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.497+0000 7f8390a00640 1 --2- 172.21.15.27:0/2184311571 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f838c076a50 0x7f838c0772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.497+0000 7f8390a00640 1 --2- 172.21.15.27:0/2184311571 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f838c0760b0 0x7f838c076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.497+0000 7f8390a00640 1 --2- 172.21.15.27:0/2184311571 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c074e70 0x7f838c075270 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.497+0000 7f8390a00640 1 -- 172.21.15.27:0/2184311571 >> 172.21.15.27:0/2184311571 conn(0x7f838c0fd700 msgr2=0x7f838c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:39.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.497+0000 7f8390a00640 1 -- 172.21.15.27:0/2184311571 shutdown_connections 2024-09-13T18:01:39.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.497+0000 7f8390a00640 1 -- 172.21.15.27:0/2184311571 wait complete. 2024-09-13T18:01:39.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.498+0000 7f8390a00640 1 Processor -- start 2024-09-13T18:01:39.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.498+0000 7f8390a00640 1 -- start start 2024-09-13T18:01:39.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8390a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f838c074e70 0x7f838c19c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:39.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8390a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0760b0 0x7f838c19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8390a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f838c076a50 0x7f838c1a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8390a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1a3f80 con 0x7f838c0760b0 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8390a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1a40f0 con 0x7f838c076a50 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8390a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1a42b0 con 0x7f838c074e70 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8383e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0760b0 0x7f838c19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f838a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f838c076a50 0x7f838c1a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8383e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0760b0 0x7f838c19c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:40550/0 (socket says 172.21.15.27:40550) 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8383e00640 1 -- 172.21.15.27:0/2432029314 learned_addr learned my addr 172.21.15.27:0/2432029314 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f838a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f838c076a50 0x7f838c1a3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:43278/0 (socket says 172.21.15.27:43278) 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8389e00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f838c074e70 0x7f838c19c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8383e00640 1 -- 172.21.15.27:0/2432029314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f838c074e70 msgr2=0x7f838c19c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:39.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8383e00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f838c074e70 0x7f838c19c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8383e00640 1 -- 172.21.15.27:0/2432029314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f838c076a50 msgr2=0x7f838c1a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8383e00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f838c076a50 0x7f838c1a3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f8383e00640 1 -- 172.21.15.27:0/2432029314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009560 con 0x7f838c0760b0 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.499+0000 7f838a800640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f838c076a50 0x7f838c1a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.500+0000 7f8383e00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0760b0 0x7f838c19c9d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f837400e9f0 tx=0x7f837400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.500+0000 7f8382a00640 1 -- 172.21.15.27:0/2432029314 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374009700 con 0x7f838c0760b0 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.500+0000 7f8382a00640 1 -- 172.21.15.27:0/2432029314 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f837400cd80 con 0x7f838c0760b0 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.500+0000 7f8382a00640 1 -- 172.21.15.27:0/2432029314 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374018920 con 0x7f838c0760b0 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.500+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838c1a4590 con 0x7f838c0760b0 2024-09-13T18:01:39.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.500+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c1a4a50 con 0x7f838c0760b0 2024-09-13T18:01:39.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.501+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c10eb40 con 0x7f838c0760b0 2024-09-13T18:01:39.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.503+0000 7f8382a00640 1 -- 172.21.15.27:0/2432029314 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8374018a80 con 0x7f838c0760b0 2024-09-13T18:01:39.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.505+0000 7f8382a00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83700a1090 0x7f83700a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:39.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.505+0000 7f8382a00640 1 -- 172.21.15.27:0/2432029314 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8374014070 con 0x7f838c0760b0 2024-09-13T18:01:39.508 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.505+0000 7f8389e00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83700a1090 0x7f83700a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:39.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.506+0000 7f8389e00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83700a1090 0x7f83700a3550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f837c005ab0 tx=0x7f837c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:39.509 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.507+0000 7f8382a00640 1 -- 172.21.15.27:0/2432029314 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f8374096400 con 0x7f838c0760b0 2024-09-13T18:01:39.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:39 smithi143 ceph-mon[38210]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:39.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:39 smithi143 ceph-mon[38210]: Deploying daemon mds.b on smithi122 2024-09-13T18:01:39.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:39 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] up:boot 2024-09-13T18:01:39.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:39 smithi143 ceph-mon[38210]: fsmap 11 up:standby 2024-09-13T18:01:39.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:39 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:01:39.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:39 smithi027 ceph-mon[30611]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:39.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:39 smithi027 ceph-mon[30611]: Deploying daemon mds.b on smithi122 2024-09-13T18:01:39.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:39 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] up:boot 2024-09-13T18:01:39.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:39 smithi027 ceph-mon[30611]: fsmap 11 up:standby 2024-09-13T18:01:39.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:39 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:01:39.714 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:39 smithi122 systemd[1]: Starting Ceph mds.b for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:01:39.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.723+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f838c111e20 con 0x7f838c0760b0 2024-09-13T18:01:39.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.724+0000 7f8382a00640 1 -- 172.21.15.27:0/2432029314 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8840 (secure 0 0 0) 0x7f8374099a20 con 0x7f838c0760b0 2024-09-13T18:01:39.727 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:39.727 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[]} 2024-09-13T18:01:39.727 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 12 2024-09-13T18:01:39.729 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83700a1090 msgr2=0x7f83700a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83700a1090 0x7f83700a3550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f837c005ab0 tx=0x7f837c005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0760b0 msgr2=0x7f838c19c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0760b0 0x7f838c19c9d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f837400e9f0 tx=0x7f837400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 shutdown_connections 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83700a1090 0x7f83700a3550 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f838c076a50 0x7f838c1a3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f838c0760b0 0x7f838c19c9d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 --2- 172.21.15.27:0/2432029314 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f838c074e70 0x7f838c19c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 >> 172.21.15.27:0/2432029314 conn(0x7f838c0fd700 msgr2=0x7f838c0feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 shutdown_connections 2024-09-13T18:01:39.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:39.726+0000 7f8390a00640 1 -- 172.21.15.27:0/2432029314 wait complete. 2024-09-13T18:01:40.035 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:39 smithi122 podman[65590]: 2024-09-13 18:01:39.681332258 +0000 UTC m=+0.015973566 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:01:40.035 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:39 smithi122 podman[65590]: 2024-09-13 18:01:39.798211051 +0000 UTC m=+0.132852358 container create 2cd571312c4550df9bc5157cc53c505e45b3ecb43e475248eef2fd2db768482b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-13T18:01:40.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:40 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2432029314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:40.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:40 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.464 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:40 smithi122 podman[65590]: 2024-09-13 18:01:40.034341798 +0000 UTC m=+0.368983106 container init 2cd571312c4550df9bc5157cc53c505e45b3ecb43e475248eef2fd2db768482b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-13T18:01:40.465 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:40 smithi122 podman[65590]: 2024-09-13 18:01:40.037432237 +0000 UTC m=+0.372073544 container start 2cd571312c4550df9bc5157cc53c505e45b3ecb43e475248eef2fd2db768482b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-13T18:01:40.465 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:40 smithi122 ceph-mds[65610]: -- 172.21.15.122:0/1878728528 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559478eecd00 con 0x559478ec1000 2024-09-13T18:01:40.465 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:40 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b[65606]: starting mds.b at 2024-09-13T18:01:40.465 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:40 smithi122 bash[65590]: 2cd571312c4550df9bc5157cc53c505e45b3ecb43e475248eef2fd2db768482b 2024-09-13T18:01:40.465 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:40 smithi122 systemd[1]: Started Ceph mds.b for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:01:40.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:40 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2432029314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:40.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:40 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:40 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2432029314' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:40.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:40 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:41.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:41 smithi143 ceph-mon[38210]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:41.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:41 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] up:boot 2024-09-13T18:01:41.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:41 smithi143 ceph-mon[38210]: fsmap 12 up:standby 2024-09-13T18:01:41.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:41 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:01:41.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:41 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:41.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:41 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:01:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:41 smithi027 ceph-mon[30611]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:41 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] up:boot 2024-09-13T18:01:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:41 smithi027 ceph-mon[30611]: fsmap 12 up:standby 2024-09-13T18:01:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:41 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:01:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:41 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:41 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:01:41.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:41 smithi122 ceph-mon[35310]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:41.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:41 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] up:boot 2024-09-13T18:01:41.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:41 smithi122 ceph-mon[35310]: fsmap 12 up:standby 2024-09-13T18:01:41.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:01:41.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:41.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:41 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:01:41.747 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:41.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.917+0000 7f29cd000640 1 -- 172.21.15.27:0/389920610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c8100da0 msgr2=0x7f29c8101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:41.920 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.917+0000 7f29cd000640 1 --2- 172.21.15.27:0/389920610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c8100da0 0x7f29c8101220 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f29b4009900 tx=0x7f29b402a410 comp rx=0 tx=0).stop 2024-09-13T18:01:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.917+0000 7f29cd000640 1 -- 172.21.15.27:0/389920610 shutdown_connections 2024-09-13T18:01:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.917+0000 7f29cd000640 1 --2- 172.21.15.27:0/389920610 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c8101760 0x7f29c8107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.917+0000 7f29cd000640 1 --2- 172.21.15.27:0/389920610 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c8100da0 0x7f29c8101220 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.917+0000 7f29cd000640 1 --2- 172.21.15.27:0/389920610 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29c80ffbb0 0x7f29c80fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.917+0000 7f29cd000640 1 -- 172.21.15.27:0/389920610 >> 172.21.15.27:0/389920610 conn(0x7f29c80fb330 msgr2=0x7f29c80fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.917+0000 7f29cd000640 1 -- 172.21.15.27:0/389920610 shutdown_connections 2024-09-13T18:01:41.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.917+0000 7f29cd000640 1 -- 172.21.15.27:0/389920610 wait complete. 2024-09-13T18:01:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.918+0000 7f29cd000640 1 Processor -- start 2024-09-13T18:01:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.918+0000 7f29cd000640 1 -- start start 2024-09-13T18:01:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29cd000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29c80ffbb0 0x7f29c8197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29cd000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c8100da0 0x7f29c8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29cd000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c8101760 0x7f29c819f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:41.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29cd000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c819f9c0 con 0x7f29c8100da0 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29cd000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c819fb30 con 0x7f29c8101760 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29cd000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c819fcf0 con 0x7f29c80ffbb0 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c7400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29c80ffbb0 0x7f29c8197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c7400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29c80ffbb0 0x7f29c8197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:32924/0 (socket says 172.21.15.27:32924) 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c6a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c8100da0 0x7f29c8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c7400640 1 -- 172.21.15.27:0/3373824340 learned_addr learned my addr 172.21.15.27:0/3373824340 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c7e00640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c8101760 0x7f29c819f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c7400640 1 -- 172.21.15.27:0/3373824340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c8101760 msgr2=0x7f29c819f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c7400640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c8101760 0x7f29c819f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c7400640 1 -- 172.21.15.27:0/3373824340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c8100da0 msgr2=0x7f29c8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c7400640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c8100da0 0x7f29c8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.919+0000 7f29c7400640 1 -- 172.21.15.27:0/3373824340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4009560 con 0x7f29c80ffbb0 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.920+0000 7f29c7400640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29c80ffbb0 0x7f29c8197ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f29b800e9c0 tx=0x7f29b800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:41.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.920+0000 7f29bfe00640 1 -- 172.21.15.27:0/3373824340 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b80096e0 con 0x7f29c80ffbb0 2024-09-13T18:01:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.920+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c819ffd0 con 0x7f29c80ffbb0 2024-09-13T18:01:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.920+0000 7f29bfe00640 1 -- 172.21.15.27:0/3373824340 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f29b800cd80 con 0x7f29c80ffbb0 2024-09-13T18:01:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.920+0000 7f29bfe00640 1 -- 172.21.15.27:0/3373824340 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b8010430 con 0x7f29c80ffbb0 2024-09-13T18:01:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.920+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c81a03f0 con 0x7f29c80ffbb0 2024-09-13T18:01:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.922+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c810b640 con 0x7f29c80ffbb0 2024-09-13T18:01:41.925 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.923+0000 7f29bfe00640 1 -- 172.21.15.27:0/3373824340 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f29b8003680 con 0x7f29c80ffbb0 2024-09-13T18:01:41.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.924+0000 7f29bfe00640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f29ac0a1090 0x7f29ac0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:41.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.924+0000 7f29bfe00640 1 -- 172.21.15.27:0/3373824340 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f29b8014070 con 0x7f29c80ffbb0 2024-09-13T18:01:41.927 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.925+0000 7f29c6a00640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f29ac0a1090 0x7f29ac0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:41.928 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.925+0000 7f29c6a00640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f29ac0a1090 0x7f29ac0a3550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f29b4005ab0 tx=0x7f29b4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:41.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:41.928+0000 7f29bfe00640 1 -- 172.21.15.27:0/3373824340 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f29b80963f0 con 0x7f29c80ffbb0 2024-09-13T18:01:42.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.165+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29c810b800 con 0x7f29c80ffbb0 2024-09-13T18:01:42.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.166+0000 7f29bfe00640 1 -- 172.21.15.27:0/3373824340 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9601 (secure 0 0 0) 0x7f29b8099a10 con 0x7f29c80ffbb0 2024-09-13T18:01:42.169 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:42.169 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24448,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24455,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24497,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24529,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24556,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24584,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.122:6839/1102491877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1102491877},{"type":"v1","addr":"172.21.15.122:6839","nonce":1102491877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-09-13T18:01:42.169 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 13 2024-09-13T18:01:42.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f29ac0a1090 msgr2=0x7f29ac0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f29ac0a1090 0x7f29ac0a3550 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f29b4005ab0 tx=0x7f29b4005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:42.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29c80ffbb0 msgr2=0x7f29c8197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29c80ffbb0 0x7f29c8197ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f29b800e9c0 tx=0x7f29b800ee80 comp rx=0 tx=0).stop 2024-09-13T18:01:42.171 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 shutdown_connections 2024-09-13T18:01:42.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f29ac0a1090 0x7f29ac0a3550 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f29c8101760 0x7f29c819f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f29c8100da0 0x7f29c8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 --2- 172.21.15.27:0/3373824340 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f29c80ffbb0 0x7f29c8197ed0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 >> 172.21.15.27:0/3373824340 conn(0x7f29c80fb330 msgr2=0x7f29c81065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:42.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 shutdown_connections 2024-09-13T18:01:42.172 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.168+0000 7f29cd000640 1 -- 172.21.15.27:0/3373824340 wait complete. 2024-09-13T18:01:42.190 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:01:42.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.358+0000 7faf61600640 1 -- 172.21.15.27:0/2189188918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf5c103150 msgr2=0x7faf5c105540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.358+0000 7faf61600640 1 --2- 172.21.15.27:0/2189188918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf5c103150 0x7faf5c105540 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7faf48009900 tx=0x7faf4802a410 comp rx=0 tx=0).stop 2024-09-13T18:01:42.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.358+0000 7faf61600640 1 -- 172.21.15.27:0/2189188918 shutdown_connections 2024-09-13T18:01:42.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.358+0000 7faf61600640 1 --2- 172.21.15.27:0/2189188918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf5c105a80 0x7faf5c107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.358+0000 7faf61600640 1 --2- 172.21.15.27:0/2189188918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf5c103150 0x7faf5c105540 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.358+0000 7faf61600640 1 --2- 172.21.15.27:0/2189188918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c100820 0x7faf5c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.358+0000 7faf61600640 1 -- 172.21.15.27:0/2189188918 >> 172.21.15.27:0/2189188918 conn(0x7faf5c0fa440 msgr2=0x7faf5c0fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:42.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.359+0000 7faf61600640 1 -- 172.21.15.27:0/2189188918 shutdown_connections 2024-09-13T18:01:42.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.359+0000 7faf61600640 1 -- 172.21.15.27:0/2189188918 wait complete. 2024-09-13T18:01:42.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.359+0000 7faf61600640 1 Processor -- start 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf61600640 1 -- start start 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf61600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf5c100820 0x7faf5c198150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf61600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c103150 0x7faf5c198690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf61600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf5c105a80 0x7faf5c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf61600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c19fc40 con 0x7faf5c100820 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf61600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c19fdb0 con 0x7faf5c105a80 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf61600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c19ff70 con 0x7faf5c103150 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf5aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf5c100820 0x7faf5c198150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf5aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf5c100820 0x7faf5c198150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54152/0 (socket says 172.21.15.27:54152) 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf5aa00640 1 -- 172.21.15.27:0/424244512 learned_addr learned my addr 172.21.15.27:0/424244512 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf5b400640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf5c105a80 0x7faf5c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:42.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.360+0000 7faf5a000640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c103150 0x7faf5c198690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf5aa00640 1 -- 172.21.15.27:0/424244512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c103150 msgr2=0x7faf5c198690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf5aa00640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c103150 0x7faf5c198690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf5aa00640 1 -- 172.21.15.27:0/424244512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf5c105a80 msgr2=0x7faf5c19f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf5aa00640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf5c105a80 0x7faf5c19f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf5aa00640 1 -- 172.21.15.27:0/424244512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48009560 con 0x7faf5c100820 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf5aa00640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf5c100820 0x7faf5c198150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00e9f0 tx=0x7faf4c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf53400640 1 -- 172.21.15.27:0/424244512 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c009720 con 0x7faf5c100820 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf53400640 1 -- 172.21.15.27:0/424244512 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf4c00cd80 con 0x7faf5c100820 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c1a0250 con 0x7faf5c100820 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.361+0000 7faf53400640 1 -- 172.21.15.27:0/424244512 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c010690 con 0x7faf5c100820 2024-09-13T18:01:42.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.362+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c1a06e0 con 0x7faf5c100820 2024-09-13T18:01:42.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.363+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c1075f0 con 0x7faf5c100820 2024-09-13T18:01:42.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.364+0000 7faf53400640 1 -- 172.21.15.27:0/424244512 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7faf4c0046c0 con 0x7faf5c100820 2024-09-13T18:01:42.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.366+0000 7faf53400640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf400a1090 0x7faf400a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:42.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.366+0000 7faf53400640 1 -- 172.21.15.27:0/424244512 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7faf4c014070 con 0x7faf5c100820 2024-09-13T18:01:42.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.366+0000 7faf5a000640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf400a1090 0x7faf400a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:42.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.367+0000 7faf5a000640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf400a1090 0x7faf400a3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faf48009230 tx=0x7faf48005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:42.374 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.371+0000 7faf53400640 1 -- 172.21.15.27:0/424244512 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faf4c096400 con 0x7faf5c100820 2024-09-13T18:01:42.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.563+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf5c107060 con 0x7faf5c100820 2024-09-13T18:01:42.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.565+0000 7faf53400640 1 -- 172.21.15.27:0/424244512 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+18398 (secure 0 0 0) 0x7faf4c099a20 con 0x7faf5c100820 2024-09-13T18:01:42.568 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:42.568 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":82,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:00:57.110565+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:01:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf400a1090 msgr2=0x7faf400a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf400a1090 0x7faf400a3550 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faf48009230 tx=0x7faf48005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:42.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf5c100820 msgr2=0x7faf5c198150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf5c100820 0x7faf5c198150 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00e9f0 tx=0x7faf4c00edf0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 shutdown_connections 2024-09-13T18:01:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf400a1090 0x7faf400a3550 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf5c105a80 0x7faf5c19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf5c103150 0x7faf5c198690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 --2- 172.21.15.27:0/424244512 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf5c100820 0x7faf5c198150 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 >> 172.21.15.27:0/424244512 conn(0x7faf5c0fa440 msgr2=0x7faf5c0fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 shutdown_connections 2024-09-13T18:01:42.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.567+0000 7faf61600640 1 -- 172.21.15.27:0/424244512 wait complete. 2024-09-13T18:01:42.588 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:57:10.088488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:01:42.589 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:01:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.753+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2778854316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 msgr2=0x7fa3dc072ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.753+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2778854316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 0x7fa3dc072ce0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009900 tx=0x7fa3cc02a410 comp rx=0 tx=0).stop 2024-09-13T18:01:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.753+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2778854316 shutdown_connections 2024-09-13T18:01:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.753+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2778854316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3dc107fd0 0x7fa3dc10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.753+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2778854316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3dc073220 0x7fa3dc107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.753+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2778854316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 0x7fa3dc072ce0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.753+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2778854316 >> 172.21.15.27:0/2778854316 conn(0x7fa3dc0fb3d0 msgr2=0x7fa3dc0fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.753+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2778854316 shutdown_connections 2024-09-13T18:01:42.757 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.753+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2778854316 wait complete. 2024-09-13T18:01:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3dbe00640 1 Processor -- start 2024-09-13T18:01:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3dbe00640 1 -- start start 2024-09-13T18:01:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3dbe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 0x7fa3dc197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3dbe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3dc073220 0x7fa3dc1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3dbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3dc107fd0 0x7fa3dc19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3dbe00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc19fa80 con 0x7fa3dc0728e0 2024-09-13T18:01:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3dbe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc19fbf0 con 0x7fa3dc107fd0 2024-09-13T18:01:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3dbe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc19fdb0 con 0x7fa3dc073220 2024-09-13T18:01:42.758 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3daa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 0x7fa3dc197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3daa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 0x7fa3dc197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54166/0 (socket says 172.21.15.27:54166) 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3daa00640 1 -- 172.21.15.27:0/2094084673 learned_addr learned my addr 172.21.15.27:0/2094084673 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.754+0000 7fa3d3e00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3dc073220 0x7fa3dc1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.755+0000 7fa3db400640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3dc107fd0 0x7fa3dc19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.755+0000 7fa3daa00640 1 -- 172.21.15.27:0/2094084673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3dc073220 msgr2=0x7fa3dc1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.755+0000 7fa3daa00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3dc073220 0x7fa3dc1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.755+0000 7fa3daa00640 1 -- 172.21.15.27:0/2094084673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3dc107fd0 msgr2=0x7fa3dc19f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.755+0000 7fa3daa00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3dc107fd0 0x7fa3dc19f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.755+0000 7fa3daa00640 1 -- 172.21.15.27:0/2094084673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc009560 con 0x7fa3dc0728e0 2024-09-13T18:01:42.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.755+0000 7fa3daa00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 0x7fa3dc197f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc031510 tx=0x7fa3cc004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.756+0000 7fa3d3400640 1 -- 172.21.15.27:0/2094084673 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc005210 con 0x7fa3dc0728e0 2024-09-13T18:01:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.756+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3dc1a0030 con 0x7fa3dc0728e0 2024-09-13T18:01:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.756+0000 7fa3d3400640 1 -- 172.21.15.27:0/2094084673 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa3cc004ba0 con 0x7fa3dc0728e0 2024-09-13T18:01:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.756+0000 7fa3d3400640 1 -- 172.21.15.27:0/2094084673 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc003b20 con 0x7fa3dc0728e0 2024-09-13T18:01:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.756+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc1a0530 con 0x7fa3dc0728e0 2024-09-13T18:01:42.760 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.757+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3dc072ce0 con 0x7fa3dc0728e0 2024-09-13T18:01:42.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.759+0000 7fa3d3400640 1 -- 172.21.15.27:0/2094084673 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa3cc004d10 con 0x7fa3dc0728e0 2024-09-13T18:01:42.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.760+0000 7fa3d3400640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa3c00a1090 0x7fa3c00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:42.763 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.760+0000 7fa3d3400640 1 -- 172.21.15.27:0/2094084673 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa3cc0ed540 con 0x7fa3dc0728e0 2024-09-13T18:01:42.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.760+0000 7fa3d3e00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa3c00a1090 0x7fa3c00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:42.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.761+0000 7fa3d3e00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa3c00a1090 0x7fa3c00a3550 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc1994a0 tx=0x7fa3c400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:42.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.762+0000 7fa3d3400640 1 -- 172.21.15.27:0/2094084673 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa3cc0b7180 con 0x7fa3dc0728e0 2024-09-13T18:01:42.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.946+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3dc10d950 con 0x7fa3dc0728e0 2024-09-13T18:01:42.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.947+0000 7fa3d3400640 1 -- 172.21.15.27:0/2094084673 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3cc0ba7a0 con 0x7fa3dc0728e0 2024-09-13T18:01:42.950 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-13T18:01:42.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa3c00a1090 msgr2=0x7fa3c00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa3c00a1090 0x7fa3c00a3550 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc1994a0 tx=0x7fa3c400b410 comp rx=0 tx=0).stop 2024-09-13T18:01:42.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 msgr2=0x7fa3dc197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:42.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 0x7fa3dc197f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc031510 tx=0x7fa3cc004360 comp rx=0 tx=0).stop 2024-09-13T18:01:42.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 shutdown_connections 2024-09-13T18:01:42.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa3c00a1090 0x7fa3c00a3550 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa3dc107fd0 0x7fa3dc19f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa3dc073220 0x7fa3dc1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 --2- 172.21.15.27:0/2094084673 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa3dc0728e0 0x7fa3dc197f90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:42.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 >> 172.21.15.27:0/2094084673 conn(0x7fa3dc0fb3d0 msgr2=0x7fa3dc103a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:42.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 shutdown_connections 2024-09-13T18:01:42.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:42.949+0000 7fa3dbe00640 1 -- 172.21.15.27:0/2094084673 wait complete. 2024-09-13T18:01:42.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:42 smithi027 ceph-mon[30611]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:42.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:42.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:42.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:42.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:42.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:42 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3373824340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:42.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:42.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:42 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:42.967 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:42 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/424244512' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:42.969 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:01:43.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:42 smithi143 ceph-mon[38210]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:43.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:42 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3373824340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:43.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:42 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:42 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/424244512' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.133+0000 7f998c400640 1 -- 172.21.15.27:0/3460216049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9984103b50 msgr2=0x7f998410a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.133+0000 7f998c400640 1 --2- 172.21.15.27:0/3460216049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9984103b50 0x7f998410a3e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f997c009ca0 tx=0x7f997c02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.134+0000 7f998c400640 1 -- 172.21.15.27:0/3460216049 shutdown_connections 2024-09-13T18:01:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.134+0000 7f998c400640 1 --2- 172.21.15.27:0/3460216049 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9984103b50 0x7f998410a3e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.134+0000 7f998c400640 1 --2- 172.21.15.27:0/3460216049 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9984103190 0x7f9984103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.134+0000 7f998c400640 1 --2- 172.21.15.27:0/3460216049 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9984101fa0 0x7f99841023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.134+0000 7f998c400640 1 -- 172.21.15.27:0/3460216049 >> 172.21.15.27:0/3460216049 conn(0x7f99840fd720 msgr2=0x7f99840ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.134+0000 7f998c400640 1 -- 172.21.15.27:0/3460216049 shutdown_connections 2024-09-13T18:01:43.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.134+0000 7f998c400640 1 -- 172.21.15.27:0/3460216049 wait complete. 2024-09-13T18:01:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.135+0000 7f998c400640 1 Processor -- start 2024-09-13T18:01:43.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.135+0000 7f998c400640 1 -- start start 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.135+0000 7f998c400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9984101fa0 0x7f9984197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.135+0000 7f998c400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9984103190 0x7f99841984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.135+0000 7f998c400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9984103b50 0x7f998419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.135+0000 7f998c400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998419fa80 con 0x7f9984103b50 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.135+0000 7f998c400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998419fbf0 con 0x7f9984103190 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.135+0000 7f998c400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998419fdb0 con 0x7f9984101fa0 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9984101fa0 0x7f9984197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f998a400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9984103b50 0x7f998419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9984103190 0x7f99841984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9984101fa0 0x7f9984197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:32976/0 (socket says 172.21.15.27:32976) 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989a00640 1 -- 172.21.15.27:0/3279035189 learned_addr learned my addr 172.21.15.27:0/3279035189 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:43.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989a00640 1 -- 172.21.15.27:0/3279035189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9984103190 msgr2=0x7f99841984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989a00640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9984103190 0x7f99841984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989a00640 1 -- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9984103b50 msgr2=0x7f998419f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989a00640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9984103b50 0x7f998419f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989a00640 1 -- 172.21.15.27:0/3279035189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c009900 con 0x7f9984101fa0 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f998a400640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9984103b50 0x7f998419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.136+0000 7f9989a00640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9984101fa0 0x7f9984197f90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f997800d770 tx=0x7f997800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.137+0000 7f9982000640 1 -- 172.21.15.27:0/3279035189 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978009c30 con 0x7f9984101fa0 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.137+0000 7f9982000640 1 -- 172.21.15.27:0/3279035189 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f997800de80 con 0x7f9984101fa0 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.137+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99841a0090 con 0x7f9984101fa0 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.137+0000 7f9982000640 1 -- 172.21.15.27:0/3279035189 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978010460 con 0x7f9984101fa0 2024-09-13T18:01:43.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.137+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99841a05a0 con 0x7f9984101fa0 2024-09-13T18:01:43.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.138+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9984109390 con 0x7f9984101fa0 2024-09-13T18:01:43.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.139+0000 7f9982000640 1 -- 172.21.15.27:0/3279035189 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9978003f60 con 0x7f9984101fa0 2024-09-13T18:01:43.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.141+0000 7f9982000640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f996c0a1090 0x7f996c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.141+0000 7f9982000640 1 -- 172.21.15.27:0/3279035189 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f99780cc140 con 0x7f9984101fa0 2024-09-13T18:01:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.141+0000 7f9989000640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f996c0a1090 0x7f996c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:43.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.142+0000 7f9989000640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f996c0a1090 0x7f996c0a3550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f99841994a0 tx=0x7f997000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:43.147 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.145+0000 7f9982000640 1 -- 172.21.15.27:0/3279035189 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9978095d80 con 0x7f9984101fa0 2024-09-13T18:01:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:42 smithi122 ceph-mon[35310]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:42 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3373824340' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:43.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:42 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:43.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:42 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/424244512' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:43.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.337+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f998410d980 con 0x7f9984101fa0 2024-09-13T18:01:43.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.338+0000 7f9982000640 1 -- 172.21.15.27:0/3279035189 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v82) v1 ==== 84+0+65 (secure 0 0 0) 0x7f99780993a0 con 0x7f9984101fa0 2024-09-13T18:01:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:43.341 INFO:teuthology.orchestra.run.smithi027.stdout:[ 2024-09-13T18:01:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:01:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "poolnum": 1, 2024-09-13T18:01:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: "poolname": ".mgr" 2024-09-13T18:01:43.341 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:01:43.341 INFO:teuthology.orchestra.run.smithi027.stdout:] 2024-09-13T18:01:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f996c0a1090 msgr2=0x7f996c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f996c0a1090 0x7f996c0a3550 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f99841994a0 tx=0x7f997000b410 comp rx=0 tx=0).stop 2024-09-13T18:01:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9984101fa0 msgr2=0x7f9984197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9984101fa0 0x7f9984197f90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f997800d770 tx=0x7f997800dc30 comp rx=0 tx=0).stop 2024-09-13T18:01:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 shutdown_connections 2024-09-13T18:01:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f996c0a1090 0x7f996c0a3550 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9984103b50 0x7f998419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9984103190 0x7f99841984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 --2- 172.21.15.27:0/3279035189 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9984101fa0 0x7f9984197f90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 >> 172.21.15.27:0/3279035189 conn(0x7f99840fd720 msgr2=0x7f9984106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:43.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 shutdown_connections 2024-09-13T18:01:43.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.340+0000 7f998c400640 1 -- 172.21.15.27:0/3279035189 wait complete. 2024-09-13T18:01:43.361 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:01:43.361 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:01:43.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.525+0000 7fe499600640 1 -- 172.21.15.27:0/2216329195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe494103090 msgr2=0x7fe494105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:43.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.525+0000 7fe499600640 1 --2- 172.21.15.27:0/2216329195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe494103090 0x7fe494105480 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe480009900 tx=0x7fe48002a410 comp rx=0 tx=0).stop 2024-09-13T18:01:43.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.525+0000 7fe499600640 1 -- 172.21.15.27:0/2216329195 shutdown_connections 2024-09-13T18:01:43.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.525+0000 7fe499600640 1 --2- 172.21.15.27:0/2216329195 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe4941059c0 0x7fe494107e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.525+0000 7fe499600640 1 --2- 172.21.15.27:0/2216329195 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe494103090 0x7fe494105480 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.525+0000 7fe499600640 1 --2- 172.21.15.27:0/2216329195 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe494100760 0x7fe494102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.526+0000 7fe499600640 1 -- 172.21.15.27:0/2216329195 >> 172.21.15.27:0/2216329195 conn(0x7fe4940fa360 msgr2=0x7fe4940fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:43.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.526+0000 7fe499600640 1 -- 172.21.15.27:0/2216329195 shutdown_connections 2024-09-13T18:01:43.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.526+0000 7fe499600640 1 -- 172.21.15.27:0/2216329195 wait complete. 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe499600640 1 Processor -- start 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe499600640 1 -- start start 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe499600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe494100760 0x7fe494198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe499600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe494103090 0x7fe4941985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe499600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4941059c0 0x7fe49419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe499600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49419fb60 con 0x7fe4941059c0 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe499600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49419fcd0 con 0x7fe494100760 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe499600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49419fe90 con 0x7fe494103090 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe493e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe494100760 0x7fe494198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe493e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe494100760 0x7fe494198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:50462/0 (socket says 172.21.15.27:50462) 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.527+0000 7fe493e00640 1 -- 172.21.15.27:0/405866628 learned_addr learned my addr 172.21.15.27:0/405866628 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:43.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe493400640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe494103090 0x7fe4941985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:43.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe498c00640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4941059c0 0x7fe49419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:43.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe493e00640 1 -- 172.21.15.27:0/405866628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe494103090 msgr2=0x7fe4941985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:43.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe493e00640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe494103090 0x7fe4941985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe493e00640 1 -- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4941059c0 msgr2=0x7fe49419f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:43.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe493e00640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4941059c0 0x7fe49419f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:43.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe493e00640 1 -- 172.21.15.27:0/405866628 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480009560 con 0x7fe494100760 2024-09-13T18:01:43.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe493e00640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe494100760 0x7fe494198070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe48400e9f0 tx=0x7fe48400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:43.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe490c00640 1 -- 172.21.15.27:0/405866628 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484009700 con 0x7fe494100760 2024-09-13T18:01:43.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.528+0000 7fe490c00640 1 -- 172.21.15.27:0/405866628 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe48400cd80 con 0x7fe494100760 2024-09-13T18:01:43.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.529+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4941a0170 con 0x7fe494100760 2024-09-13T18:01:43.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.529+0000 7fe490c00640 1 -- 172.21.15.27:0/405866628 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484018920 con 0x7fe494100760 2024-09-13T18:01:43.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.529+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4941a0650 con 0x7fe494100760 2024-09-13T18:01:43.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.530+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe494107530 con 0x7fe494100760 2024-09-13T18:01:43.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.532+0000 7fe490c00640 1 -- 172.21.15.27:0/405866628 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe484018a80 con 0x7fe494100760 2024-09-13T18:01:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.534+0000 7fe490c00640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe4780a1090 0x7fe4780a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.534+0000 7fe490c00640 1 -- 172.21.15.27:0/405866628 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe484014070 con 0x7fe494100760 2024-09-13T18:01:43.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.534+0000 7fe493400640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe4780a1090 0x7fe4780a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:43.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.535+0000 7fe493400640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe4780a1090 0x7fe4780a3550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe480009230 tx=0x7fe480005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:43.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.536+0000 7fe490c00640 1 -- 172.21.15.27:0/405866628 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe484096400 con 0x7fe494100760 2024-09-13T18:01:43.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:43.768+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe49410b760 con 0x7fe494100760 2024-09-13T18:01:44.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:43 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2094084673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:01:44.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:44.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:01:44.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:44.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:43 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:01:44.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:43 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3279035189' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T18:01:44.052 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:43 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2094084673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:01:44.052 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:44.052 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:01:44.052 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:44.053 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:43 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:01:44.053 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:43 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3279035189' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T18:01:44.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:43 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2094084673' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:01:44.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:44.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:01:44.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:44.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:43 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:01:44.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:43 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3279035189' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-13T18:01:44.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.724+0000 7fe490c00640 1 -- 172.21.15.27:0/405866628 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v83) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe484099a20 con 0x7fe494100760 2024-09-13T18:01:44.727 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' created 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe4780a1090 msgr2=0x7fe4780a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe4780a1090 0x7fe4780a3550 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe480009230 tx=0x7fe480005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe494100760 msgr2=0x7fe494198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe494100760 0x7fe494198070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe48400e9f0 tx=0x7fe48400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 shutdown_connections 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe4780a1090 0x7fe4780a3550 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe4941059c0 0x7fe49419f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe494103090 0x7fe4941985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 --2- 172.21.15.27:0/405866628 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe494100760 0x7fe494198070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 >> 172.21.15.27:0/405866628 conn(0x7fe4940fa360 msgr2=0x7fe4940ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:44.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 shutdown_connections 2024-09-13T18:01:44.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.728+0000 7fe499600640 1 -- 172.21.15.27:0/405866628 wait complete. 2024-09-13T18:01:44.747 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:01:44.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.927+0000 7f6e98a00640 1 -- 172.21.15.27:0/2492673980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94100ed0 msgr2=0x7f6e94101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:44.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.927+0000 7f6e98a00640 1 --2- 172.21.15.27:0/2492673980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94100ed0 0x7f6e94101350 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009900 tx=0x7f6e8002a410 comp rx=0 tx=0).stop 2024-09-13T18:01:44.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.928+0000 7f6e98a00640 1 -- 172.21.15.27:0/2492673980 shutdown_connections 2024-09-13T18:01:44.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.928+0000 7f6e98a00640 1 --2- 172.21.15.27:0/2492673980 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e94101890 0x7f6e94108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.928+0000 7f6e98a00640 1 --2- 172.21.15.27:0/2492673980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94100ed0 0x7f6e94101350 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.928+0000 7f6e98a00640 1 --2- 172.21.15.27:0/2492673980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e940ffce0 0x7f6e941000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.928+0000 7f6e98a00640 1 -- 172.21.15.27:0/2492673980 >> 172.21.15.27:0/2492673980 conn(0x7f6e940fb440 msgr2=0x7f6e940fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:44.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.928+0000 7f6e98a00640 1 -- 172.21.15.27:0/2492673980 shutdown_connections 2024-09-13T18:01:44.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.928+0000 7f6e98a00640 1 -- 172.21.15.27:0/2492673980 wait complete. 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e98a00640 1 Processor -- start 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e98a00640 1 -- start start 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e98a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e940ffce0 0x7f6e94074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e98a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e94100ed0 0x7f6e940728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e98a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94101890 0x7f6e94072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e98a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94073540 con 0x7f6e94101890 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e98a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e940736b0 con 0x7f6e94100ed0 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e98a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9419fe00 con 0x7f6e940ffce0 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e93e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94101890 0x7f6e94072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e93400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e940ffce0 0x7f6e94074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:44.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e92a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e94100ed0 0x7f6e940728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e93400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e940ffce0 0x7f6e94074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:33010/0 (socket says 172.21.15.27:33010) 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e93e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94101890 0x7f6e94072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54236/0 (socket says 172.21.15.27:54236) 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.929+0000 7f6e93400640 1 -- 172.21.15.27:0/539971629 learned_addr learned my addr 172.21.15.27:0/539971629 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.930+0000 7f6e93e00640 1 -- 172.21.15.27:0/539971629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e940ffce0 msgr2=0x7f6e94074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.930+0000 7f6e93e00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e940ffce0 0x7f6e94074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.930+0000 7f6e93e00640 1 -- 172.21.15.27:0/539971629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e94100ed0 msgr2=0x7f6e940728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.930+0000 7f6e93e00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e94100ed0 0x7f6e940728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.930+0000 7f6e93e00640 1 -- 172.21.15.27:0/539971629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e80009560 con 0x7f6e94101890 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.930+0000 7f6e92a00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e94100ed0 0x7f6e940728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.930+0000 7f6e93e00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94101890 0x7f6e94072de0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00ea80 tx=0x7f6e8c00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.931+0000 7f6e8be00640 1 -- 172.21.15.27:0/539971629 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c00cea0 con 0x7f6e94101890 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.931+0000 7f6e8be00640 1 -- 172.21.15.27:0/539971629 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6e8c005020 con 0x7f6e94101890 2024-09-13T18:01:44.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.931+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e941a00b0 con 0x7f6e94101890 2024-09-13T18:01:44.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.931+0000 7f6e8be00640 1 -- 172.21.15.27:0/539971629 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8c010690 con 0x7f6e94101890 2024-09-13T18:01:44.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.931+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e941a0590 con 0x7f6e94101890 2024-09-13T18:01:44.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.932+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e94107110 con 0x7f6e94101890 2024-09-13T18:01:44.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.934+0000 7f6e8be00640 1 -- 172.21.15.27:0/539971629 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6e8c005500 con 0x7f6e94101890 2024-09-13T18:01:44.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.935+0000 7f6e8be00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6e780a1110 0x7f6e780a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:44.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.935+0000 7f6e8be00640 1 -- 172.21.15.27:0/539971629 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f6e8c014070 con 0x7f6e94101890 2024-09-13T18:01:44.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.935+0000 7f6e93400640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6e780a1110 0x7f6e780a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:44.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.936+0000 7f6e93400640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6e780a1110 0x7f6e780a35d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6e840058c0 tx=0x7f6e84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:44.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:44.944+0000 7f6e8be00640 1 -- 172.21.15.27:0/539971629 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f6e8c0966d0 con 0x7f6e94101890 2024-09-13T18:01:45.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:44 smithi143 ceph-mon[38210]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:45.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:44 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/405866628' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T18:01:45.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:44 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T18:01:45.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:44 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:44 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:44 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:44 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:44 smithi027 ceph-mon[30611]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:45.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:44 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/405866628' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T18:01:45.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:44 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T18:01:45.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:44 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:44 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:44 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:44 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.167+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6e9410b770 con 0x7f6e94101890 2024-09-13T18:01:45.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:44 smithi122 ceph-mon[35310]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:45.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:44 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/405866628' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T18:01:45.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:44 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-13T18:01:45.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:44 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:44 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:44 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:44 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:45.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.895+0000 7f6e8be00640 1 -- 172.21.15.27:0/539971629 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v84) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6e8c005190 con 0x7f6e94101890 2024-09-13T18:01:45.898 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' created 2024-09-13T18:01:45.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6e780a1110 msgr2=0x7f6e780a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:45.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6e780a1110 0x7f6e780a35d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6e840058c0 tx=0x7f6e84005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:45.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94101890 msgr2=0x7f6e94072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94101890 0x7f6e94072de0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c00ea80 tx=0x7f6e8c00ef40 comp rx=0 tx=0).stop 2024-09-13T18:01:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 shutdown_connections 2024-09-13T18:01:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f6e780a1110 0x7f6e780a35d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6e94101890 0x7f6e94072de0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f6e94100ed0 0x7f6e940728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 --2- 172.21.15.27:0/539971629 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f6e940ffce0 0x7f6e94074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.901+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 >> 172.21.15.27:0/539971629 conn(0x7f6e940fb440 msgr2=0x7f6e941042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:45.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.902+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 shutdown_connections 2024-09-13T18:01:45.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:45.902+0000 7f6e98a00640 1 -- 172.21.15.27:0/539971629 wait complete. 2024-09-13T18:01:45.930 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:01:46.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.094+0000 7f6124800640 1 -- 172.21.15.27:0/2507723802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f611c0ffd70 msgr2=0x7f611c100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.094+0000 7f6124800640 1 --2- 172.21.15.27:0/2507723802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f611c0ffd70 0x7f611c100170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6110009900 tx=0x7f611002a410 comp rx=0 tx=0).stop 2024-09-13T18:01:46.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.094+0000 7f6124800640 1 -- 172.21.15.27:0/2507723802 shutdown_connections 2024-09-13T18:01:46.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.094+0000 7f6124800640 1 --2- 172.21.15.27:0/2507723802 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f611c101920 0x7f611c1081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.094+0000 7f6124800640 1 --2- 172.21.15.27:0/2507723802 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f611c100f60 0x7f611c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.094+0000 7f6124800640 1 --2- 172.21.15.27:0/2507723802 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f611c0ffd70 0x7f611c100170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.094+0000 7f6124800640 1 -- 172.21.15.27:0/2507723802 >> 172.21.15.27:0/2507723802 conn(0x7f611c0fb4d0 msgr2=0x7f611c0fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:46.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.094+0000 7f6124800640 1 -- 172.21.15.27:0/2507723802 shutdown_connections 2024-09-13T18:01:46.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.094+0000 7f6124800640 1 -- 172.21.15.27:0/2507723802 wait complete. 2024-09-13T18:01:46.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.095+0000 7f6124800640 1 Processor -- start 2024-09-13T18:01:46.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.095+0000 7f6124800640 1 -- start start 2024-09-13T18:01:46.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6124800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f611c0ffd70 0x7f611c1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6124800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f611c100f60 0x7f611c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6124800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f611c101920 0x7f611c19f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6124800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c19fbb0 con 0x7f611c0ffd70 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6124800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c19fd20 con 0x7f611c101920 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6124800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611c19fee0 con 0x7f611c100f60 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6121e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f611c0ffd70 0x7f611c1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6121400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f611c100f60 0x7f611c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6121e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f611c0ffd70 0x7f611c1980c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54252/0 (socket says 172.21.15.27:54252) 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6121e00640 1 -- 172.21.15.27:0/160428132 learned_addr learned my addr 172.21.15.27:0/160428132 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6122800640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f611c101920 0x7f611c19f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6121400640 1 -- 172.21.15.27:0/160428132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f611c101920 msgr2=0x7f611c19f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6121400640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f611c101920 0x7f611c19f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6121400640 1 -- 172.21.15.27:0/160428132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f611c0ffd70 msgr2=0x7f611c1980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6121400640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f611c0ffd70 0x7f611c1980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.096+0000 7f6121400640 1 -- 172.21.15.27:0/160428132 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6110009560 con 0x7f611c100f60 2024-09-13T18:01:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.097+0000 7f6121400640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f611c100f60 0x7f611c198600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f610c005fd0 tx=0x7f610c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.097+0000 7f6116a00640 1 -- 172.21.15.27:0/160428132 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c009c30 con 0x7f611c100f60 2024-09-13T18:01:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.097+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f611c1a01c0 con 0x7f611c100f60 2024-09-13T18:01:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.097+0000 7f6116a00640 1 -- 172.21.15.27:0/160428132 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f610c004510 con 0x7f611c100f60 2024-09-13T18:01:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.097+0000 7f6116a00640 1 -- 172.21.15.27:0/160428132 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c003e60 con 0x7f611c100f60 2024-09-13T18:01:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.097+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611c1a0720 con 0x7f611c100f60 2024-09-13T18:01:46.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.098+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c10b800 con 0x7f611c100f60 2024-09-13T18:01:46.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.100+0000 7f6116a00640 1 -- 172.21.15.27:0/160428132 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f610c004000 con 0x7f611c100f60 2024-09-13T18:01:46.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.102+0000 7f6116a00640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f61040a1110 0x7f61040a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.102+0000 7f6116a00640 1 -- 172.21.15.27:0/160428132 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f610c0cc240 con 0x7f611c100f60 2024-09-13T18:01:46.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.102+0000 7f6121e00640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f61040a1110 0x7f61040a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.103+0000 7f6121e00640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f61040a1110 0x7f61040a35d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6110006010 tx=0x7f6110005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:46.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.103+0000 7f6116a00640 1 -- 172.21.15.27:0/160428132 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f610c095c10 con 0x7f611c100f60 2024-09-13T18:01:46.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:45 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T18:01:46.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:45 smithi122 ceph-mon[35310]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T18:01:46.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:45 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T18:01:46.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:45 smithi143 ceph-mon[38210]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T18:01:46.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:45 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-13T18:01:46.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:45 smithi027 ceph-mon[30611]: osdmap e83: 12 total, 12 up, 12 in 2024-09-13T18:01:46.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.318+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f611c10b9c0 con 0x7f611c100f60 2024-09-13T18:01:46.329 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.327+0000 7f6116a00640 1 -- 172.21.15.27:0/160428132 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f610c020070 con 0x7f611c100f60 2024-09-13T18:01:46.330 INFO:teuthology.orchestra.run.smithi027.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:01:46.333 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.331+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f61040a1110 msgr2=0x7f61040a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.331+0000 7f6124800640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f61040a1110 0x7f61040a35d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6110006010 tx=0x7f6110005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:46.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.331+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f611c100f60 msgr2=0x7f611c198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.331+0000 7f6124800640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f611c100f60 0x7f611c198600 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f610c005fd0 tx=0x7f610c00dde0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.332+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 shutdown_connections 2024-09-13T18:01:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.332+0000 7f6124800640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f61040a1110 0x7f61040a35d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.332+0000 7f6124800640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f611c101920 0x7f611c19f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.332+0000 7f6124800640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f611c100f60 0x7f611c198600 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.337 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.332+0000 7f6124800640 1 --2- 172.21.15.27:0/160428132 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f611c0ffd70 0x7f611c1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.332+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 >> 172.21.15.27:0/160428132 conn(0x7f611c0fb4d0 msgr2=0x7f611c106720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:46.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.333+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 shutdown_connections 2024-09-13T18:01:46.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.333+0000 7f6124800640 1 -- 172.21.15.27:0/160428132 wait complete. 2024-09-13T18:01:46.363 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:01:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.522+0000 7f0c13a00640 1 -- 172.21.15.27:0/604510786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 msgr2=0x7f0c0c103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.522+0000 7f0c13a00640 1 --2- 172.21.15.27:0/604510786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 0x7f0c0c103610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009900 tx=0x7f0bf802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.522+0000 7f0c13a00640 1 -- 172.21.15.27:0/604510786 shutdown_connections 2024-09-13T18:01:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.522+0000 7f0c13a00640 1 --2- 172.21.15.27:0/604510786 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c103b50 0x7f0c0c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.522+0000 7f0c13a00640 1 --2- 172.21.15.27:0/604510786 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 0x7f0c0c103610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.522+0000 7f0c13a00640 1 --2- 172.21.15.27:0/604510786 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c0c101fa0 0x7f0c0c1023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.522+0000 7f0c13a00640 1 -- 172.21.15.27:0/604510786 >> 172.21.15.27:0/604510786 conn(0x7f0c0c0fd700 msgr2=0x7f0c0c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.522+0000 7f0c13a00640 1 -- 172.21.15.27:0/604510786 shutdown_connections 2024-09-13T18:01:46.524 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.522+0000 7f0c13a00640 1 -- 172.21.15.27:0/604510786 wait complete. 2024-09-13T18:01:46.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c13a00640 1 Processor -- start 2024-09-13T18:01:46.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c13a00640 1 -- start start 2024-09-13T18:01:46.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c13a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c101fa0 0x7f0c0c198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c13a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 0x7f0c0c1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c13a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c0c103b50 0x7f0c0c19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c13a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c19fb80 con 0x7f0c0c103190 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c13a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c19fcf0 con 0x7f0c0c103b50 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c13a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c19feb0 con 0x7f0c0c101fa0 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c0be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 0x7f0c0c1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c0be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 0x7f0c0c1985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54270/0 (socket says 172.21.15.27:54270) 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c0be00640 1 -- 172.21.15.27:0/3634123983 learned_addr learned my addr 172.21.15.27:0/3634123983 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c11000640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c101fa0 0x7f0c0c198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.523+0000 7f0c11a00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c0c103b50 0x7f0c0c19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.527 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c11000640 1 -- 172.21.15.27:0/3634123983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c0c103b50 msgr2=0x7f0c0c19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c11000640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c0c103b50 0x7f0c0c19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c11000640 1 -- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 msgr2=0x7f0c0c1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c11000640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 0x7f0c0c1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c11000640 1 -- 172.21.15.27:0/3634123983 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8009560 con 0x7f0c0c101fa0 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c0be00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 0x7f0c0c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c11000640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c101fa0 0x7f0c0c198090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000e9c0 tx=0x7f0c0000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c09600640 1 -- 172.21.15.27:0/3634123983 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0000ccc0 con 0x7f0c0c101fa0 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c1a0190 con 0x7f0c0c101fa0 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c09600640 1 -- 172.21.15.27:0/3634123983 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0c0000ce20 con 0x7f0c0c101fa0 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.524+0000 7f0c09600640 1 -- 172.21.15.27:0/3634123983 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c00010430 con 0x7f0c0c101fa0 2024-09-13T18:01:46.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.525+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c1a0670 con 0x7f0c0c101fa0 2024-09-13T18:01:46.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.526+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c109390 con 0x7f0c0c101fa0 2024-09-13T18:01:46.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.528+0000 7f0c09600640 1 -- 172.21.15.27:0/3634123983 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0c00003f40 con 0x7f0c0c101fa0 2024-09-13T18:01:46.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.529+0000 7f0c09600640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0bf40a1090 0x7f0bf40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.529+0000 7f0c09600640 1 -- 172.21.15.27:0/3634123983 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0c00014070 con 0x7f0c0c101fa0 2024-09-13T18:01:46.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.529+0000 7f0c0be00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0bf40a1090 0x7f0bf40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.530+0000 7f0c0be00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0bf40a1090 0x7f0bf40a3550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8000c00 tx=0x7f0bf8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:46.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.531+0000 7f0c09600640 1 -- 172.21.15.27:0/3634123983 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0c000966a0 con 0x7f0c0c101fa0 2024-09-13T18:01:46.716 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.714+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c0c10d9f0 con 0x7f0c0c101fa0 2024-09-13T18:01:46.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.716+0000 7f0c09600640 1 -- 172.21.15.27:0/3634123983 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22108 (secure 0 0 0) 0x7f0c00099cc0 con 0x7f0c0c101fa0 2024-09-13T18:01:46.718 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:46.719 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":85,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:01:46.320130+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:01:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0bf40a1090 msgr2=0x7f0bf40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0bf40a1090 0x7f0bf40a3550 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8000c00 tx=0x7f0bf8005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c101fa0 msgr2=0x7f0c0c198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c101fa0 0x7f0c0c198090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c0000e9c0 tx=0x7f0c0000ee80 comp rx=0 tx=0).stop 2024-09-13T18:01:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 shutdown_connections 2024-09-13T18:01:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0bf40a1090 0x7f0bf40a3550 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c0c103b50 0x7f0c0c19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c0c103190 0x7f0c0c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 --2- 172.21.15.27:0/3634123983 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c0c101fa0 0x7f0c0c198090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 >> 172.21.15.27:0/3634123983 conn(0x7f0c0c0fd700 msgr2=0x7f0c0c106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:46.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 shutdown_connections 2024-09-13T18:01:46.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.718+0000 7f0c13a00640 1 -- 172.21.15.27:0/3634123983 wait complete. 2024-09-13T18:01:46.736 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:01:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.896+0000 7ff718000640 1 -- 172.21.15.27:0/4028036484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710105a80 msgr2=0x7ff710107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.896+0000 7ff718000640 1 --2- 172.21.15.27:0/4028036484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710105a80 0x7ff710107ef0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff708009ca0 tx=0x7ff70802a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.896+0000 7ff718000640 1 -- 172.21.15.27:0/4028036484 shutdown_connections 2024-09-13T18:01:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.896+0000 7ff718000640 1 --2- 172.21.15.27:0/4028036484 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710105a80 0x7ff710107ef0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.896+0000 7ff718000640 1 --2- 172.21.15.27:0/4028036484 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff710103150 0x7ff710105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.896+0000 7ff718000640 1 --2- 172.21.15.27:0/4028036484 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff710100820 0x7ff710102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.896+0000 7ff718000640 1 -- 172.21.15.27:0/4028036484 >> 172.21.15.27:0/4028036484 conn(0x7ff7100fa420 msgr2=0x7ff7100fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:46.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.896+0000 7ff718000640 1 -- 172.21.15.27:0/4028036484 shutdown_connections 2024-09-13T18:01:46.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.896+0000 7ff718000640 1 -- 172.21.15.27:0/4028036484 wait complete. 2024-09-13T18:01:46.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff718000640 1 Processor -- start 2024-09-13T18:01:46.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff718000640 1 -- start start 2024-09-13T18:01:46.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff718000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710100820 0x7ff710195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff718000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff710103150 0x7ff710196420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff718000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff710105a80 0x7ff71019d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff718000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71019d9d0 con 0x7ff710100820 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff718000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71019db40 con 0x7ff710103150 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff718000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71019dd00 con 0x7ff710105a80 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff715600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710100820 0x7ff710195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff715600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710100820 0x7ff710195ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54284/0 (socket says 172.21.15.27:54284) 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.897+0000 7ff715600640 1 -- 172.21.15.27:0/441222832 learned_addr learned my addr 172.21.15.27:0/441222832 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff716000640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff710105a80 0x7ff71019d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff714c00640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff710103150 0x7ff710196420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff715600640 1 -- 172.21.15.27:0/441222832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff710105a80 msgr2=0x7ff71019d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff715600640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff710105a80 0x7ff71019d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff715600640 1 -- 172.21.15.27:0/441222832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff710103150 msgr2=0x7ff710196420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:46.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff715600640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff710103150 0x7ff710196420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff715600640 1 -- 172.21.15.27:0/441222832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff708009900 con 0x7ff710100820 2024-09-13T18:01:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff716000640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff710105a80 0x7ff71019d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff715600640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710100820 0x7ff710195ee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff70400e9f0 tx=0x7ff70400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.898+0000 7ff70e000640 1 -- 172.21.15.27:0/441222832 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704009700 con 0x7ff710100820 2024-09-13T18:01:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.899+0000 7ff70e000640 1 -- 172.21.15.27:0/441222832 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff70400cd80 con 0x7ff710100820 2024-09-13T18:01:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.899+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71019dfe0 con 0x7ff710100820 2024-09-13T18:01:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.899+0000 7ff70e000640 1 -- 172.21.15.27:0/441222832 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704018920 con 0x7ff710100820 2024-09-13T18:01:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.899+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71019e400 con 0x7ff710100820 2024-09-13T18:01:46.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.900+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff710103530 con 0x7ff710100820 2024-09-13T18:01:46.903 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.902+0000 7ff70e000640 1 -- 172.21.15.27:0/441222832 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff704018a80 con 0x7ff710100820 2024-09-13T18:01:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.904+0000 7ff70e000640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6f80a1090 0x7ff6f80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.904+0000 7ff70e000640 1 -- 172.21.15.27:0/441222832 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff704014070 con 0x7ff710100820 2024-09-13T18:01:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.904+0000 7ff714c00640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6f80a1090 0x7ff6f80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:46.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.905+0000 7ff714c00640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6f80a1090 0x7ff6f80a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff7101973f0 tx=0x7ff6fc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:46.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:46.907+0000 7ff70e000640 1 -- 172.21.15.27:0/441222832 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff7040968d0 con 0x7ff710100820 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/539971629' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: pgmap v288: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/539971629' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:47.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T18:01:47.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/160428132' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:01:47.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:01:47.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T18:01:47.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T18:01:47.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T18:01:47.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T18:01:47.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T18:01:47.058 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:46 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3634123983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:47.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.100+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff71010b910 con 0x7ff710100820 2024-09-13T18:01:47.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.102+0000 7ff70e000640 1 -- 172.21.15.27:0/441222832 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22108 (secure 0 0 0) 0x7ff704099ef0 con 0x7ff710100820 2024-09-13T18:01:47.104 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:47.104 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":85,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:01:46.320130+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:01:47.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.104+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6f80a1090 msgr2=0x7ff6f80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:47.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.104+0000 7ff718000640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6f80a1090 0x7ff6f80a3550 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff7101973f0 tx=0x7ff6fc00b410 comp rx=0 tx=0).stop 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.104+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710100820 msgr2=0x7ff710195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.104+0000 7ff718000640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710100820 0x7ff710195ee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff70400e9f0 tx=0x7ff70400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.104+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 shutdown_connections 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.104+0000 7ff718000640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6f80a1090 0x7ff6f80a3550 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.104+0000 7ff718000640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff710105a80 0x7ff71019d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.104+0000 7ff718000640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff710103150 0x7ff710196420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.105+0000 7ff718000640 1 --2- 172.21.15.27:0/441222832 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff710100820 0x7ff710195ee0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.105+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 >> 172.21.15.27:0/441222832 conn(0x7ff7100fa420 msgr2=0x7ff7101012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.105+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 shutdown_connections 2024-09-13T18:01:47.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.105+0000 7ff718000640 1 -- 172.21.15.27:0/441222832 wait complete. 2024-09-13T18:01:47.122 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:01:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/539971629' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T18:01:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: pgmap v288: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/539971629' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T18:01:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T18:01:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/160428132' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T18:01:47.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:46 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3634123983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/539971629' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-13T18:01:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: pgmap v288: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-13T18:01:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/539971629' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-13T18:01:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: osdmap e84: 12 total, 12 up, 12 in 2024-09-13T18:01:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:01:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:01:47.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:01:47.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-13T18:01:47.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/160428132' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:01:47.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-13T18:01:47.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-13T18:01:47.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: osdmap e85: 12 total, 12 up, 12 in 2024-09-13T18:01:47.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-13T18:01:47.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-13T18:01:47.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-13T18:01:47.277 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:46 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3634123983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.283+0000 7f68f1800640 1 -- 172.21.15.27:0/825075889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 msgr2=0x7f68ec10a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.283+0000 7f68f1800640 1 --2- 172.21.15.27:0/825075889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 0x7f68ec10a3c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f68e4009ca0 tx=0x7f68e402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.283+0000 7f68f1800640 1 -- 172.21.15.27:0/825075889 shutdown_connections 2024-09-13T18:01:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.283+0000 7f68f1800640 1 --2- 172.21.15.27:0/825075889 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 0x7f68ec10a3c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.283+0000 7f68f1800640 1 --2- 172.21.15.27:0/825075889 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68ec103170 0x7f68ec1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.283+0000 7f68f1800640 1 --2- 172.21.15.27:0/825075889 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68ec101f80 0x7f68ec102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.283+0000 7f68f1800640 1 -- 172.21.15.27:0/825075889 >> 172.21.15.27:0/825075889 conn(0x7f68ec0fd700 msgr2=0x7f68ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.283+0000 7f68f1800640 1 -- 172.21.15.27:0/825075889 shutdown_connections 2024-09-13T18:01:47.286 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.283+0000 7f68f1800640 1 -- 172.21.15.27:0/825075889 wait complete. 2024-09-13T18:01:47.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.284+0000 7f68f1800640 1 Processor -- start 2024-09-13T18:01:47.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.284+0000 7f68f1800640 1 -- start start 2024-09-13T18:01:47.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.284+0000 7f68f1800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68ec101f80 0x7f68ec198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:47.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.284+0000 7f68f1800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68ec103170 0x7f68ec198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:47.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.284+0000 7f68f1800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 0x7f68ec19f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:47.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.284+0000 7f68f1800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec19fb00 con 0x7f68ec103b30 2024-09-13T18:01:47.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.284+0000 7f68f1800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec19fc70 con 0x7f68ec103170 2024-09-13T18:01:47.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.284+0000 7f68f1800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ec19fe30 con 0x7f68ec101f80 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eb400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 0x7f68ec19f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eaa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68ec101f80 0x7f68ec198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eb400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 0x7f68ec19f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:54302/0 (socket says 172.21.15.27:54302) 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eb400640 1 -- 172.21.15.27:0/831388106 learned_addr learned my addr 172.21.15.27:0/831388106 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68ea000640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68ec103170 0x7f68ec198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eb400640 1 -- 172.21.15.27:0/831388106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68ec101f80 msgr2=0x7f68ec198010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eb400640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68ec101f80 0x7f68ec198010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eb400640 1 -- 172.21.15.27:0/831388106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68ec103170 msgr2=0x7f68ec198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eb400640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68ec103170 0x7f68ec198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eb400640 1 -- 172.21.15.27:0/831388106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e4009900 con 0x7f68ec103b30 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68ea000640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68ec103170 0x7f68ec198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:01:47.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.285+0000 7f68eb400640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 0x7f68ec19f5c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68e402ade0 tx=0x7f68e4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.286+0000 7f68e3400640 1 -- 172.21.15.27:0/831388106 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e4031450 con 0x7f68ec103b30 2024-09-13T18:01:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.286+0000 7f68e3400640 1 -- 172.21.15.27:0/831388106 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f68e4040070 con 0x7f68ec103b30 2024-09-13T18:01:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.286+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ec1a00b0 con 0x7f68ec103b30 2024-09-13T18:01:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.286+0000 7f68e3400640 1 -- 172.21.15.27:0/831388106 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e40308b0 con 0x7f68ec103b30 2024-09-13T18:01:47.289 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.286+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ec1a0610 con 0x7f68ec103b30 2024-09-13T18:01:47.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.287+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ec1093c0 con 0x7f68ec103b30 2024-09-13T18:01:47.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.289+0000 7f68e3400640 1 -- 172.21.15.27:0/831388106 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f68e4042030 con 0x7f68ec103b30 2024-09-13T18:01:47.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.291+0000 7f68e3400640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68d00a1110 0x7f68d00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:47.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.291+0000 7f68e3400640 1 -- 172.21.15.27:0/831388106 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f68e40edce0 con 0x7f68ec103b30 2024-09-13T18:01:47.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.291+0000 7f68eaa00640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68d00a1110 0x7f68d00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:47.293 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.292+0000 7f68eaa00640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68d00a1110 0x7f68d00a35d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f68ec102fd0 tx=0x7f68dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:47.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.295+0000 7f68e3400640 1 -- 172.21.15.27:0/831388106 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f68e40b75c0 con 0x7f68ec103b30 2024-09-13T18:01:47.516 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:47.514+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f68ec10d9d0 con 0x7f68ec103b30 2024-09-13T18:01:48.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:48 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] up:active 2024-09-13T18:01:48.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:48 smithi027 ceph-mon[30611]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:01:48.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:48 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/441222832' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:48.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:48 smithi027 ceph-mon[30611]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T18:01:48.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:48 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/831388106' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T18:01:48.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.334+0000 7f68e3400640 1 -- 172.21.15.27:0/831388106 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f68e40babe0 con 0x7f68ec103b30 2024-09-13T18:01:48.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68d00a1110 msgr2=0x7f68d00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:48.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68d00a1110 0x7f68d00a35d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f68ec102fd0 tx=0x7f68dc005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:48.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 msgr2=0x7f68ec19f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:48.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 0x7f68ec19f5c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f68e402ade0 tx=0x7f68e4003ba0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 shutdown_connections 2024-09-13T18:01:48.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68d00a1110 0x7f68d00a35d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f68ec103b30 0x7f68ec19f5c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68ec103170 0x7f68ec198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 --2- 172.21.15.27:0/831388106 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68ec101f80 0x7f68ec198010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 >> 172.21.15.27:0/831388106 conn(0x7f68ec0fd700 msgr2=0x7f68ec106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:48.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 shutdown_connections 2024-09-13T18:01:48.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.337+0000 7f68f1800640 1 -- 172.21.15.27:0/831388106 wait complete. 2024-09-13T18:01:48.356 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-13T18:01:48.357 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-09-13T18:01:48.452 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:48 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] up:active 2024-09-13T18:01:48.452 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:48 smithi143 ceph-mon[38210]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:01:48.452 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:48 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/441222832' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:48.452 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:48 smithi143 ceph-mon[38210]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T18:01:48.452 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:48 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/831388106' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T18:01:48.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:48 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] up:active 2024-09-13T18:01:48.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:48 smithi122 ceph-mon[35310]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:01:48.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:48 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/441222832' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:48.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:48 smithi122 ceph-mon[35310]: osdmap e86: 12 total, 12 up, 12 in 2024-09-13T18:01:48.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:48 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/831388106' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-13T18:01:48.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.523+0000 7fa545c00640 1 -- 172.21.15.27:0/3979759100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5400744f0 msgr2=0x7fa540072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:48.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.523+0000 7fa545c00640 1 --2- 172.21.15.27:0/3979759100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5400744f0 0x7fa540072940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa530009900 tx=0x7fa53002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.523+0000 7fa545c00640 1 -- 172.21.15.27:0/3979759100 shutdown_connections 2024-09-13T18:01:48.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.523+0000 7fa545c00640 1 --2- 172.21.15.27:0/3979759100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa54010c2b0 0x7fa54010e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.525 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.523+0000 7fa545c00640 1 --2- 172.21.15.27:0/3979759100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa540072f10 0x7fa540073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.523+0000 7fa545c00640 1 --2- 172.21.15.27:0/3979759100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa5400744f0 0x7fa540072940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.523+0000 7fa545c00640 1 -- 172.21.15.27:0/3979759100 >> 172.21.15.27:0/3979759100 conn(0x7fa5400fb440 msgr2=0x7fa5400fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:48.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.523+0000 7fa545c00640 1 -- 172.21.15.27:0/3979759100 shutdown_connections 2024-09-13T18:01:48.526 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.523+0000 7fa545c00640 1 -- 172.21.15.27:0/3979759100 wait complete. 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.524+0000 7fa545c00640 1 Processor -- start 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.524+0000 7fa545c00640 1 -- start start 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa545c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa540072f10 0x7fa54019c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa545c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5400744f0 0x7fa54019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa545c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa54010c2b0 0x7fa5401a38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa545c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401a3e20 con 0x7fa54010c2b0 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa545c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401a3f90 con 0x7fa5400744f0 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa545c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401a4150 con 0x7fa540072f10 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa53fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa540072f10 0x7fa54019c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa53fe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa540072f10 0x7fa54019c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:33088/0 (socket says 172.21.15.27:33088) 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa53fe00640 1 -- 172.21.15.27:0/1604813445 learned_addr learned my addr 172.21.15.27:0/1604813445 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:48.528 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa545200640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa54010c2b0 0x7fa5401a38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa53f400640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5400744f0 0x7fa54019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa53fe00640 1 -- 172.21.15.27:0/1604813445 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5400744f0 msgr2=0x7fa54019c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa53fe00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5400744f0 0x7fa54019c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa53fe00640 1 -- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa54010c2b0 msgr2=0x7fa5401a38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa53fe00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa54010c2b0 0x7fa5401a38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.525+0000 7fa53fe00640 1 -- 172.21.15.27:0/1604813445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa530009560 con 0x7fa540072f10 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.526+0000 7fa53fe00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa540072f10 0x7fa54019c330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa530031510 tx=0x7fa530004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.526+0000 7fa53cc00640 1 -- 172.21.15.27:0/1604813445 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530005000 con 0x7fa540072f10 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.526+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5401a43d0 con 0x7fa540072f10 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.526+0000 7fa53cc00640 1 -- 172.21.15.27:0/1604813445 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa5300046c0 con 0x7fa540072f10 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.526+0000 7fa53cc00640 1 -- 172.21.15.27:0/1604813445 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530003a10 con 0x7fa540072f10 2024-09-13T18:01:48.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.526+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5401a4880 con 0x7fa540072f10 2024-09-13T18:01:48.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.527+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa540101c50 con 0x7fa540072f10 2024-09-13T18:01:48.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.529+0000 7fa53cc00640 1 -- 172.21.15.27:0/1604813445 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa530004bc0 con 0x7fa540072f10 2024-09-13T18:01:48.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.530+0000 7fa53cc00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa5240a1090 0x7fa5240a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:48.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.530+0000 7fa53cc00640 1 -- 172.21.15.27:0/1604813445 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa5300ed6e0 con 0x7fa540072f10 2024-09-13T18:01:48.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.531+0000 7fa53f400640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa5240a1090 0x7fa5240a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:48.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.531+0000 7fa53f400640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa5240a1090 0x7fa5240a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa54019d840 tx=0x7fa52c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:48.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.532+0000 7fa53cc00640 1 -- 172.21.15.27:0/1604813445 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa5300b7040 con 0x7fa540072f10 2024-09-13T18:01:48.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:48.749+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7fa540111cf0 con 0x7fa540072f10 2024-09-13T18:01:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:49 smithi027 ceph-mon[30611]: pgmap v292: 97 pgs: 59 unknown, 38 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-09-13T18:01:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:49 smithi027 ceph-mon[30611]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T18:01:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:49 smithi027 ceph-mon[30611]: Cluster is now healthy 2024-09-13T18:01:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:49 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/831388106' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T18:01:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:49 smithi027 ceph-mon[30611]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:01:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:49 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1604813445' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-13T18:01:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:49 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-13T18:01:49.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.339+0000 7fa53cc00640 1 -- 172.21.15.27:0/1604813445 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v17) v1 ==== 105+0+0 (secure 0 0 0) 0x7fa5300350b0 con 0x7fa540072f10 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa5240a1090 msgr2=0x7fa5240a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa5240a1090 0x7fa5240a3550 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa54019d840 tx=0x7fa52c005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa540072f10 msgr2=0x7fa54019c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa540072f10 0x7fa54019c330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa530031510 tx=0x7fa530004270 comp rx=0 tx=0).stop 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 shutdown_connections 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa5240a1090 0x7fa5240a3550 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa54010c2b0 0x7fa5401a38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa5400744f0 0x7fa54019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 --2- 172.21.15.27:0/1604813445 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa540072f10 0x7fa54019c330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 >> 172.21.15.27:0/1604813445 conn(0x7fa5400fb440 msgr2=0x7fa5400fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:49.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 shutdown_connections 2024-09-13T18:01:49.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.342+0000 7fa545c00640 1 -- 172.21.15.27:0/1604813445 wait complete. 2024-09-13T18:01:49.368 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-09-13T18:01:49.407 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:49 smithi143 ceph-mon[38210]: pgmap v292: 97 pgs: 59 unknown, 38 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-09-13T18:01:49.407 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:49 smithi143 ceph-mon[38210]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T18:01:49.407 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:49 smithi143 ceph-mon[38210]: Cluster is now healthy 2024-09-13T18:01:49.407 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:49 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/831388106' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T18:01:49.408 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:49 smithi143 ceph-mon[38210]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:01:49.408 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:49 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1604813445' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-13T18:01:49.408 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:49 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-13T18:01:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:49 smithi122 ceph-mon[35310]: pgmap v292: 97 pgs: 59 unknown, 38 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-09-13T18:01:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:49 smithi122 ceph-mon[35310]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-13T18:01:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:49 smithi122 ceph-mon[35310]: Cluster is now healthy 2024-09-13T18:01:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:49 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/831388106' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-13T18:01:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:49 smithi122 ceph-mon[35310]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:01:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:49 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1604813445' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-13T18:01:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:49 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-13T18:01:49.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.533+0000 7f7f9d800640 1 -- 172.21.15.27:0/2552680611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f98103a40 msgr2=0x7f7f9810a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:49.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.533+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2552680611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f98103a40 0x7f7f9810a360 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009be0 tx=0x7f7f9002a6c0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.533+0000 7f7f9d800640 1 -- 172.21.15.27:0/2552680611 shutdown_connections 2024-09-13T18:01:49.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.533+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2552680611 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f98103a40 0x7f7f9810a360 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.533+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2552680611 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f98103080 0x7f7f98103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.533+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2552680611 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f98101ea0 0x7f7f981022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.533+0000 7f7f9d800640 1 -- 172.21.15.27:0/2552680611 >> 172.21.15.27:0/2552680611 conn(0x7f7f980fd670 msgr2=0x7f7f980ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:49.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.533+0000 7f7f9d800640 1 -- 172.21.15.27:0/2552680611 shutdown_connections 2024-09-13T18:01:49.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.534+0000 7f7f9d800640 1 -- 172.21.15.27:0/2552680611 wait complete. 2024-09-13T18:01:49.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.534+0000 7f7f9d800640 1 Processor -- start 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f9d800640 1 -- start start 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f9d800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f98101ea0 0x7f7f98197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f9d800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f98103080 0x7f7f98198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f9d800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f98103a40 0x7f7f9819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f9d800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9819fa20 con 0x7f7f98103a40 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f9d800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9819fb90 con 0x7f7f98103080 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f9d800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9819fd50 con 0x7f7f98101ea0 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f8f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f98103080 0x7f7f98198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f8f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f98103080 0x7f7f98198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:50602/0 (socket says 172.21.15.27:50602) 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f8f400640 1 -- 172.21.15.27:0/2200008168 learned_addr learned my addr 172.21.15.27:0/2200008168 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f97e00640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f98101ea0 0x7f7f98197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:49.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f9ce00640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f98103a40 0x7f7f9819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f8f400640 1 -- 172.21.15.27:0/2200008168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f98101ea0 msgr2=0x7f7f98197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f8f400640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f98101ea0 0x7f7f98197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f8f400640 1 -- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f98103a40 msgr2=0x7f7f9819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.535+0000 7f7f8f400640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f98103a40 0x7f7f9819f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.536+0000 7f7f8f400640 1 -- 172.21.15.27:0/2200008168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f88009560 con 0x7f7f98103080 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.536+0000 7f7f9ce00640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f98103a40 0x7f7f9819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.536+0000 7f7f8f400640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f98103080 0x7f7f98198470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000e9f0 tx=0x7f7f8000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.536+0000 7f7f95600640 1 -- 172.21.15.27:0/2200008168 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80009700 con 0x7f7f98103080 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.536+0000 7f7f95600640 1 -- 172.21.15.27:0/2200008168 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f8000cd80 con 0x7f7f98103080 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.536+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f90009840 con 0x7f7f98103080 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.536+0000 7f7f95600640 1 -- 172.21.15.27:0/2200008168 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80018920 con 0x7f7f98103080 2024-09-13T18:01:49.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.536+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f981a0320 con 0x7f7f98103080 2024-09-13T18:01:49.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.537+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f981093b0 con 0x7f7f98103080 2024-09-13T18:01:49.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.539+0000 7f7f95600640 1 -- 172.21.15.27:0/2200008168 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7f80018a80 con 0x7f7f98103080 2024-09-13T18:01:49.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.541+0000 7f7f95600640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7f7c0a1090 0x7f7f7c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:49.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.541+0000 7f7f95600640 1 -- 172.21.15.27:0/2200008168 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7f80014070 con 0x7f7f98103080 2024-09-13T18:01:49.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.541+0000 7f7f97e00640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7f7c0a1090 0x7f7f7c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:49.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.541+0000 7f7f97e00640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7f7c0a1090 0x7f7f7c0a3550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009530 tx=0x7f7f88009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:49.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.542+0000 7f7f95600640 1 -- 172.21.15.27:0/2200008168 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7f800968d0 con 0x7f7f98103080 2024-09-13T18:01:49.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:49.760+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f7f9810d8f0 con 0x7f7f98103080 2024-09-13T18:01:50.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:50 smithi027 ceph-mon[30611]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T18:01:50.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:50 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-13T18:01:50.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:50 smithi027 ceph-mon[30611]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:01:50.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:50 smithi027 ceph-mon[30611]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:01:50.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:50 smithi027 ceph-mon[30611]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-13T18:01:50.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:50 smithi027 ceph-mon[30611]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-13T18:01:50.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:50 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2200008168' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:01:50.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:50 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:01:50.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.354+0000 7f7f95600640 1 -- 172.21.15.27:0/2200008168 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) v1 ==== 121+0+0 (secure 0 0 0) 0x7f7f80099ef0 con 0x7f7f98103080 2024-09-13T18:01:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7f7c0a1090 msgr2=0x7f7f7c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7f7c0a1090 0x7f7f7c0a3550 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009530 tx=0x7f7f88009260 comp rx=0 tx=0).stop 2024-09-13T18:01:50.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f98103080 msgr2=0x7f7f98198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f98103080 0x7f7f98198470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f8000e9f0 tx=0x7f7f8000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 shutdown_connections 2024-09-13T18:01:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7f7c0a1090 0x7f7f7c0a3550 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7f98103a40 0x7f7f9819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7f98103080 0x7f7f98198470 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 --2- 172.21.15.27:0/2200008168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7f98101ea0 0x7f7f98197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 >> 172.21.15.27:0/2200008168 conn(0x7f7f980fd670 msgr2=0x7f7f98106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:50.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 shutdown_connections 2024-09-13T18:01:50.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.357+0000 7f7f9d800640 1 -- 172.21.15.27:0/2200008168 wait complete. 2024-09-13T18:01:50.382 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-13T18:01:50.464 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:50 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b[65606]: 2024-09-13T18:01:50.226+0000 7f5fc32cf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:01:50.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:50 smithi122 ceph-mon[35310]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T18:01:50.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:50 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-13T18:01:50.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:50 smithi122 ceph-mon[35310]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:01:50.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:50 smithi122 ceph-mon[35310]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:01:50.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:50 smithi122 ceph-mon[35310]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-13T18:01:50.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:50 smithi122 ceph-mon[35310]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-13T18:01:50.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:50 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2200008168' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:01:50.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:50 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:01:50.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:50 smithi143 ceph-mon[38210]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T18:01:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:50 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-13T18:01:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:50 smithi143 ceph-mon[38210]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T18:01:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:50 smithi143 ceph-mon[38210]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-13T18:01:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:50 smithi143 ceph-mon[38210]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2024-09-13T18:01:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:50 smithi143 ceph-mon[38210]: daemon mds.a is now active in filesystem cephfs as rank 1 2024-09-13T18:01:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:50 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2200008168' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:01:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:50 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T18:01:50.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.545+0000 7f9b8ce00640 1 -- 172.21.15.27:0/3121852185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b880fe5f0 msgr2=0x7f9b880fe9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:50.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.545+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/3121852185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b880fe5f0 0x7f9b880fe9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009900 tx=0x7f9b7802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.545+0000 7f9b8ce00640 1 -- 172.21.15.27:0/3121852185 shutdown_connections 2024-09-13T18:01:50.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.545+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/3121852185 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b880ff8d0 0x7f9b880ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.545+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/3121852185 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b880fef30 0x7f9b880ff390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.545+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/3121852185 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b880fe5f0 0x7f9b880fe9f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.545+0000 7f9b8ce00640 1 -- 172.21.15.27:0/3121852185 >> 172.21.15.27:0/3121852185 conn(0x7f9b880fa3e0 msgr2=0x7f9b880fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:50.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.545+0000 7f9b8ce00640 1 -- 172.21.15.27:0/3121852185 shutdown_connections 2024-09-13T18:01:50.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.545+0000 7f9b8ce00640 1 -- 172.21.15.27:0/3121852185 wait complete. 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.546+0000 7f9b8ce00640 1 Processor -- start 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.546+0000 7f9b8ce00640 1 -- start start 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b8ce00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b880fe5f0 0x7f9b881980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b8ce00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b880fef30 0x7f9b88198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b8ce00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b880ff8d0 0x7f9b8819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b8ce00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8819fbe0 con 0x7f9b880fef30 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b8ce00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8819fd50 con 0x7f9b880ff8d0 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b8ce00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8819ff10 con 0x7f9b880fe5f0 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b880fef30 0x7f9b88198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b880fe5f0 0x7f9b881980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:50.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b880fe5f0 0x7f9b881980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:40108/0 (socket says 172.21.15.27:40108) 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85e00640 1 -- 172.21.15.27:0/2249168935 learned_addr learned my addr 172.21.15.27:0/2249168935 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b86800640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b880ff8d0 0x7f9b8819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85400640 1 -- 172.21.15.27:0/2249168935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b880fe5f0 msgr2=0x7f9b881980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85400640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b880fe5f0 0x7f9b881980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85400640 1 -- 172.21.15.27:0/2249168935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b880ff8d0 msgr2=0x7f9b8819f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85400640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b880ff8d0 0x7f9b8819f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85400640 1 -- 172.21.15.27:0/2249168935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78009560 con 0x7f9b880fef30 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b86800640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b880ff8d0 0x7f9b8819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.547+0000 7f9b85e00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b880fe5f0 0x7f9b881980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.548+0000 7f9b85400640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b880fef30 0x7f9b88198630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400d6d0 tx=0x7f9b7400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.548+0000 7f9b7ea00640 1 -- 172.21.15.27:0/2249168935 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74005220 con 0x7f9b880fef30 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.548+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b881a01f0 con 0x7f9b880fef30 2024-09-13T18:01:50.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.548+0000 7f9b7ea00640 1 -- 172.21.15.27:0/2249168935 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9b74009d00 con 0x7f9b880fef30 2024-09-13T18:01:50.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.548+0000 7f9b7ea00640 1 -- 172.21.15.27:0/2249168935 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74004dd0 con 0x7f9b880fef30 2024-09-13T18:01:50.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.548+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b881a0750 con 0x7f9b880fef30 2024-09-13T18:01:50.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.549+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b88109590 con 0x7f9b880fef30 2024-09-13T18:01:50.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.551+0000 7f9b7ea00640 1 -- 172.21.15.27:0/2249168935 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9b74009820 con 0x7f9b880fef30 2024-09-13T18:01:50.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.552+0000 7f9b7ea00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9b6c0a1190 0x7f9b6c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:50.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.552+0000 7f9b7ea00640 1 -- 172.21.15.27:0/2249168935 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9b740cc320 con 0x7f9b880fef30 2024-09-13T18:01:50.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.553+0000 7f9b85e00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9b6c0a1190 0x7f9b6c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:50.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.553+0000 7f9b85e00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9b6c0a1190 0x7f9b6c0a3650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b78005ec0 tx=0x7f9b78005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:50.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.556+0000 7f9b7ea00640 1 -- 172.21.15.27:0/2249168935 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9b74095b60 con 0x7f9b880fef30 2024-09-13T18:01:50.776 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:50.774+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f9b8810d9b0 con 0x7f9b880fef30 2024-09-13T18:01:51.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.361+0000 7f9b7ea00640 1 -- 172.21.15.27:0/2249168935 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f9b74099180 con 0x7f9b880fef30 2024-09-13T18:01:51.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9b6c0a1190 msgr2=0x7f9b6c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:51.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9b6c0a1190 0x7f9b6c0a3650 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9b78005ec0 tx=0x7f9b78005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:51.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b880fef30 msgr2=0x7f9b88198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:51.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b880fef30 0x7f9b88198630 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400d6d0 tx=0x7f9b7400db90 comp rx=0 tx=0).stop 2024-09-13T18:01:51.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 shutdown_connections 2024-09-13T18:01:51.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9b6c0a1190 0x7f9b6c0a3650 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9b880ff8d0 0x7f9b8819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9b880fef30 0x7f9b88198630 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 --2- 172.21.15.27:0/2249168935 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9b880fe5f0 0x7f9b881980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 >> 172.21.15.27:0/2249168935 conn(0x7f9b880fa3e0 msgr2=0x7f9b880fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:51.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 shutdown_connections 2024-09-13T18:01:51.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.364+0000 7f9b8ce00640 1 -- 172.21.15.27:0/2249168935 wait complete. 2024-09-13T18:01:51.388 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-13T18:01:51.388 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-09-13T18:01:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.553+0000 7fd245000640 1 -- 172.21.15.27:0/1110898456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240074e70 msgr2=0x7fd240075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.553+0000 7fd245000640 1 --2- 172.21.15.27:0/1110898456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240074e70 0x7fd240075270 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd230009900 tx=0x7fd23002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.553+0000 7fd245000640 1 -- 172.21.15.27:0/1110898456 shutdown_connections 2024-09-13T18:01:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.553+0000 7fd245000640 1 --2- 172.21.15.27:0/1110898456 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd240076a50 0x7fd2400772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.553+0000 7fd245000640 1 --2- 172.21.15.27:0/1110898456 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2400760b0 0x7fd240076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.553+0000 7fd245000640 1 --2- 172.21.15.27:0/1110898456 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240074e70 0x7fd240075270 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.553+0000 7fd245000640 1 -- 172.21.15.27:0/1110898456 >> 172.21.15.27:0/1110898456 conn(0x7fd2400fd700 msgr2=0x7fd2400ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.553+0000 7fd245000640 1 -- 172.21.15.27:0/1110898456 shutdown_connections 2024-09-13T18:01:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.553+0000 7fd245000640 1 -- 172.21.15.27:0/1110898456 wait complete. 2024-09-13T18:01:51.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.554+0000 7fd245000640 1 Processor -- start 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.554+0000 7fd245000640 1 -- start start 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.554+0000 7fd245000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd240074e70 0x7fd24019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.554+0000 7fd245000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2400760b0 0x7fd24019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.554+0000 7fd245000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240076a50 0x7fd2401a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.554+0000 7fd245000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401a3ff0 con 0x7fd240076a50 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.554+0000 7fd245000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401a4160 con 0x7fd2400760b0 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.554+0000 7fd245000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401a4320 con 0x7fd240074e70 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.554+0000 7fd23e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240076a50 0x7fd2401a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd23e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240076a50 0x7fd2401a3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51008/0 (socket says 172.21.15.27:51008) 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd23e800640 1 -- 172.21.15.27:0/2610892850 learned_addr learned my addr 172.21.15.27:0/2610892850 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd235400640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2400760b0 0x7fd24019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd23de00640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd240074e70 0x7fd24019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd23e800640 1 -- 172.21.15.27:0/2610892850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd240074e70 msgr2=0x7fd24019c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:51.558 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd23e800640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd240074e70 0x7fd24019c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd23e800640 1 -- 172.21.15.27:0/2610892850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2400760b0 msgr2=0x7fd24019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd23e800640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2400760b0 0x7fd24019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd23e800640 1 -- 172.21.15.27:0/2610892850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd230009560 con 0x7fd240076a50 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd23e800640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240076a50 0x7fd2401a3ab0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd23800b970 tx=0x7fd23800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd237400640 1 -- 172.21.15.27:0/2610892850 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800cb40 con 0x7fd240076a50 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2401a4600 con 0x7fd240076a50 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.555+0000 7fd237400640 1 -- 172.21.15.27:0/2610892850 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd23800cca0 con 0x7fd240076a50 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.556+0000 7fd237400640 1 -- 172.21.15.27:0/2610892850 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238007780 con 0x7fd240076a50 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.556+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2401a4b10 con 0x7fd240076a50 2024-09-13T18:01:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.557+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd24010e8f0 con 0x7fd240076a50 2024-09-13T18:01:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.558+0000 7fd237400640 1 -- 172.21.15.27:0/2610892850 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd238014440 con 0x7fd240076a50 2024-09-13T18:01:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.560+0000 7fd237400640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2240a1110 0x7fd2240a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:51.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.560+0000 7fd237400640 1 -- 172.21.15.27:0/2610892850 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd2380cc080 con 0x7fd240076a50 2024-09-13T18:01:51.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.560+0000 7fd23de00640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2240a1110 0x7fd2240a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:51.562 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.561+0000 7fd23de00640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2240a1110 0x7fd2240a35d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd230005ab0 tx=0x7fd230005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.563+0000 7fd237400640 1 -- 172.21.15.27:0/2610892850 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fd2380ffe20 con 0x7fd240076a50 2024-09-13T18:01:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:51 smithi122 ceph-mon[35310]: pgmap v293: 97 pgs: 8 unknown, 89 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 9 op/s 2024-09-13T18:01:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:51 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] up:active 2024-09-13T18:01:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:51 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T18:01:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:51 smithi122 ceph-mon[35310]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T18:01:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:51 smithi122 ceph-mon[35310]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-13T18:01:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:51 smithi122 ceph-mon[35310]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2024-09-13T18:01:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:51 smithi122 ceph-mon[35310]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-13T18:01:51.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:51 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2249168935' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T18:01:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:51.769+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2400608f0 con 0x7fd2240a1110 2024-09-13T18:01:51.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:51 smithi143 ceph-mon[38210]: pgmap v293: 97 pgs: 8 unknown, 89 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 9 op/s 2024-09-13T18:01:51.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:51 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] up:active 2024-09-13T18:01:51.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:51 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T18:01:51.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:51 smithi143 ceph-mon[38210]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T18:01:51.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:51 smithi143 ceph-mon[38210]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-13T18:01:51.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:51 smithi143 ceph-mon[38210]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2024-09-13T18:01:51.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:51 smithi143 ceph-mon[38210]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-13T18:01:51.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:51 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2249168935' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T18:01:51.779 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-mon[30611]: pgmap v293: 97 pgs: 8 unknown, 89 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s wr, 9 op/s 2024-09-13T18:01:51.779 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] up:active 2024-09-13T18:01:51.779 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T18:01:51.779 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-mon[30611]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-13T18:01:51.779 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-mon[30611]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 10 up:standby 2024-09-13T18:01:51.779 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-mon[30611]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:creating} 9 up:standby 2024-09-13T18:01:51.779 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-mon[30611]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-13T18:01:51.779 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2249168935' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-13T18:01:52.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:01:51.775+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:01:52.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:01:51.775+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:01:52.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:01:51.775+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:01:52.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:01:51.775+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:01:52.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:01:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:01:51.775+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:01:52.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.064+0000 7fd237400640 1 -- 172.21.15.27:0/2610892850 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd2400608f0 con 0x7fd2240a1110 2024-09-13T18:01:52.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2240a1110 msgr2=0x7fd2240a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2240a1110 0x7fd2240a35d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd230005ab0 tx=0x7fd230005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:52.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240076a50 msgr2=0x7fd2401a3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240076a50 0x7fd2401a3ab0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd23800b970 tx=0x7fd23800be30 comp rx=0 tx=0).stop 2024-09-13T18:01:52.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 shutdown_connections 2024-09-13T18:01:52.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fd2240a1110 0x7fd2240a35d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fd240076a50 0x7fd2401a3ab0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fd2400760b0 0x7fd24019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 --2- 172.21.15.27:0/2610892850 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fd240074e70 0x7fd24019c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 >> 172.21.15.27:0/2610892850 conn(0x7fd2400fd700 msgr2=0x7fd2400ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:52.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 shutdown_connections 2024-09-13T18:01:52.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.066+0000 7fd245000640 1 -- 172.21.15.27:0/2610892850 wait complete. 2024-09-13T18:01:52.085 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-13T18:01:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.248+0000 7ff681a00640 1 -- 172.21.15.27:0/4089557426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c105a50 msgr2=0x7ff67c107ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.248+0000 7ff681a00640 1 --2- 172.21.15.27:0/4089557426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c105a50 0x7ff67c107ec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff674009ca0 tx=0x7ff67402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.248+0000 7ff681a00640 1 -- 172.21.15.27:0/4089557426 shutdown_connections 2024-09-13T18:01:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.248+0000 7ff681a00640 1 --2- 172.21.15.27:0/4089557426 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c105a50 0x7ff67c107ec0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.248+0000 7ff681a00640 1 --2- 172.21.15.27:0/4089557426 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff67c103120 0x7ff67c105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.248+0000 7ff681a00640 1 --2- 172.21.15.27:0/4089557426 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1007f0 0x7ff67c102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.248+0000 7ff681a00640 1 -- 172.21.15.27:0/4089557426 >> 172.21.15.27:0/4089557426 conn(0x7ff67c0fa3d0 msgr2=0x7ff67c0fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.248+0000 7ff681a00640 1 -- 172.21.15.27:0/4089557426 shutdown_connections 2024-09-13T18:01:52.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.249+0000 7ff681a00640 1 -- 172.21.15.27:0/4089557426 wait complete. 2024-09-13T18:01:52.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.249+0000 7ff681a00640 1 Processor -- start 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff681a00640 1 -- start start 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff681a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1007f0 0x7ff67c195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff681a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c103120 0x7ff67c1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff681a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff67c105a50 0x7ff67c19d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff681a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c19d9a0 con 0x7ff67c103120 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff681a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c19db10 con 0x7ff67c1007f0 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff681a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c19dcd0 con 0x7ff67c105a50 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff67aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1007f0 0x7ff67c195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff67a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c103120 0x7ff67c1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff67aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1007f0 0x7ff67c195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:39572/0 (socket says 172.21.15.27:39572) 2024-09-13T18:01:52.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff67a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c103120 0x7ff67c1963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51046/0 (socket says 172.21.15.27:51046) 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff67aa00640 1 -- 172.21.15.27:0/2665037502 learned_addr learned my addr 172.21.15.27:0/2665037502 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.250+0000 7ff67b400640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff67c105a50 0x7ff67c19d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff67a000640 1 -- 172.21.15.27:0/2665037502 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff67c105a50 msgr2=0x7ff67c19d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff67a000640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff67c105a50 0x7ff67c19d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff67a000640 1 -- 172.21.15.27:0/2665037502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1007f0 msgr2=0x7ff67c195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff67a000640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1007f0 0x7ff67c195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff67a000640 1 -- 172.21.15.27:0/2665037502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674009900 con 0x7ff67c103120 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff67aa00640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1007f0 0x7ff67c195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff67a000640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c103120 0x7ff67c1963f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff66800e9c0 tx=0x7ff66800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff673400640 1 -- 172.21.15.27:0/2665037502 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66800ccc0 con 0x7ff67c103120 2024-09-13T18:01:52.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff673400640 1 -- 172.21.15.27:0/2665037502 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff66800ce20 con 0x7ff67c103120 2024-09-13T18:01:52.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c19dfb0 con 0x7ff67c103120 2024-09-13T18:01:52.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff673400640 1 -- 172.21.15.27:0/2665037502 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668018880 con 0x7ff67c103120 2024-09-13T18:01:52.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.251+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c19e430 con 0x7ff67c103120 2024-09-13T18:01:52.256 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.253+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c0fbec0 con 0x7ff67c103120 2024-09-13T18:01:52.257 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.255+0000 7ff673400640 1 -- 172.21.15.27:0/2665037502 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff6680189e0 con 0x7ff67c103120 2024-09-13T18:01:52.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.256+0000 7ff673400640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6600a1090 0x7ff6600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.257+0000 7ff673400640 1 -- 172.21.15.27:0/2665037502 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff668014070 con 0x7ff67c103120 2024-09-13T18:01:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.257+0000 7ff67aa00640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6600a1090 0x7ff6600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:52.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.257+0000 7ff67aa00640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6600a1090 0x7ff6600a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff66c011550 tx=0x7ff66c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:52.260 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.258+0000 7ff673400640 1 -- 172.21.15.27:0/2665037502 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff668096870 con 0x7ff67c103120 2024-09-13T18:01:52.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.470+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7ff67c0608f0 con 0x7ff6600a1090 2024-09-13T18:01:52.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.497+0000 7ff673400640 1 -- 172.21.15.27:0/2665037502 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff67c0608f0 con 0x7ff6600a1090 2024-09-13T18:01:52.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6600a1090 msgr2=0x7ff6600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6600a1090 0x7ff6600a3550 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff66c011550 tx=0x7ff66c005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c103120 msgr2=0x7ff67c1963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c103120 0x7ff67c1963f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff66800e9c0 tx=0x7ff66800ee80 comp rx=0 tx=0).stop 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 shutdown_connections 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff6600a1090 0x7ff6600a3550 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff67c105a50 0x7ff67c19d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff67c103120 0x7ff67c1963f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 --2- 172.21.15.27:0/2665037502 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff67c1007f0 0x7ff67c195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 >> 172.21.15.27:0/2665037502 conn(0x7ff67c0fa3d0 msgr2=0x7ff67c1010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 shutdown_connections 2024-09-13T18:01:52.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.500+0000 7ff681a00640 1 -- 172.21.15.27:0/2665037502 wait complete. 2024-09-13T18:01:52.519 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-13T18:01:52.644 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] up:active 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2249168935' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] up:active 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: Cluster is now healthy 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 4 up:standby-replay 4 up:standby 2024-09-13T18:01:52.645 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-13T18:01:52.646 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:52 smithi122 ceph-mon[35310]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-13T18:01:52.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.682+0000 7f95b4800640 1 -- 172.21.15.27:0/127988071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 msgr2=0x7f95ac1035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.682+0000 7f95b4800640 1 --2- 172.21.15.27:0/127988071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 0x7f95ac1035f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f959c009860 tx=0x7f959c02a340 comp rx=0 tx=0).stop 2024-09-13T18:01:52.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.682+0000 7f95b4800640 1 -- 172.21.15.27:0/127988071 shutdown_connections 2024-09-13T18:01:52.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.682+0000 7f95b4800640 1 --2- 172.21.15.27:0/127988071 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95ac103b30 0x7f95ac10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.682+0000 7f95b4800640 1 --2- 172.21.15.27:0/127988071 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 0x7f95ac1035f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.682+0000 7f95b4800640 1 --2- 172.21.15.27:0/127988071 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95ac101f80 0x7f95ac102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.682+0000 7f95b4800640 1 -- 172.21.15.27:0/127988071 >> 172.21.15.27:0/127988071 conn(0x7f95ac0fd700 msgr2=0x7f95ac0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:52.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.682+0000 7f95b4800640 1 -- 172.21.15.27:0/127988071 shutdown_connections 2024-09-13T18:01:52.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.682+0000 7f95b4800640 1 -- 172.21.15.27:0/127988071 wait complete. 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.683+0000 7f95b4800640 1 Processor -- start 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.683+0000 7f95b4800640 1 -- start start 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b4800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95ac101f80 0x7f95ac198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b4800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 0x7f95ac1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b4800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95ac103b30 0x7f95ac19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b4800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac19fb30 con 0x7f95ac103b30 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b4800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac19fca0 con 0x7f95ac103170 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b4800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac19fe60 con 0x7f95ac101f80 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b1400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 0x7f95ac1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b1e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95ac101f80 0x7f95ac198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:52.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b1400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 0x7f95ac1985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:39590/0 (socket says 172.21.15.27:39590) 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b1400640 1 -- 172.21.15.27:0/3966507907 learned_addr learned my addr 172.21.15.27:0/3966507907 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b2800640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95ac103b30 0x7f95ac19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b1400640 1 -- 172.21.15.27:0/3966507907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95ac101f80 msgr2=0x7f95ac198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b1400640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95ac101f80 0x7f95ac198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b1400640 1 -- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95ac103b30 msgr2=0x7f95ac19f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b1400640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95ac103b30 0x7f95ac19f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.684+0000 7f95b1400640 1 -- 172.21.15.27:0/3966507907 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0009560 con 0x7f95ac103170 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.685+0000 7f95b1400640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 0x7f95ac1985d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f959c030590 tx=0x7f959c0326f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.685+0000 7f95a6a00640 1 -- 172.21.15.27:0/3966507907 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c03f070 con 0x7f95ac103170 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.685+0000 7f95a6a00640 1 -- 172.21.15.27:0/3966507907 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f959c030340 con 0x7f95ac103170 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.685+0000 7f95a6a00640 1 -- 172.21.15.27:0/3966507907 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c0046c0 con 0x7f95ac103170 2024-09-13T18:01:52.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.685+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c009490 con 0x7f95ac103170 2024-09-13T18:01:52.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.685+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac1a0350 con 0x7f95ac103170 2024-09-13T18:01:52.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.686+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac1093c0 con 0x7f95ac103170 2024-09-13T18:01:52.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.688+0000 7f95a6a00640 1 -- 172.21.15.27:0/3966507907 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f959c039040 con 0x7f95ac103170 2024-09-13T18:01:52.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.689+0000 7f95a6a00640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95940a1090 0x7f95940a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:52.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.689+0000 7f95a6a00640 1 -- 172.21.15.27:0/3966507907 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f959c0ec610 con 0x7f95ac103170 2024-09-13T18:01:52.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.689+0000 7f95b1e00640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95940a1090 0x7f95940a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:52.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.690+0000 7f95b1e00640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95940a1090 0x7f95940a3550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009530 tx=0x7f95a0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:52.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.693+0000 7f95a6a00640 1 -- 172.21.15.27:0/3966507907 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f959c0b5e50 con 0x7f95ac103170 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] up:active 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2249168935' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] up:active 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T18:01:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: Cluster is now healthy 2024-09-13T18:01:52.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 4 up:standby-replay 4 up:standby 2024-09-13T18:01:52.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-13T18:01:52.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:52 smithi143 ceph-mon[38210]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-13T18:01:52.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] up:active 2024-09-13T18:01:52.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2249168935' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-13T18:01:52.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: daemon mds.i assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-13T18:01:52.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=h=up:active} 9 up:standby 2024-09-13T18:01:52.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:creating} 8 up:standby 2024-09-13T18:01:52.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: pgmap v294: 97 pgs: 97 active+clean; 579 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-13T18:01:52.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: daemon mds.i is now active in filesystem cephfs as rank 3 2024-09-13T18:01:52.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:52.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] up:active 2024-09-13T18:01:52.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-13T18:01:52.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T18:01:52.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: Cluster is now healthy 2024-09-13T18:01:52.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: fsmap cephfs:4 {0=b=up:active,1=a=up:active,2=h=up:active,3=i=up:active} 4 up:standby-replay 4 up:standby 2024-09-13T18:01:52.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: fsmap cephfs:5 4 up:standby-replay 1 up:creating 3 up:standby 4 up:active 2024-09-13T18:01:52.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:52 smithi027 ceph-mon[30611]: daemon mds.l is now active in filesystem cephfs as rank 4 2024-09-13T18:01:52.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.903+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f95ac02c450 con 0x7f95940a1090 2024-09-13T18:01:52.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.908+0000 7f95a6a00640 1 -- 172.21.15.27:0/3966507907 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f95ac02c450 con 0x7f95940a1090 2024-09-13T18:01:52.910 INFO:teuthology.orchestra.run.smithi027.stdout:/volumes/qa/sv_0/1bd3792c-b76c-4741-beb9-c9b1bab3bf46 2024-09-13T18:01:52.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95940a1090 msgr2=0x7f95940a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95940a1090 0x7f95940a3550 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009530 tx=0x7f95a0009260 comp rx=0 tx=0).stop 2024-09-13T18:01:52.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 msgr2=0x7f95ac1985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 0x7f95ac1985d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f959c030590 tx=0x7f959c0326f0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 shutdown_connections 2024-09-13T18:01:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95940a1090 0x7f95940a3550 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95ac103b30 0x7f95ac19f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95ac103170 0x7f95ac1985d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 --2- 172.21.15.27:0/3966507907 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95ac101f80 0x7f95ac198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 >> 172.21.15.27:0/3966507907 conn(0x7f95ac0fd700 msgr2=0x7f95ac106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 shutdown_connections 2024-09-13T18:01:52.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:52.910+0000 7f95b4800640 1 -- 172.21.15.27:0/3966507907 wait complete. 2024-09-13T18:01:52.928 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-13T18:01:53.096 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.094+0000 7f2f84600640 1 -- 172.21.15.27:0/2172726674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7c101fa0 msgr2=0x7f2f7c1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.094+0000 7f2f84600640 1 --2- 172.21.15.27:0/2172726674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7c101fa0 0x7f2f7c1023a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009ca0 tx=0x7f2f7002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.094+0000 7f2f84600640 1 -- 172.21.15.27:0/2172726674 shutdown_connections 2024-09-13T18:01:53.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.094+0000 7f2f84600640 1 --2- 172.21.15.27:0/2172726674 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f7c103b50 0x7f2f7c10a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.094+0000 7f2f84600640 1 --2- 172.21.15.27:0/2172726674 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7c103190 0x7f2f7c103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.094+0000 7f2f84600640 1 --2- 172.21.15.27:0/2172726674 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7c101fa0 0x7f2f7c1023a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.094+0000 7f2f84600640 1 -- 172.21.15.27:0/2172726674 >> 172.21.15.27:0/2172726674 conn(0x7f2f7c0fd700 msgr2=0x7f2f7c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:53.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.094+0000 7f2f84600640 1 -- 172.21.15.27:0/2172726674 shutdown_connections 2024-09-13T18:01:53.097 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.094+0000 7f2f84600640 1 -- 172.21.15.27:0/2172726674 wait complete. 2024-09-13T18:01:53.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.095+0000 7f2f84600640 1 Processor -- start 2024-09-13T18:01:53.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.095+0000 7f2f84600640 1 -- start start 2024-09-13T18:01:53.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.095+0000 7f2f84600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7c101fa0 0x7f2f7c1980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f84600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7c103190 0x7f2f7c198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f84600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f7c103b50 0x7f2f7c19f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f84600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c19fbc0 con 0x7f2f7c103b50 2024-09-13T18:01:53.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f84600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c19fd30 con 0x7f2f7c101fa0 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f84600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c19fef0 con 0x7f2f7c103190 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f81c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7c101fa0 0x7f2f7c1980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f82600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f7c103b50 0x7f2f7c19f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f81c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7c101fa0 0x7f2f7c1980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:39612/0 (socket says 172.21.15.27:39612) 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f81c00640 1 -- 172.21.15.27:0/34104175 learned_addr learned my addr 172.21.15.27:0/34104175 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f81200640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7c103190 0x7f2f7c198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f82600640 1 -- 172.21.15.27:0/34104175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7c103190 msgr2=0x7f2f7c198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f82600640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7c103190 0x7f2f7c198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f82600640 1 -- 172.21.15.27:0/34104175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7c101fa0 msgr2=0x7f2f7c1980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f82600640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7c101fa0 0x7f2f7c1980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f82600640 1 -- 172.21.15.27:0/34104175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70009900 con 0x7f2f7c103b50 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.096+0000 7f2f82600640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f7c103b50 0x7f2f7c19f680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e970 tx=0x7f2f7400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:53.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.097+0000 7f2f7a000640 1 -- 172.21.15.27:0/34104175 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74009620 con 0x7f2f7c103b50 2024-09-13T18:01:53.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.097+0000 7f2f7a000640 1 -- 172.21.15.27:0/34104175 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2f7400ccc0 con 0x7f2f7c103b50 2024-09-13T18:01:53.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.097+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c1a01d0 con 0x7f2f7c103b50 2024-09-13T18:01:53.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.097+0000 7f2f7a000640 1 -- 172.21.15.27:0/34104175 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74004a00 con 0x7f2f7c103b50 2024-09-13T18:01:53.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.097+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c1a0690 con 0x7f2f7c103b50 2024-09-13T18:01:53.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.098+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c109430 con 0x7f2f7c103b50 2024-09-13T18:01:53.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.100+0000 7f2f7a000640 1 -- 172.21.15.27:0/34104175 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2f74005020 con 0x7f2f7c103b50 2024-09-13T18:01:53.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.101+0000 7f2f7a000640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f2f640a1090 0x7f2f640a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.102+0000 7f2f7a000640 1 -- 172.21.15.27:0/34104175 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2f74014070 con 0x7f2f7c103b50 2024-09-13T18:01:53.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.102+0000 7f2f81c00640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f2f640a1090 0x7f2f640a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.104 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.102+0000 7f2f81c00640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f2f640a1090 0x7f2f640a3550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f70031cf0 tx=0x7f2f7002f3d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:53.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.105+0000 7f2f7a000640 1 -- 172.21.15.27:0/34104175 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2f74095ff0 con 0x7f2f7c103b50 2024-09-13T18:01:53.314 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.312+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f7c0608f0 con 0x7f2f640a1090 2024-09-13T18:01:53.336 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.334+0000 7f2f7a000640 1 -- 172.21.15.27:0/34104175 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2f7c0608f0 con 0x7f2f640a1090 2024-09-13T18:01:53.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.336+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f2f640a1090 msgr2=0x7f2f640a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.336+0000 7f2f84600640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f2f640a1090 0x7f2f640a3550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f70031cf0 tx=0x7f2f7002f3d0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.336+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f7c103b50 msgr2=0x7f2f7c19f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.336+0000 7f2f84600640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f7c103b50 0x7f2f7c19f680 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2f7400e970 tx=0x7f2f7400ee30 comp rx=0 tx=0).stop 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.336+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 shutdown_connections 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.336+0000 7f2f84600640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f2f640a1090 0x7f2f640a3550 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.336+0000 7f2f84600640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2f7c103b50 0x7f2f7c19f680 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.336+0000 7f2f84600640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2f7c103190 0x7f2f7c198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.337+0000 7f2f84600640 1 --2- 172.21.15.27:0/34104175 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2f7c101fa0 0x7f2f7c1980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.337+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 >> 172.21.15.27:0/34104175 conn(0x7f2f7c0fd700 msgr2=0x7f2f7c106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.337+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 shutdown_connections 2024-09-13T18:01:53.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.337+0000 7f2f84600640 1 -- 172.21.15.27:0/34104175 wait complete. 2024-09-13T18:01:53.354 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-13T18:01:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.533+0000 7f9c24800640 1 -- 172.21.15.27:0/120998168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c10c2f0 msgr2=0x7f9c1c10e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.533+0000 7f9c24800640 1 --2- 172.21.15.27:0/120998168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c10c2f0 0x7f9c1c10e6e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009be0 tx=0x7f9c1802a6d0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.533+0000 7f9c24800640 1 -- 172.21.15.27:0/120998168 shutdown_connections 2024-09-13T18:01:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.533+0000 7f9c24800640 1 --2- 172.21.15.27:0/120998168 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c10c2f0 0x7f9c1c10e6e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.534+0000 7f9c24800640 1 --2- 172.21.15.27:0/120998168 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1c072f10 0x7f9c1c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.534+0000 7f9c24800640 1 --2- 172.21.15.27:0/120998168 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c1c0744f0 0x7f9c1c072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.534+0000 7f9c24800640 1 -- 172.21.15.27:0/120998168 >> 172.21.15.27:0/120998168 conn(0x7f9c1c0fb480 msgr2=0x7f9c1c0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.534+0000 7f9c24800640 1 -- 172.21.15.27:0/120998168 shutdown_connections 2024-09-13T18:01:53.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.534+0000 7f9c24800640 1 -- 172.21.15.27:0/120998168 wait complete. 2024-09-13T18:01:53.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.534+0000 7f9c24800640 1 Processor -- start 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c24800640 1 -- start start 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c24800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c072f10 0x7f9c1c19c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c24800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c1c0744f0 0x7f9c1c19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c24800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1c10c2f0 0x7f9c1c1a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c24800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c1a3e00 con 0x7f9c1c072f10 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c24800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c1a3f70 con 0x7f9c1c10c2f0 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c24800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c1a4130 con 0x7f9c1c0744f0 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c21e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c072f10 0x7f9c1c19c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c21e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c072f10 0x7f9c1c19c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51090/0 (socket says 172.21.15.27:51090) 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c21e00640 1 -- 172.21.15.27:0/344876296 learned_addr learned my addr 172.21.15.27:0/344876296 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c22800640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1c10c2f0 0x7f9c1c1a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.539 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c21400640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c1c0744f0 0x7f9c1c19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c21e00640 1 -- 172.21.15.27:0/344876296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c1c0744f0 msgr2=0x7f9c1c19c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c21e00640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c1c0744f0 0x7f9c1c19c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.535+0000 7f9c21e00640 1 -- 172.21.15.27:0/344876296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1c10c2f0 msgr2=0x7f9c1c1a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.536+0000 7f9c21e00640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1c10c2f0 0x7f9c1c1a38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.536+0000 7f9c21e00640 1 -- 172.21.15.27:0/344876296 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c009560 con 0x7f9c1c072f10 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.536+0000 7f9c21400640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c1c0744f0 0x7f9c1c19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.536+0000 7f9c21e00640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c072f10 0x7f9c1c19c310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c920 tx=0x7f9c1000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.536+0000 7f9c16a00640 1 -- 172.21.15.27:0/344876296 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10007c70 con 0x7f9c1c072f10 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.536+0000 7f9c16a00640 1 -- 172.21.15.27:0/344876296 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9c10007dd0 con 0x7f9c1c072f10 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.536+0000 7f9c16a00640 1 -- 172.21.15.27:0/344876296 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10018860 con 0x7f9c1c072f10 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.536+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c18009840 con 0x7f9c1c072f10 2024-09-13T18:01:53.540 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.536+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c1a4740 con 0x7f9c1c072f10 2024-09-13T18:01:53.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.537+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c1023a0 con 0x7f9c1c072f10 2024-09-13T18:01:53.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.539+0000 7f9c16a00640 1 -- 172.21.15.27:0/344876296 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9c1000fac0 con 0x7f9c1c072f10 2024-09-13T18:01:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.540+0000 7f9c16a00640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c040a1090 0x7f9c040a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.540+0000 7f9c16a00640 1 -- 172.21.15.27:0/344876296 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9c100ccc40 con 0x7f9c1c072f10 2024-09-13T18:01:53.542 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.541+0000 7f9c21400640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c040a1090 0x7f9c040a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.543 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.541+0000 7f9c21400640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c040a1090 0x7f9c040a3550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c19d820 tx=0x7f9c0c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:53.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.542+0000 7f9c16a00640 1 -- 172.21.15.27:0/344876296 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9c10096510 con 0x7f9c1c072f10 2024-09-13T18:01:53.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.755+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c1c02c4f0 con 0x7f9c040a1090 2024-09-13T18:01:53.761 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.759+0000 7f9c16a00640 1 -- 172.21.15.27:0/344876296 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f9c1c02c4f0 con 0x7f9c040a1090 2024-09-13T18:01:53.761 INFO:teuthology.orchestra.run.smithi027.stdout:/volumes/qa/sv_1/86d1e91a-8df4-474f-9b97-2d9090f9f3e5 2024-09-13T18:01:53.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c040a1090 msgr2=0x7f9c040a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c040a1090 0x7f9c040a3550 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c19d820 tx=0x7f9c0c009260 comp rx=0 tx=0).stop 2024-09-13T18:01:53.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c072f10 msgr2=0x7f9c1c19c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c072f10 0x7f9c1c19c310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000c920 tx=0x7f9c1000cde0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 shutdown_connections 2024-09-13T18:01:53.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c040a1090 0x7f9c040a3550 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c1c10c2f0 0x7f9c1c1a38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c1c0744f0 0x7f9c1c19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.764 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 --2- 172.21.15.27:0/344876296 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c1c072f10 0x7f9c1c19c310 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 >> 172.21.15.27:0/344876296 conn(0x7f9c1c0fb480 msgr2=0x7f9c1c0ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:53.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 shutdown_connections 2024-09-13T18:01:53.765 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.762+0000 7f9c24800640 1 -- 172.21.15.27:0/344876296 wait complete. 2024-09-13T18:01:53.780 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:01:53.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.940+0000 7f985bc00640 1 -- 172.21.15.27:0/2216072344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 msgr2=0x7f98540fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.940+0000 7f985bc00640 1 --2- 172.21.15.27:0/2216072344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 0x7f98540fea10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9848009900 tx=0x7f984802a410 comp rx=0 tx=0).stop 2024-09-13T18:01:53.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.940+0000 7f985bc00640 1 -- 172.21.15.27:0/2216072344 shutdown_connections 2024-09-13T18:01:53.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.940+0000 7f985bc00640 1 --2- 172.21.15.27:0/2216072344 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98540ff8f0 0x7f98540ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.940+0000 7f985bc00640 1 --2- 172.21.15.27:0/2216072344 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98540fef50 0x7f98540ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.940+0000 7f985bc00640 1 --2- 172.21.15.27:0/2216072344 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 0x7f98540fea10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.940+0000 7f985bc00640 1 -- 172.21.15.27:0/2216072344 >> 172.21.15.27:0/2216072344 conn(0x7f98540fa420 msgr2=0x7f98540fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:53.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.940+0000 7f985bc00640 1 -- 172.21.15.27:0/2216072344 shutdown_connections 2024-09-13T18:01:53.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.940+0000 7f985bc00640 1 -- 172.21.15.27:0/2216072344 wait complete. 2024-09-13T18:01:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.941+0000 7f985bc00640 1 Processor -- start 2024-09-13T18:01:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.941+0000 7f985bc00640 1 -- start start 2024-09-13T18:01:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.941+0000 7f985bc00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 0x7f9854198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.941+0000 7f985bc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98540fef50 0x7f9854198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.941+0000 7f985bc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98540ff8f0 0x7f985419f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.941+0000 7f985bc00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985419fbd0 con 0x7f98540fe610 2024-09-13T18:01:53.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.941+0000 7f985bc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985419fd40 con 0x7f98540ff8f0 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.941+0000 7f985bc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985419ff00 con 0x7f98540fef50 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 0x7f9854198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 0x7f9854198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51118/0 (socket says 172.21.15.27:51118) 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859200640 1 -- 172.21.15.27:0/2542543255 learned_addr learned my addr 172.21.15.27:0/2542543255 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859c00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98540ff8f0 0x7f985419f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9853e00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98540fef50 0x7f9854198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859200640 1 -- 172.21.15.27:0/2542543255 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98540fef50 msgr2=0x7f9854198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859200640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98540fef50 0x7f9854198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859200640 1 -- 172.21.15.27:0/2542543255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98540ff8f0 msgr2=0x7f985419f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859200640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98540ff8f0 0x7f985419f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859200640 1 -- 172.21.15.27:0/2542543255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9848009560 con 0x7f98540fe610 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.942+0000 7f9859200640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 0x7f9854198130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9848031510 tx=0x7f98480055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.943+0000 7f9851600640 1 -- 172.21.15.27:0/2542543255 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848004b90 con 0x7f98540fe610 2024-09-13T18:01:53.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.943+0000 7f9851600640 1 -- 172.21.15.27:0/2542543255 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9848004cf0 con 0x7f98540fe610 2024-09-13T18:01:53.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.943+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98541a0180 con 0x7f98540fe610 2024-09-13T18:01:53.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.943+0000 7f9851600640 1 -- 172.21.15.27:0/2542543255 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9848031b50 con 0x7f98540fe610 2024-09-13T18:01:53.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.943+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98541a0680 con 0x7f98540fe610 2024-09-13T18:01:53.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.944+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9854109590 con 0x7f98540fe610 2024-09-13T18:01:53.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.946+0000 7f9851600640 1 -- 172.21.15.27:0/2542543255 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9848003cd0 con 0x7f98540fe610 2024-09-13T18:01:53.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.947+0000 7f9851600640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f983c0a1110 0x7f983c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:53.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.947+0000 7f9851600640 1 -- 172.21.15.27:0/2542543255 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f98480ed980 con 0x7f98540fe610 2024-09-13T18:01:53.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.947+0000 7f9853e00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f983c0a1110 0x7f983c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:53.950 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.948+0000 7f9853e00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f983c0a1110 0x7f983c0a35d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98541995f0 tx=0x7f9840005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:53.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:53.949+0000 7f9851600640 1 -- 172.21.15.27:0/2542543255 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f98480b7270 con 0x7f98540fe610 2024-09-13T18:01:54.078 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.076+0000 7f9851600640 1 -- 172.21.15.27:0/2542543255 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f98480b7640 con 0x7f98540fe610 2024-09-13T18:01:54.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.173+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f985410d9f0 con 0x7f98540fe610 2024-09-13T18:01:54.175 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.174+0000 7f9851600640 1 -- 172.21.15.27:0/2542543255 <== mon.0 v2:172.21.15.27:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10916 (secure 0 0 0) 0x7f98480af030 con 0x7f98540fe610 2024-09-13T18:01:54.176 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:54.176 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:01:46.320502+0000","modified":"2024-09-13T18:01:53.056677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24556,"mds_2":24533,"mds_3":24529,"mds_4":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24448":{"gid":24448,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24529":{"gid":24529,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24556":{"gid":24556,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/1102491877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1102491877},{"type":"v1","addr":"172.21.15.122:6839","nonce":1102491877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:01:54.176 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 26 2024-09-13T18:01:54.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f983c0a1110 msgr2=0x7f983c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f983c0a1110 0x7f983c0a35d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f98541995f0 tx=0x7f9840005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:54.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 msgr2=0x7f9854198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 0x7f9854198130 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9848031510 tx=0x7f98480055a0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 shutdown_connections 2024-09-13T18:01:54.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f983c0a1110 0x7f983c0a35d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98540ff8f0 0x7f985419f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98540fef50 0x7f9854198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 --2- 172.21.15.27:0/2542543255 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98540fe610 0x7f9854198130 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 >> 172.21.15.27:0/2542543255 conn(0x7f98540fa420 msgr2=0x7f98540fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:54.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 shutdown_connections 2024-09-13T18:01:54.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.176+0000 7f985bc00640 1 -- 172.21.15.27:0/2542543255 wait complete. 2024-09-13T18:01:54.194 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:01:54.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:54 smithi027 ceph-mon[30611]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:54.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:54 smithi027 ceph-mon[30611]: from='client.24686 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:54.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:54 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] up:active 2024-09-13T18:01:54.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:54 smithi027 ceph-mon[30611]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-13T18:01:54.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:54 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:01:54.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:54 smithi027 ceph-mon[30611]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:54.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.355+0000 7f42bfe00640 1 -- 172.21.15.27:0/697230558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c0102fb0 msgr2=0x7f42c0103430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.355+0000 7f42bfe00640 1 --2- 172.21.15.27:0/697230558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c0102fb0 0x7f42c0103430 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009900 tx=0x7f42ac02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.355+0000 7f42bfe00640 1 -- 172.21.15.27:0/697230558 shutdown_connections 2024-09-13T18:01:54.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.355+0000 7f42bfe00640 1 --2- 172.21.15.27:0/697230558 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42c0103970 0x7f42c010a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.355+0000 7f42bfe00640 1 --2- 172.21.15.27:0/697230558 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c0102fb0 0x7f42c0103430 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.355+0000 7f42bfe00640 1 --2- 172.21.15.27:0/697230558 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42c0101dc0 0x7f42c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.355+0000 7f42bfe00640 1 -- 172.21.15.27:0/697230558 >> 172.21.15.27:0/697230558 conn(0x7f42c00fd540 msgr2=0x7f42c00ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:54.357 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.355+0000 7f42bfe00640 1 -- 172.21.15.27:0/697230558 shutdown_connections 2024-09-13T18:01:54.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.355+0000 7f42bfe00640 1 -- 172.21.15.27:0/697230558 wait complete. 2024-09-13T18:01:54.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.356+0000 7f42bfe00640 1 Processor -- start 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.356+0000 7f42bfe00640 1 -- start start 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.356+0000 7f42bfe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42c0101dc0 0x7f42c0197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.356+0000 7f42bfe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42c0102fb0 0x7f42c01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.356+0000 7f42bfe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c0103970 0x7f42c019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.356+0000 7f42bfe00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c019f980 con 0x7f42c0102fb0 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.356+0000 7f42bfe00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c019faf0 con 0x7f42c0103970 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.356+0000 7f42bfe00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c019fcb0 con 0x7f42c0101dc0 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42c0101dc0 0x7f42c0197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42c0101dc0 0x7f42c0197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:40246/0 (socket says 172.21.15.27:40246) 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bea00640 1 -- 172.21.15.27:0/1907353906 learned_addr learned my addr 172.21.15.27:0/1907353906 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:54.360 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bf400640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c0103970 0x7f42c019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42be000640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42c0102fb0 0x7f42c01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bea00640 1 -- 172.21.15.27:0/1907353906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c0103970 msgr2=0x7f42c019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bea00640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c0103970 0x7f42c019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bea00640 1 -- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42c0102fb0 msgr2=0x7f42c01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bea00640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42c0102fb0 0x7f42c01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bea00640 1 -- 172.21.15.27:0/1907353906 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b0009490 con 0x7f42c0101dc0 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42be000640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42c0102fb0 0x7f42c01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.357+0000 7f42bea00640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42c0101dc0 0x7f42c0197e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42b000e9c0 tx=0x7f42b000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.358+0000 7f42b7400640 1 -- 172.21.15.27:0/1907353906 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b000cde0 con 0x7f42c0101dc0 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.358+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac009560 con 0x7f42c0101dc0 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.358+0000 7f42b7400640 1 -- 172.21.15.27:0/1907353906 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f42b0010910 con 0x7f42c0101dc0 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.358+0000 7f42b7400640 1 -- 172.21.15.27:0/1907353906 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b0018960 con 0x7f42c0101dc0 2024-09-13T18:01:54.361 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.358+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c01a0280 con 0x7f42c0101dc0 2024-09-13T18:01:54.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.359+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c010d850 con 0x7f42c0101dc0 2024-09-13T18:01:54.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.361+0000 7f42b7400640 1 -- 172.21.15.27:0/1907353906 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f42b0010a80 con 0x7f42c0101dc0 2024-09-13T18:01:54.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.362+0000 7f42b7400640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f42a40a1120 0x7f42a40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:54.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.363+0000 7f42b7400640 1 -- 172.21.15.27:0/1907353906 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f42b0014070 con 0x7f42c0101dc0 2024-09-13T18:01:54.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.363+0000 7f42be000640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f42a40a1120 0x7f42a40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:54.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.363+0000 7f42be000640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f42a40a1120 0x7f42a40a35e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42ac006010 tx=0x7f42ac000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:54.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.365+0000 7f42b7400640 1 -- 172.21.15.27:0/1907353906 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f42b00968c0 con 0x7f42c0101dc0 2024-09-13T18:01:54.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:54 smithi122 ceph-mon[35310]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:54.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:54 smithi122 ceph-mon[35310]: from='client.24686 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:54.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:54 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] up:active 2024-09-13T18:01:54.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:54 smithi122 ceph-mon[35310]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-13T18:01:54.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:54 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:01:54.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:54 smithi122 ceph-mon[35310]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:54.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:54 smithi143 ceph-mon[38210]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:54.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:54 smithi143 ceph-mon[38210]: from='client.24686 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:54.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:54 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] up:active 2024-09-13T18:01:54.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:54 smithi143 ceph-mon[38210]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-13T18:01:54.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:54 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:01:54.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:54 smithi143 ceph-mon[38210]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:54.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.550+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42c0108bf0 con 0x7f42c0101dc0 2024-09-13T18:01:54.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.552+0000 7f42b7400640 1 -- 172.21.15.27:0/1907353906 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22095 (secure 0 0 0) 0x7f42b0099ee0 con 0x7f42c0101dc0 2024-09-13T18:01:54.554 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:54.554 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":86,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:01:47.322441+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:01:54.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f42a40a1120 msgr2=0x7f42a40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f42a40a1120 0x7f42a40a35e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42ac006010 tx=0x7f42ac000bc0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42c0101dc0 msgr2=0x7f42c0197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42c0101dc0 0x7f42c0197e90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f42b000e9c0 tx=0x7f42b000ee80 comp rx=0 tx=0).stop 2024-09-13T18:01:54.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 shutdown_connections 2024-09-13T18:01:54.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f42a40a1120 0x7f42a40a35e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f42c0103970 0x7f42c019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f42c0102fb0 0x7f42c01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 --2- 172.21.15.27:0/1907353906 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f42c0101dc0 0x7f42c0197e90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 >> 172.21.15.27:0/1907353906 conn(0x7f42c00fd540 msgr2=0x7f42c00ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:54.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 shutdown_connections 2024-09-13T18:01:54.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.554+0000 7f42bfe00640 1 -- 172.21.15.27:0/1907353906 wait complete. 2024-09-13T18:01:54.572 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:01:54.573 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:01:54.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.730+0000 7f367d800640 1 -- 172.21.15.27:0/3320289587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36780760b0 msgr2=0x7f3678076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.730+0000 7f367d800640 1 --2- 172.21.15.27:0/3320289587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36780760b0 0x7f3678076510 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3660009900 tx=0x7f366002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.731+0000 7f367d800640 1 -- 172.21.15.27:0/3320289587 shutdown_connections 2024-09-13T18:01:54.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.731+0000 7f367d800640 1 --2- 172.21.15.27:0/3320289587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3678076a50 0x7f36780772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.731+0000 7f367d800640 1 --2- 172.21.15.27:0/3320289587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36780760b0 0x7f3678076510 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.731+0000 7f367d800640 1 --2- 172.21.15.27:0/3320289587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3678074e70 0x7f3678075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.731+0000 7f367d800640 1 -- 172.21.15.27:0/3320289587 >> 172.21.15.27:0/3320289587 conn(0x7f36780fd730 msgr2=0x7f36780ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:54.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.731+0000 7f367d800640 1 -- 172.21.15.27:0/3320289587 shutdown_connections 2024-09-13T18:01:54.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.731+0000 7f367d800640 1 -- 172.21.15.27:0/3320289587 wait complete. 2024-09-13T18:01:54.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f367d800640 1 Processor -- start 2024-09-13T18:01:54.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f367d800640 1 -- start start 2024-09-13T18:01:54.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f367d800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3678074e70 0x7f367819c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f367d800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36780760b0 0x7f367819c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f367d800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3678076a50 0x7f36781a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f367d800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36781a3f30 con 0x7f3678074e70 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f367d800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36781a40a0 con 0x7f3678076a50 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f367d800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36781a4260 con 0x7f36780760b0 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f3676a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3678074e70 0x7f367819c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f3676a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3678074e70 0x7f367819c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51160/0 (socket says 172.21.15.27:51160) 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.732+0000 7f3676a00640 1 -- 172.21.15.27:0/163774960 learned_addr learned my addr 172.21.15.27:0/163774960 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f366e000640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36780760b0 0x7f367819c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f3677400640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3678076a50 0x7f36781a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f3676a00640 1 -- 172.21.15.27:0/163774960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36780760b0 msgr2=0x7f367819c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f3676a00640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36780760b0 0x7f367819c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f3676a00640 1 -- 172.21.15.27:0/163774960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3678076a50 msgr2=0x7f36781a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f3676a00640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3678076a50 0x7f36781a39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f3676a00640 1 -- 172.21.15.27:0/163774960 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3670009840 con 0x7f3678074e70 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f3676a00640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3678074e70 0x7f367819c490 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f366800e9f0 tx=0x7f366800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f366fe00640 1 -- 172.21.15.27:0/163774960 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668009700 con 0x7f3678074e70 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f366fe00640 1 -- 172.21.15.27:0/163774960 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f366800cd80 con 0x7f3678074e70 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3660009560 con 0x7f3678074e70 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f366fe00640 1 -- 172.21.15.27:0/163774960 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668018920 con 0x7f3678074e70 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.733+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36781a48e0 con 0x7f3678074e70 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.734+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367810eaf0 con 0x7f3678074e70 2024-09-13T18:01:54.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.736+0000 7f366fe00640 1 -- 172.21.15.27:0/163774960 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3668018a80 con 0x7f3678074e70 2024-09-13T18:01:54.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.737+0000 7f366fe00640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f365c0a11a0 0x7f365c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:54.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.738+0000 7f366fe00640 1 -- 172.21.15.27:0/163774960 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3668014070 con 0x7f3678074e70 2024-09-13T18:01:54.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.738+0000 7f366e000640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f365c0a11a0 0x7f365c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:54.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.739+0000 7f366e000640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f365c0a11a0 0x7f365c0a3660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3660006010 tx=0x7f3660000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:54.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.742+0000 7f366fe00640 1 -- 172.21.15.27:0/163774960 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3668052e20 con 0x7f3678074e70 2024-09-13T18:01:54.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.921+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f367802c480 con 0x7f365c0a11a0 2024-09-13T18:01:54.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.933+0000 7f366fe00640 1 -- 172.21.15.27:0/163774960 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335951 (secure 0 0 0) 0x7f367802c480 con 0x7f365c0a11a0 2024-09-13T18:01:54.940 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:54.943 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-13T18:01:54.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f365c0a11a0 msgr2=0x7f365c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f365c0a11a0 0x7f365c0a3660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3660006010 tx=0x7f3660000bc0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3678074e70 msgr2=0x7f367819c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3678074e70 0x7f367819c490 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f366800e9f0 tx=0x7f366800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 shutdown_connections 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f365c0a11a0 0x7f365c0a3660 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3678076a50 0x7f36781a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f36780760b0 0x7f367819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 --2- 172.21.15.27:0/163774960 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3678074e70 0x7f367819c490 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 >> 172.21.15.27:0/163774960 conn(0x7f36780fd730 msgr2=0x7f36780feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 shutdown_connections 2024-09-13T18:01:54.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:54.939+0000 7f367d800640 1 -- 172.21.15.27:0/163774960 wait complete. 2024-09-13T18:01:54.958 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-13T18:01:53.370167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603875,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":348,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369784,"kb_used_data":12808,"kb_used_omap":18,"kb_used_meta":356845,"kb_avail":1124572040,"statfs":{"total":1151940427776,"available":1151561768960,"internally_reserved":0,"allocated":13115392,"data_stored":7099719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19127,"internal_metadata":365409609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13507,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.480735"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109703+0000","last_change":"2024-09-13T18:01:46.343413+0000","last_active":"2024-09-13T18:01:47.109703+0000","last_peered":"2024-09-13T18:01:47.109703+0000","last_clean":"2024-09-13T18:01:47.109703+0000","last_became_active":"2024-09-13T18:01:46.343086+0000","last_became_peered":"2024-09-13T18:01:46.343086+0000","last_unstale":"2024-09-13T18:01:47.109703+0000","last_undegraded":"2024-09-13T18:01:47.109703+0000","last_fullsized":"2024-09-13T18:01:47.109703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:11.345474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900616+0000","last_change":"2024-09-13T18:01:46.338910+0000","last_active":"2024-09-13T18:01:47.900616+0000","last_peered":"2024-09-13T18:01:47.900616+0000","last_clean":"2024-09-13T18:01:47.900616+0000","last_became_active":"2024-09-13T18:01:46.338570+0000","last_became_peered":"2024-09-13T18:01:46.338570+0000","last_unstale":"2024-09-13T18:01:47.900616+0000","last_undegraded":"2024-09-13T18:01:47.900616+0000","last_fullsized":"2024-09-13T18:01:47.900616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:24.664195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900719+0000","last_change":"2024-09-13T18:01:46.329371+0000","last_active":"2024-09-13T18:01:47.900719+0000","last_peered":"2024-09-13T18:01:47.900719+0000","last_clean":"2024-09-13T18:01:47.900719+0000","last_became_active":"2024-09-13T18:01:46.328778+0000","last_became_peered":"2024-09-13T18:01:46.328778+0000","last_unstale":"2024-09-13T18:01:47.900719+0000","last_undegraded":"2024-09-13T18:01:47.900719+0000","last_fullsized":"2024-09-13T18:01:47.900719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:02.025318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:46.996286+0000","last_change":"2024-09-13T18:01:46.357302+0000","last_active":"2024-09-13T18:01:46.996286+0000","last_peered":"2024-09-13T18:01:46.996286+0000","last_clean":"2024-09-13T18:01:46.996286+0000","last_became_active":"2024-09-13T18:01:46.356981+0000","last_became_peered":"2024-09-13T18:01:46.356981+0000","last_unstale":"2024-09-13T18:01:46.996286+0000","last_undegraded":"2024-09-13T18:01:46.996286+0000","last_fullsized":"2024-09-13T18:01:46.996286+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:30.410651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.881879+0000","last_change":"2024-09-13T18:01:46.357813+0000","last_active":"2024-09-13T18:01:47.881879+0000","last_peered":"2024-09-13T18:01:47.881879+0000","last_clean":"2024-09-13T18:01:47.881879+0000","last_became_active":"2024-09-13T18:01:46.357039+0000","last_became_peered":"2024-09-13T18:01:46.357039+0000","last_unstale":"2024-09-13T18:01:47.881879+0000","last_undegraded":"2024-09-13T18:01:47.881879+0000","last_fullsized":"2024-09-13T18:01:47.881879+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:18.772049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.187412+0000","last_change":"2024-09-13T18:01:46.348881+0000","last_active":"2024-09-13T18:01:47.187412+0000","last_peered":"2024-09-13T18:01:47.187412+0000","last_clean":"2024-09-13T18:01:47.187412+0000","last_became_active":"2024-09-13T18:01:46.348576+0000","last_became_peered":"2024-09-13T18:01:46.348576+0000","last_unstale":"2024-09-13T18:01:47.187412+0000","last_undegraded":"2024-09-13T18:01:47.187412+0000","last_fullsized":"2024-09-13T18:01:47.187412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:56.322188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329151+0000","last_change":"2024-09-13T18:01:46.348568+0000","last_active":"2024-09-13T18:01:47.329151+0000","last_peered":"2024-09-13T18:01:47.329151+0000","last_clean":"2024-09-13T18:01:47.329151+0000","last_became_active":"2024-09-13T18:01:46.347140+0000","last_became_peered":"2024-09-13T18:01:46.347140+0000","last_unstale":"2024-09-13T18:01:47.329151+0000","last_undegraded":"2024-09-13T18:01:47.329151+0000","last_fullsized":"2024-09-13T18:01:47.329151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:53.324943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326233+0000","last_change":"2024-09-13T18:01:46.356670+0000","last_active":"2024-09-13T18:01:47.326233+0000","last_peered":"2024-09-13T18:01:47.326233+0000","last_clean":"2024-09-13T18:01:47.326233+0000","last_became_active":"2024-09-13T18:01:46.354951+0000","last_became_peered":"2024-09-13T18:01:46.354951+0000","last_unstale":"2024-09-13T18:01:47.326233+0000","last_undegraded":"2024-09-13T18:01:47.326233+0000","last_fullsized":"2024-09-13T18:01:47.326233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:26.335474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315904+0000","last_change":"2024-09-13T18:01:46.339105+0000","last_active":"2024-09-13T18:01:47.315904+0000","last_peered":"2024-09-13T18:01:47.315904+0000","last_clean":"2024-09-13T18:01:47.315904+0000","last_became_active":"2024-09-13T18:01:46.338760+0000","last_became_peered":"2024-09-13T18:01:46.338760+0000","last_unstale":"2024-09-13T18:01:47.315904+0000","last_undegraded":"2024-09-13T18:01:47.315904+0000","last_fullsized":"2024-09-13T18:01:47.315904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:30.071385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.187510+0000","last_change":"2024-09-13T18:01:46.349900+0000","last_active":"2024-09-13T18:01:47.187510+0000","last_peered":"2024-09-13T18:01:47.187510+0000","last_clean":"2024-09-13T18:01:47.187510+0000","last_became_active":"2024-09-13T18:01:46.348934+0000","last_became_peered":"2024-09-13T18:01:46.348934+0000","last_unstale":"2024-09-13T18:01:47.187510+0000","last_undegraded":"2024-09-13T18:01:47.187510+0000","last_fullsized":"2024-09-13T18:01:47.187510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:33.337730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329632+0000","last_change":"2024-09-13T18:01:46.345358+0000","last_active":"2024-09-13T18:01:47.329632+0000","last_peered":"2024-09-13T18:01:47.329632+0000","last_clean":"2024-09-13T18:01:47.329632+0000","last_became_active":"2024-09-13T18:01:46.345050+0000","last_became_peered":"2024-09-13T18:01:46.345050+0000","last_unstale":"2024-09-13T18:01:47.329632+0000","last_undegraded":"2024-09-13T18:01:47.329632+0000","last_fullsized":"2024-09-13T18:01:47.329632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:30.925633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:46.996297+0000","last_change":"2024-09-13T18:01:46.349011+0000","last_active":"2024-09-13T18:01:46.996297+0000","last_peered":"2024-09-13T18:01:46.996297+0000","last_clean":"2024-09-13T18:01:46.996297+0000","last_became_active":"2024-09-13T18:01:46.348245+0000","last_became_peered":"2024-09-13T18:01:46.348245+0000","last_unstale":"2024-09-13T18:01:46.996297+0000","last_undegraded":"2024-09-13T18:01:46.996297+0000","last_fullsized":"2024-09-13T18:01:46.996297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:47.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882508+0000","last_change":"2024-09-13T18:01:46.342540+0000","last_active":"2024-09-13T18:01:47.882508+0000","last_peered":"2024-09-13T18:01:47.882508+0000","last_clean":"2024-09-13T18:01:47.882508+0000","last_became_active":"2024-09-13T18:01:46.342143+0000","last_became_peered":"2024-09-13T18:01:46.342143+0000","last_unstale":"2024-09-13T18:01:47.882508+0000","last_undegraded":"2024-09-13T18:01:47.882508+0000","last_fullsized":"2024-09-13T18:01:47.882508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:49.934091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900370+0000","last_change":"2024-09-13T18:01:46.338915+0000","last_active":"2024-09-13T18:01:47.900370+0000","last_peered":"2024-09-13T18:01:47.900370+0000","last_clean":"2024-09-13T18:01:47.900370+0000","last_became_active":"2024-09-13T18:01:46.338384+0000","last_became_peered":"2024-09-13T18:01:46.338384+0000","last_unstale":"2024-09-13T18:01:47.900370+0000","last_undegraded":"2024-09-13T18:01:47.900370+0000","last_fullsized":"2024-09-13T18:01:47.900370+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:13.478337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900377+0000","last_change":"2024-09-13T18:01:46.343959+0000","last_active":"2024-09-13T18:01:47.900377+0000","last_peered":"2024-09-13T18:01:47.900377+0000","last_clean":"2024-09-13T18:01:47.900377+0000","last_became_active":"2024-09-13T18:01:46.341063+0000","last_became_peered":"2024-09-13T18:01:46.341063+0000","last_unstale":"2024-09-13T18:01:47.900377+0000","last_undegraded":"2024-09-13T18:01:47.900377+0000","last_fullsized":"2024-09-13T18:01:47.900377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.447487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315810+0000","last_change":"2024-09-13T18:01:46.341971+0000","last_active":"2024-09-13T18:01:47.315810+0000","last_peered":"2024-09-13T18:01:47.315810+0000","last_clean":"2024-09-13T18:01:47.315810+0000","last_became_active":"2024-09-13T18:01:46.341636+0000","last_became_peered":"2024-09-13T18:01:46.341636+0000","last_unstale":"2024-09-13T18:01:47.315810+0000","last_undegraded":"2024-09-13T18:01:47.315810+0000","last_fullsized":"2024-09-13T18:01:47.315810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:27.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109713+0000","last_change":"2024-09-13T18:01:46.344009+0000","last_active":"2024-09-13T18:01:47.109713+0000","last_peered":"2024-09-13T18:01:47.109713+0000","last_clean":"2024-09-13T18:01:47.109713+0000","last_became_active":"2024-09-13T18:01:46.343639+0000","last_became_peered":"2024-09-13T18:01:46.343639+0000","last_unstale":"2024-09-13T18:01:47.109713+0000","last_undegraded":"2024-09-13T18:01:47.109713+0000","last_fullsized":"2024-09-13T18:01:47.109713+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:09.271452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882712+0000","last_change":"2024-09-13T18:01:46.343502+0000","last_active":"2024-09-13T18:01:47.882712+0000","last_peered":"2024-09-13T18:01:47.882712+0000","last_clean":"2024-09-13T18:01:47.882712+0000","last_became_active":"2024-09-13T18:01:46.343169+0000","last_became_peered":"2024-09-13T18:01:46.343169+0000","last_unstale":"2024-09-13T18:01:47.882712+0000","last_undegraded":"2024-09-13T18:01:47.882712+0000","last_fullsized":"2024-09-13T18:01:47.882712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:25.351119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882607+0000","last_change":"2024-09-13T18:01:46.348957+0000","last_active":"2024-09-13T18:01:47.882607+0000","last_peered":"2024-09-13T18:01:47.882607+0000","last_clean":"2024-09-13T18:01:47.882607+0000","last_became_active":"2024-09-13T18:01:46.348617+0000","last_became_peered":"2024-09-13T18:01:46.348617+0000","last_unstale":"2024-09-13T18:01:47.882607+0000","last_undegraded":"2024-09-13T18:01:47.882607+0000","last_fullsized":"2024-09-13T18:01:47.882607+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:24.981539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109660+0000","last_change":"2024-09-13T18:01:46.352010+0000","last_active":"2024-09-13T18:01:47.109660+0000","last_peered":"2024-09-13T18:01:47.109660+0000","last_clean":"2024-09-13T18:01:47.109660+0000","last_became_active":"2024-09-13T18:01:46.351708+0000","last_became_peered":"2024-09-13T18:01:46.351708+0000","last_unstale":"2024-09-13T18:01:47.109660+0000","last_undegraded":"2024-09-13T18:01:47.109660+0000","last_fullsized":"2024-09-13T18:01:47.109660+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:04.022440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882581+0000","last_change":"2024-09-13T18:01:46.346106+0000","last_active":"2024-09-13T18:01:47.882581+0000","last_peered":"2024-09-13T18:01:47.882581+0000","last_clean":"2024-09-13T18:01:47.882581+0000","last_became_active":"2024-09-13T18:01:46.345814+0000","last_became_peered":"2024-09-13T18:01:46.345814+0000","last_unstale":"2024-09-13T18:01:47.882581+0000","last_undegraded":"2024-09-13T18:01:47.882581+0000","last_fullsized":"2024-09-13T18:01:47.882581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:04.030278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315839+0000","last_change":"2024-09-13T18:01:46.358966+0000","last_active":"2024-09-13T18:01:47.315839+0000","last_peered":"2024-09-13T18:01:47.315839+0000","last_clean":"2024-09-13T18:01:47.315839+0000","last_became_active":"2024-09-13T18:01:46.358048+0000","last_became_peered":"2024-09-13T18:01:46.358048+0000","last_unstale":"2024-09-13T18:01:47.315839+0000","last_undegraded":"2024-09-13T18:01:47.315839+0000","last_fullsized":"2024-09-13T18:01:47.315839+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:02.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326220+0000","last_change":"2024-09-13T18:01:46.352545+0000","last_active":"2024-09-13T18:01:47.326220+0000","last_peered":"2024-09-13T18:01:47.326220+0000","last_clean":"2024-09-13T18:01:47.326220+0000","last_became_active":"2024-09-13T18:01:46.352231+0000","last_became_peered":"2024-09-13T18:01:46.352231+0000","last_unstale":"2024-09-13T18:01:47.326220+0000","last_undegraded":"2024-09-13T18:01:47.326220+0000","last_fullsized":"2024-09-13T18:01:47.326220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:01.420823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326962+0000","last_change":"2024-09-13T18:01:46.355755+0000","last_active":"2024-09-13T18:01:47.326962+0000","last_peered":"2024-09-13T18:01:47.326962+0000","last_clean":"2024-09-13T18:01:47.326962+0000","last_became_active":"2024-09-13T18:01:46.355251+0000","last_became_peered":"2024-09-13T18:01:46.355251+0000","last_unstale":"2024-09-13T18:01:47.326962+0000","last_undegraded":"2024-09-13T18:01:47.326962+0000","last_fullsized":"2024-09-13T18:01:47.326962+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:28.658446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326630+0000","last_change":"2024-09-13T18:01:46.359891+0000","last_active":"2024-09-13T18:01:47.326630+0000","last_peered":"2024-09-13T18:01:47.326630+0000","last_clean":"2024-09-13T18:01:47.326630+0000","last_became_active":"2024-09-13T18:01:46.359445+0000","last_became_peered":"2024-09-13T18:01:46.359445+0000","last_unstale":"2024-09-13T18:01:47.326630+0000","last_undegraded":"2024-09-13T18:01:47.326630+0000","last_fullsized":"2024-09-13T18:01:47.326630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:14.287904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.883008+0000","last_change":"2024-09-13T18:01:46.337012+0000","last_active":"2024-09-13T18:01:47.883008+0000","last_peered":"2024-09-13T18:01:47.883008+0000","last_clean":"2024-09-13T18:01:47.883008+0000","last_became_active":"2024-09-13T18:01:46.335134+0000","last_became_peered":"2024-09-13T18:01:46.335134+0000","last_unstale":"2024-09-13T18:01:47.883008+0000","last_undegraded":"2024-09-13T18:01:47.883008+0000","last_fullsized":"2024-09-13T18:01:47.883008+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:00.932899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109678+0000","last_change":"2024-09-13T18:01:46.345537+0000","last_active":"2024-09-13T18:01:47.109678+0000","last_peered":"2024-09-13T18:01:47.109678+0000","last_clean":"2024-09-13T18:01:47.109678+0000","last_became_active":"2024-09-13T18:01:46.344988+0000","last_became_peered":"2024-09-13T18:01:46.344988+0000","last_unstale":"2024-09-13T18:01:47.109678+0000","last_undegraded":"2024-09-13T18:01:47.109678+0000","last_fullsized":"2024-09-13T18:01:47.109678+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:01.631371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882295+0000","last_change":"2024-09-13T18:01:46.352355+0000","last_active":"2024-09-13T18:01:47.882295+0000","last_peered":"2024-09-13T18:01:47.882295+0000","last_clean":"2024-09-13T18:01:47.882295+0000","last_became_active":"2024-09-13T18:01:46.352027+0000","last_became_peered":"2024-09-13T18:01:46.352027+0000","last_unstale":"2024-09-13T18:01:47.882295+0000","last_undegraded":"2024-09-13T18:01:47.882295+0000","last_fullsized":"2024-09-13T18:01:47.882295+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:21.204326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900603+0000","last_change":"2024-09-13T18:01:46.353703+0000","last_active":"2024-09-13T18:01:47.900603+0000","last_peered":"2024-09-13T18:01:47.900603+0000","last_clean":"2024-09-13T18:01:47.900603+0000","last_became_active":"2024-09-13T18:01:46.353278+0000","last_became_peered":"2024-09-13T18:01:46.353278+0000","last_unstale":"2024-09-13T18:01:47.900603+0000","last_undegraded":"2024-09-13T18:01:47.900603+0000","last_fullsized":"2024-09-13T18:01:47.900603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:13.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882706+0000","last_change":"2024-09-13T18:01:46.348944+0000","last_active":"2024-09-13T18:01:47.882706+0000","last_peered":"2024-09-13T18:01:47.882706+0000","last_clean":"2024-09-13T18:01:47.882706+0000","last_became_active":"2024-09-13T18:01:46.348600+0000","last_became_peered":"2024-09-13T18:01:46.348600+0000","last_unstale":"2024-09-13T18:01:47.882706+0000","last_undegraded":"2024-09-13T18:01:47.882706+0000","last_fullsized":"2024-09-13T18:01:47.882706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:52.474038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882666+0000","last_change":"2024-09-13T18:01:46.343072+0000","last_active":"2024-09-13T18:01:47.882666+0000","last_peered":"2024-09-13T18:01:47.882666+0000","last_clean":"2024-09-13T18:01:47.882666+0000","last_became_active":"2024-09-13T18:01:46.342604+0000","last_became_peered":"2024-09-13T18:01:46.342604+0000","last_unstale":"2024-09-13T18:01:47.882666+0000","last_undegraded":"2024-09-13T18:01:47.882666+0000","last_fullsized":"2024-09-13T18:01:47.882666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:39.018568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109622+0000","last_change":"2024-09-13T18:01:46.345568+0000","last_active":"2024-09-13T18:01:47.109622+0000","last_peered":"2024-09-13T18:01:47.109622+0000","last_clean":"2024-09-13T18:01:47.109622+0000","last_became_active":"2024-09-13T18:01:46.344980+0000","last_became_peered":"2024-09-13T18:01:46.344980+0000","last_unstale":"2024-09-13T18:01:47.109622+0000","last_undegraded":"2024-09-13T18:01:47.109622+0000","last_fullsized":"2024-09-13T18:01:47.109622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:10.337136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882208+0000","last_change":"2024-09-13T18:01:46.343778+0000","last_active":"2024-09-13T18:01:47.882208+0000","last_peered":"2024-09-13T18:01:47.882208+0000","last_clean":"2024-09-13T18:01:47.882208+0000","last_became_active":"2024-09-13T18:01:46.343315+0000","last_became_peered":"2024-09-13T18:01:46.343315+0000","last_unstale":"2024-09-13T18:01:47.882208+0000","last_undegraded":"2024-09-13T18:01:47.882208+0000","last_fullsized":"2024-09-13T18:01:47.882208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:37.300512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.057541+0000","last_change":"2024-09-13T18:01:45.907544+0000","last_active":"2024-09-13T18:01:52.057541+0000","last_peered":"2024-09-13T18:01:52.057541+0000","last_clean":"2024-09-13T18:01:52.057541+0000","last_became_active":"2024-09-13T18:01:45.905723+0000","last_became_peered":"2024-09-13T18:01:45.905723+0000","last_unstale":"2024-09-13T18:01:52.057541+0000","last_undegraded":"2024-09-13T18:01:52.057541+0000","last_fullsized":"2024-09-13T18:01:52.057541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:36.956332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326992+0000","last_change":"2024-09-13T18:01:46.354386+0000","last_active":"2024-09-13T18:01:47.326992+0000","last_peered":"2024-09-13T18:01:47.326992+0000","last_clean":"2024-09-13T18:01:47.326992+0000","last_became_active":"2024-09-13T18:01:46.353826+0000","last_became_peered":"2024-09-13T18:01:46.353826+0000","last_unstale":"2024-09-13T18:01:47.326992+0000","last_undegraded":"2024-09-13T18:01:47.326992+0000","last_fullsized":"2024-09-13T18:01:47.326992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:52.882814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:51.376862+0000","last_change":"2024-09-13T18:01:45.905700+0000","last_active":"2024-09-13T18:01:51.376862+0000","last_peered":"2024-09-13T18:01:51.376862+0000","last_clean":"2024-09-13T18:01:51.376862+0000","last_became_active":"2024-09-13T18:01:45.905041+0000","last_became_peered":"2024-09-13T18:01:45.905041+0000","last_unstale":"2024-09-13T18:01:51.376862+0000","last_undegraded":"2024-09-13T18:01:51.376862+0000","last_fullsized":"2024-09-13T18:01:51.376862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:42.452899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:50.370204+0000","last_change":"2024-09-13T18:01:45.909342+0000","last_active":"2024-09-13T18:01:50.370204+0000","last_peered":"2024-09-13T18:01:50.370204+0000","last_clean":"2024-09-13T18:01:50.370204+0000","last_became_active":"2024-09-13T18:01:45.903521+0000","last_became_peered":"2024-09-13T18:01:45.903521+0000","last_unstale":"2024-09-13T18:01:50.370204+0000","last_undegraded":"2024-09-13T18:01:50.370204+0000","last_fullsized":"2024-09-13T18:01:50.370204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:51.641256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326303+0000","last_change":"2024-09-13T18:01:46.352544+0000","last_active":"2024-09-13T18:01:47.326303+0000","last_peered":"2024-09-13T18:01:47.326303+0000","last_clean":"2024-09-13T18:01:47.326303+0000","last_became_active":"2024-09-13T18:01:46.352037+0000","last_became_peered":"2024-09-13T18:01:46.352037+0000","last_unstale":"2024-09-13T18:01:47.326303+0000","last_undegraded":"2024-09-13T18:01:47.326303+0000","last_fullsized":"2024-09-13T18:01:47.326303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:39.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.057421+0000","last_change":"2024-09-13T18:01:45.908424+0000","last_active":"2024-09-13T18:01:52.057421+0000","last_peered":"2024-09-13T18:01:52.057421+0000","last_clean":"2024-09-13T18:01:52.057421+0000","last_became_active":"2024-09-13T18:01:45.908046+0000","last_became_peered":"2024-09-13T18:01:45.908046+0000","last_unstale":"2024-09-13T18:01:52.057421+0000","last_undegraded":"2024-09-13T18:01:52.057421+0000","last_fullsized":"2024-09-13T18:01:52.057421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:36.894538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882243+0000","last_change":"2024-09-13T18:01:46.356279+0000","last_active":"2024-09-13T18:01:47.882243+0000","last_peered":"2024-09-13T18:01:47.882243+0000","last_clean":"2024-09-13T18:01:47.882243+0000","last_became_active":"2024-09-13T18:01:46.355954+0000","last_became_peered":"2024-09-13T18:01:46.355954+0000","last_unstale":"2024-09-13T18:01:47.882243+0000","last_undegraded":"2024-09-13T18:01:47.882243+0000","last_fullsized":"2024-09-13T18:01:47.882243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:30.595635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.054407+0000","last_change":"2024-09-13T18:01:45.903952+0000","last_active":"2024-09-13T18:01:52.054407+0000","last_peered":"2024-09-13T18:01:52.054407+0000","last_clean":"2024-09-13T18:01:52.054407+0000","last_became_active":"2024-09-13T18:01:45.903664+0000","last_became_peered":"2024-09-13T18:01:45.903664+0000","last_unstale":"2024-09-13T18:01:52.054407+0000","last_undegraded":"2024-09-13T18:01:52.054407+0000","last_fullsized":"2024-09-13T18:01:52.054407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:08.599379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315892+0000","last_change":"2024-09-13T18:01:46.343183+0000","last_active":"2024-09-13T18:01:47.315892+0000","last_peered":"2024-09-13T18:01:47.315892+0000","last_clean":"2024-09-13T18:01:47.315892+0000","last_became_active":"2024-09-13T18:01:46.342773+0000","last_became_peered":"2024-09-13T18:01:46.342773+0000","last_unstale":"2024-09-13T18:01:47.315892+0000","last_undegraded":"2024-09-13T18:01:47.315892+0000","last_fullsized":"2024-09-13T18:01:47.315892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:50.038027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.064127+0000","last_change":"2024-09-13T18:01:45.911889+0000","last_active":"2024-09-13T18:01:52.064127+0000","last_peered":"2024-09-13T18:01:52.064127+0000","last_clean":"2024-09-13T18:01:52.064127+0000","last_became_active":"2024-09-13T18:01:45.911418+0000","last_became_peered":"2024-09-13T18:01:45.911418+0000","last_unstale":"2024-09-13T18:01:52.064127+0000","last_undegraded":"2024-09-13T18:01:52.064127+0000","last_fullsized":"2024-09-13T18:01:52.064127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:05.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900773+0000","last_change":"2024-09-13T18:01:46.354364+0000","last_active":"2024-09-13T18:01:47.900773+0000","last_peered":"2024-09-13T18:01:47.900773+0000","last_clean":"2024-09-13T18:01:47.900773+0000","last_became_active":"2024-09-13T18:01:46.354026+0000","last_became_peered":"2024-09-13T18:01:46.354026+0000","last_unstale":"2024-09-13T18:01:47.900773+0000","last_undegraded":"2024-09-13T18:01:47.900773+0000","last_fullsized":"2024-09-13T18:01:47.900773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:51.375950+0000","last_change":"2024-09-13T18:01:45.901597+0000","last_active":"2024-09-13T18:01:51.375950+0000","last_peered":"2024-09-13T18:01:51.375950+0000","last_clean":"2024-09-13T18:01:51.375950+0000","last_became_active":"2024-09-13T18:01:45.901239+0000","last_became_peered":"2024-09-13T18:01:45.901239+0000","last_unstale":"2024-09-13T18:01:51.375950+0000","last_undegraded":"2024-09-13T18:01:51.375950+0000","last_fullsized":"2024-09-13T18:01:51.375950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:10.833206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315880+0000","last_change":"2024-09-13T18:01:46.351157+0000","last_active":"2024-09-13T18:01:47.315880+0000","last_peered":"2024-09-13T18:01:47.315880+0000","last_clean":"2024-09-13T18:01:47.315880+0000","last_became_active":"2024-09-13T18:01:46.350805+0000","last_became_peered":"2024-09-13T18:01:46.350805+0000","last_unstale":"2024-09-13T18:01:47.315880+0000","last_undegraded":"2024-09-13T18:01:47.315880+0000","last_fullsized":"2024-09-13T18:01:47.315880+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:15.680744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'13","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.063927+0000","last_change":"2024-09-13T18:01:45.898614+0000","last_active":"2024-09-13T18:01:52.063927+0000","last_peered":"2024-09-13T18:01:52.063927+0000","last_clean":"2024-09-13T18:01:52.063927+0000","last_became_active":"2024-09-13T18:01:45.898279+0000","last_became_peered":"2024-09-13T18:01:45.898279+0000","last_unstale":"2024-09-13T18:01:52.063927+0000","last_undegraded":"2024-09-13T18:01:52.063927+0000","last_fullsized":"2024-09-13T18:01:52.063927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:49.174143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8165,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882372+0000","last_change":"2024-09-13T18:01:46.340270+0000","last_active":"2024-09-13T18:01:47.882372+0000","last_peered":"2024-09-13T18:01:47.882372+0000","last_clean":"2024-09-13T18:01:47.882372+0000","last_became_active":"2024-09-13T18:01:46.339968+0000","last_became_peered":"2024-09-13T18:01:46.339968+0000","last_unstale":"2024-09-13T18:01:47.882372+0000","last_undegraded":"2024-09-13T18:01:47.882372+0000","last_fullsized":"2024-09-13T18:01:47.882372+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:42.070652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882782+0000","last_change":"2024-09-13T18:01:45.909336+0000","last_active":"2024-09-13T18:01:47.882782+0000","last_peered":"2024-09-13T18:01:47.882782+0000","last_clean":"2024-09-13T18:01:47.882782+0000","last_became_active":"2024-09-13T18:01:45.908956+0000","last_became_peered":"2024-09-13T18:01:45.908956+0000","last_unstale":"2024-09-13T18:01:47.882782+0000","last_undegraded":"2024-09-13T18:01:47.882782+0000","last_fullsized":"2024-09-13T18:01:47.882782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:29.327701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882114+0000","last_change":"2024-09-13T18:01:46.354627+0000","last_active":"2024-09-13T18:01:47.882114+0000","last_peered":"2024-09-13T18:01:47.882114+0000","last_clean":"2024-09-13T18:01:47.882114+0000","last_became_active":"2024-09-13T18:01:46.354318+0000","last_became_peered":"2024-09-13T18:01:46.354318+0000","last_unstale":"2024-09-13T18:01:47.882114+0000","last_undegraded":"2024-09-13T18:01:47.882114+0000","last_fullsized":"2024-09-13T18:01:47.882114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:55.814673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.064368+0000","last_change":"2024-09-13T18:01:45.909477+0000","last_active":"2024-09-13T18:01:52.064368+0000","last_peered":"2024-09-13T18:01:52.064368+0000","last_clean":"2024-09-13T18:01:52.064368+0000","last_became_active":"2024-09-13T18:01:45.909143+0000","last_became_peered":"2024-09-13T18:01:45.909143+0000","last_unstale":"2024-09-13T18:01:52.064368+0000","last_undegraded":"2024-09-13T18:01:52.064368+0000","last_fullsized":"2024-09-13T18:01:52.064368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:52.276839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329315+0000","last_change":"2024-09-13T18:01:46.351293+0000","last_active":"2024-09-13T18:01:47.329315+0000","last_peered":"2024-09-13T18:01:47.329315+0000","last_clean":"2024-09-13T18:01:47.329315+0000","last_became_active":"2024-09-13T18:01:46.350980+0000","last_became_peered":"2024-09-13T18:01:46.350980+0000","last_unstale":"2024-09-13T18:01:47.329315+0000","last_undegraded":"2024-09-13T18:01:47.329315+0000","last_fullsized":"2024-09-13T18:01:47.329315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:20.656282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:51.373920+0000","last_change":"2024-09-13T18:01:45.905434+0000","last_active":"2024-09-13T18:01:51.373920+0000","last_peered":"2024-09-13T18:01:51.373920+0000","last_clean":"2024-09-13T18:01:51.373920+0000","last_became_active":"2024-09-13T18:01:45.904719+0000","last_became_peered":"2024-09-13T18:01:45.904719+0000","last_unstale":"2024-09-13T18:01:51.373920+0000","last_undegraded":"2024-09-13T18:01:51.373920+0000","last_fullsized":"2024-09-13T18:01:51.373920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:43.949977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329122+0000","last_change":"2024-09-13T18:01:46.348191+0000","last_active":"2024-09-13T18:01:47.329122+0000","last_peered":"2024-09-13T18:01:47.329122+0000","last_clean":"2024-09-13T18:01:47.329122+0000","last_became_active":"2024-09-13T18:01:46.347886+0000","last_became_peered":"2024-09-13T18:01:46.347886+0000","last_unstale":"2024-09-13T18:01:47.329122+0000","last_undegraded":"2024-09-13T18:01:47.329122+0000","last_fullsized":"2024-09-13T18:01:47.329122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:40.986385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.052888+0000","last_change":"2024-09-13T18:01:45.904429+0000","last_active":"2024-09-13T18:01:52.052888+0000","last_peered":"2024-09-13T18:01:52.052888+0000","last_clean":"2024-09-13T18:01:52.052888+0000","last_became_active":"2024-09-13T18:01:45.904134+0000","last_became_peered":"2024-09-13T18:01:45.904134+0000","last_unstale":"2024-09-13T18:01:52.052888+0000","last_undegraded":"2024-09-13T18:01:52.052888+0000","last_fullsized":"2024-09-13T18:01:52.052888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:54.073044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.327305+0000","last_change":"2024-09-13T18:01:46.350725+0000","last_active":"2024-09-13T18:01:47.327305+0000","last_peered":"2024-09-13T18:01:47.327305+0000","last_clean":"2024-09-13T18:01:47.327305+0000","last_became_active":"2024-09-13T18:01:46.350061+0000","last_became_peered":"2024-09-13T18:01:46.350061+0000","last_unstale":"2024-09-13T18:01:47.327305+0000","last_undegraded":"2024-09-13T18:01:47.327305+0000","last_fullsized":"2024-09-13T18:01:47.327305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:09.649534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.052782+0000","last_change":"2024-09-13T18:01:45.903251+0000","last_active":"2024-09-13T18:01:52.052782+0000","last_peered":"2024-09-13T18:01:52.052782+0000","last_clean":"2024-09-13T18:01:52.052782+0000","last_became_active":"2024-09-13T18:01:45.901593+0000","last_became_peered":"2024-09-13T18:01:45.901593+0000","last_unstale":"2024-09-13T18:01:52.052782+0000","last_undegraded":"2024-09-13T18:01:52.052782+0000","last_fullsized":"2024-09-13T18:01:52.052782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.197806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109691+0000","last_change":"2024-09-13T18:01:46.351524+0000","last_active":"2024-09-13T18:01:47.109691+0000","last_peered":"2024-09-13T18:01:47.109691+0000","last_clean":"2024-09-13T18:01:47.109691+0000","last_became_active":"2024-09-13T18:01:46.351136+0000","last_became_peered":"2024-09-13T18:01:46.351136+0000","last_unstale":"2024-09-13T18:01:47.109691+0000","last_undegraded":"2024-09-13T18:01:47.109691+0000","last_fullsized":"2024-09-13T18:01:47.109691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:39.639592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.063396+0000","last_change":"2024-09-13T18:01:45.914866+0000","last_active":"2024-09-13T18:01:52.063396+0000","last_peered":"2024-09-13T18:01:52.063396+0000","last_clean":"2024-09-13T18:01:52.063396+0000","last_became_active":"2024-09-13T18:01:45.914549+0000","last_became_peered":"2024-09-13T18:01:45.914549+0000","last_unstale":"2024-09-13T18:01:52.063396+0000","last_undegraded":"2024-09-13T18:01:52.063396+0000","last_fullsized":"2024-09-13T18:01:52.063396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:46.789559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329752+0000","last_change":"2024-09-13T18:01:46.342386+0000","last_active":"2024-09-13T18:01:47.329752+0000","last_peered":"2024-09-13T18:01:47.329752+0000","last_clean":"2024-09-13T18:01:47.329752+0000","last_became_active":"2024-09-13T18:01:46.342086+0000","last_became_peered":"2024-09-13T18:01:46.342086+0000","last_unstale":"2024-09-13T18:01:47.329752+0000","last_undegraded":"2024-09-13T18:01:47.329752+0000","last_fullsized":"2024-09-13T18:01:47.329752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:44.379756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.052810+0000","last_change":"2024-09-13T18:01:45.909247+0000","last_active":"2024-09-13T18:01:52.052810+0000","last_peered":"2024-09-13T18:01:52.052810+0000","last_clean":"2024-09-13T18:01:52.052810+0000","last_became_active":"2024-09-13T18:01:45.908930+0000","last_became_peered":"2024-09-13T18:01:45.908930+0000","last_unstale":"2024-09-13T18:01:52.052810+0000","last_undegraded":"2024-09-13T18:01:52.052810+0000","last_fullsized":"2024-09-13T18:01:52.052810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:46.433561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329552+0000","last_change":"2024-09-13T18:01:46.358240+0000","last_active":"2024-09-13T18:01:47.329552+0000","last_peered":"2024-09-13T18:01:47.329552+0000","last_clean":"2024-09-13T18:01:47.329552+0000","last_became_active":"2024-09-13T18:01:46.357893+0000","last_became_peered":"2024-09-13T18:01:46.357893+0000","last_unstale":"2024-09-13T18:01:47.329552+0000","last_undegraded":"2024-09-13T18:01:47.329552+0000","last_fullsized":"2024-09-13T18:01:47.329552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:41.725958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882640+0000","last_change":"2024-09-13T18:01:45.906743+0000","last_active":"2024-09-13T18:01:47.882640+0000","last_peered":"2024-09-13T18:01:47.882640+0000","last_clean":"2024-09-13T18:01:47.882640+0000","last_became_active":"2024-09-13T18:01:45.906149+0000","last_became_peered":"2024-09-13T18:01:45.906149+0000","last_unstale":"2024-09-13T18:01:47.882640+0000","last_undegraded":"2024-09-13T18:01:47.882640+0000","last_fullsized":"2024-09-13T18:01:47.882640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:36.609259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329685+0000","last_change":"2024-09-13T18:01:46.343336+0000","last_active":"2024-09-13T18:01:47.329685+0000","last_peered":"2024-09-13T18:01:47.329685+0000","last_clean":"2024-09-13T18:01:47.329685+0000","last_became_active":"2024-09-13T18:01:46.342941+0000","last_became_peered":"2024-09-13T18:01:46.342941+0000","last_unstale":"2024-09-13T18:01:47.329685+0000","last_undegraded":"2024-09-13T18:01:47.329685+0000","last_fullsized":"2024-09-13T18:01:47.329685+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:13.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":329,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:46.334343+0000","last_change":"2024-09-13T18:00:36.038635+0000","last_active":"2024-09-13T18:01:46.334343+0000","last_peered":"2024-09-13T18:01:46.334343+0000","last_clean":"2024-09-13T18:01:46.334343+0000","last_became_active":"2024-09-13T18:00:36.038227+0000","last_became_peered":"2024-09-13T18:00:36.038227+0000","last_unstale":"2024-09-13T18:01:46.334343+0000","last_undegraded":"2024-09-13T18:01:46.334343+0000","last_fullsized":"2024-09-13T18:01:46.334343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:57:10.088656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:57:10.088656+0000","last_clean_scrub_stamp":"2024-09-13T17:57:10.088656+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:54.824216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:51.374286+0000","last_change":"2024-09-13T18:01:45.901622+0000","last_active":"2024-09-13T18:01:51.374286+0000","last_peered":"2024-09-13T18:01:51.374286+0000","last_clean":"2024-09-13T18:01:51.374286+0000","last_became_active":"2024-09-13T18:01:45.901212+0000","last_became_peered":"2024-09-13T18:01:45.901212+0000","last_unstale":"2024-09-13T18:01:51.374286+0000","last_undegraded":"2024-09-13T18:01:51.374286+0000","last_fullsized":"2024-09-13T18:01:51.374286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:57.417769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326246+0000","last_change":"2024-09-13T18:01:46.351439+0000","last_active":"2024-09-13T18:01:47.326246+0000","last_peered":"2024-09-13T18:01:47.326246+0000","last_clean":"2024-09-13T18:01:47.326246+0000","last_became_active":"2024-09-13T18:01:46.350801+0000","last_became_peered":"2024-09-13T18:01:46.350801+0000","last_unstale":"2024-09-13T18:01:47.326246+0000","last_undegraded":"2024-09-13T18:01:47.326246+0000","last_fullsized":"2024-09-13T18:01:47.326246+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:32.407058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:50.367634+0000","last_change":"2024-09-13T18:01:45.907122+0000","last_active":"2024-09-13T18:01:50.367634+0000","last_peered":"2024-09-13T18:01:50.367634+0000","last_clean":"2024-09-13T18:01:50.367634+0000","last_became_active":"2024-09-13T18:01:45.906741+0000","last_became_peered":"2024-09-13T18:01:45.906741+0000","last_unstale":"2024-09-13T18:01:50.367634+0000","last_undegraded":"2024-09-13T18:01:50.367634+0000","last_fullsized":"2024-09-13T18:01:50.367634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:09.242844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882036+0000","last_change":"2024-09-13T18:01:46.341715+0000","last_active":"2024-09-13T18:01:47.882036+0000","last_peered":"2024-09-13T18:01:47.882036+0000","last_clean":"2024-09-13T18:01:47.882036+0000","last_became_active":"2024-09-13T18:01:46.340930+0000","last_became_peered":"2024-09-13T18:01:46.340930+0000","last_unstale":"2024-09-13T18:01:47.882036+0000","last_undegraded":"2024-09-13T18:01:47.882036+0000","last_fullsized":"2024-09-13T18:01:47.882036+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:02.050831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:53.058925+0000","last_change":"2024-09-13T18:01:45.918611+0000","last_active":"2024-09-13T18:01:53.058925+0000","last_peered":"2024-09-13T18:01:53.058925+0000","last_clean":"2024-09-13T18:01:53.058925+0000","last_became_active":"2024-09-13T18:01:45.916885+0000","last_became_peered":"2024-09-13T18:01:45.916885+0000","last_unstale":"2024-09-13T18:01:53.058925+0000","last_undegraded":"2024-09-13T18:01:53.058925+0000","last_fullsized":"2024-09-13T18:01:53.058925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:59.917562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.327082+0000","last_change":"2024-09-13T18:01:46.350526+0000","last_active":"2024-09-13T18:01:47.327082+0000","last_peered":"2024-09-13T18:01:47.327082+0000","last_clean":"2024-09-13T18:01:47.327082+0000","last_became_active":"2024-09-13T18:01:46.350065+0000","last_became_peered":"2024-09-13T18:01:46.350065+0000","last_unstale":"2024-09-13T18:01:47.327082+0000","last_undegraded":"2024-09-13T18:01:47.327082+0000","last_fullsized":"2024-09-13T18:01:47.327082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:43.573806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.064425+0000","last_change":"2024-09-13T18:01:45.911811+0000","last_active":"2024-09-13T18:01:52.064425+0000","last_peered":"2024-09-13T18:01:52.064425+0000","last_clean":"2024-09-13T18:01:52.064425+0000","last_became_active":"2024-09-13T18:01:45.911086+0000","last_became_peered":"2024-09-13T18:01:45.911086+0000","last_unstale":"2024-09-13T18:01:52.064425+0000","last_undegraded":"2024-09-13T18:01:52.064425+0000","last_fullsized":"2024-09-13T18:01:52.064425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:31.743257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.187452+0000","last_change":"2024-09-13T18:01:46.349538+0000","last_active":"2024-09-13T18:01:47.187452+0000","last_peered":"2024-09-13T18:01:47.187452+0000","last_clean":"2024-09-13T18:01:47.187452+0000","last_became_active":"2024-09-13T18:01:46.349241+0000","last_became_peered":"2024-09-13T18:01:46.349241+0000","last_unstale":"2024-09-13T18:01:47.187452+0000","last_undegraded":"2024-09-13T18:01:47.187452+0000","last_fullsized":"2024-09-13T18:01:47.187452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:49.245551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882614+0000","last_change":"2024-09-13T18:01:45.912239+0000","last_active":"2024-09-13T18:01:47.882614+0000","last_peered":"2024-09-13T18:01:47.882614+0000","last_clean":"2024-09-13T18:01:47.882614+0000","last_became_active":"2024-09-13T18:01:45.911898+0000","last_became_peered":"2024-09-13T18:01:45.911898+0000","last_unstale":"2024-09-13T18:01:47.882614+0000","last_undegraded":"2024-09-13T18:01:47.882614+0000","last_fullsized":"2024-09-13T18:01:47.882614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.473369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.187500+0000","last_change":"2024-09-13T18:01:46.353872+0000","last_active":"2024-09-13T18:01:47.187500+0000","last_peered":"2024-09-13T18:01:47.187500+0000","last_clean":"2024-09-13T18:01:47.187500+0000","last_became_active":"2024-09-13T18:01:46.353253+0000","last_became_peered":"2024-09-13T18:01:46.353253+0000","last_unstale":"2024-09-13T18:01:47.187500+0000","last_undegraded":"2024-09-13T18:01:47.187500+0000","last_fullsized":"2024-09-13T18:01:47.187500+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:11.247278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.053530+0000","last_change":"2024-09-13T18:01:45.911329+0000","last_active":"2024-09-13T18:01:52.053530+0000","last_peered":"2024-09-13T18:01:52.053530+0000","last_clean":"2024-09-13T18:01:52.053530+0000","last_became_active":"2024-09-13T18:01:45.911036+0000","last_became_peered":"2024-09-13T18:01:45.911036+0000","last_unstale":"2024-09-13T18:01:52.053530+0000","last_undegraded":"2024-09-13T18:01:52.053530+0000","last_fullsized":"2024-09-13T18:01:52.053530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:17.661879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882322+0000","last_change":"2024-09-13T18:01:46.341156+0000","last_active":"2024-09-13T18:01:47.882322+0000","last_peered":"2024-09-13T18:01:47.882322+0000","last_clean":"2024-09-13T18:01:47.882322+0000","last_became_active":"2024-09-13T18:01:46.340770+0000","last_became_peered":"2024-09-13T18:01:46.340770+0000","last_unstale":"2024-09-13T18:01:47.882322+0000","last_undegraded":"2024-09-13T18:01:47.882322+0000","last_fullsized":"2024-09-13T18:01:47.882322+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:27.782016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882737+0000","last_change":"2024-09-13T18:01:45.910311+0000","last_active":"2024-09-13T18:01:47.882737+0000","last_peered":"2024-09-13T18:01:47.882737+0000","last_clean":"2024-09-13T18:01:47.882737+0000","last_became_active":"2024-09-13T18:01:45.909959+0000","last_became_peered":"2024-09-13T18:01:45.909959+0000","last_unstale":"2024-09-13T18:01:47.882737+0000","last_undegraded":"2024-09-13T18:01:47.882737+0000","last_fullsized":"2024-09-13T18:01:47.882737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:58.840803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326709+0000","last_change":"2024-09-13T18:01:46.354213+0000","last_active":"2024-09-13T18:01:47.326709+0000","last_peered":"2024-09-13T18:01:47.326709+0000","last_clean":"2024-09-13T18:01:47.326709+0000","last_became_active":"2024-09-13T18:01:46.353381+0000","last_became_peered":"2024-09-13T18:01:46.353381+0000","last_unstale":"2024-09-13T18:01:47.326709+0000","last_undegraded":"2024-09-13T18:01:47.326709+0000","last_fullsized":"2024-09-13T18:01:47.326709+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:17.236617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:49.356658+0000","last_change":"2024-09-13T18:01:45.915203+0000","last_active":"2024-09-13T18:01:49.356658+0000","last_peered":"2024-09-13T18:01:49.356658+0000","last_clean":"2024-09-13T18:01:49.356658+0000","last_became_active":"2024-09-13T18:01:45.914901+0000","last_became_peered":"2024-09-13T18:01:45.914901+0000","last_unstale":"2024-09-13T18:01:49.356658+0000","last_undegraded":"2024-09-13T18:01:49.356658+0000","last_fullsized":"2024-09-13T18:01:49.356658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:52.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900655+0000","last_change":"2024-09-13T18:01:46.351561+0000","last_active":"2024-09-13T18:01:47.900655+0000","last_peered":"2024-09-13T18:01:47.900655+0000","last_clean":"2024-09-13T18:01:47.900655+0000","last_became_active":"2024-09-13T18:01:46.351245+0000","last_became_peered":"2024-09-13T18:01:46.351245+0000","last_unstale":"2024-09-13T18:01:47.900655+0000","last_undegraded":"2024-09-13T18:01:47.900655+0000","last_fullsized":"2024-09-13T18:01:47.900655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:16.878552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:49.357037+0000","last_change":"2024-09-13T18:01:45.904200+0000","last_active":"2024-09-13T18:01:49.357037+0000","last_peered":"2024-09-13T18:01:49.357037+0000","last_clean":"2024-09-13T18:01:49.357037+0000","last_became_active":"2024-09-13T18:01:45.903139+0000","last_became_peered":"2024-09-13T18:01:45.903139+0000","last_unstale":"2024-09-13T18:01:49.357037+0000","last_undegraded":"2024-09-13T18:01:49.357037+0000","last_fullsized":"2024-09-13T18:01:49.357037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:19.104048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.881791+0000","last_change":"2024-09-13T18:01:46.339384+0000","last_active":"2024-09-13T18:01:47.881791+0000","last_peered":"2024-09-13T18:01:47.881791+0000","last_clean":"2024-09-13T18:01:47.881791+0000","last_became_active":"2024-09-13T18:01:46.338962+0000","last_became_peered":"2024-09-13T18:01:46.338962+0000","last_unstale":"2024-09-13T18:01:47.881791+0000","last_undegraded":"2024-09-13T18:01:47.881791+0000","last_fullsized":"2024-09-13T18:01:47.881791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:09.452756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.063275+0000","last_change":"2024-09-13T18:01:45.907717+0000","last_active":"2024-09-13T18:01:52.063275+0000","last_peered":"2024-09-13T18:01:52.063275+0000","last_clean":"2024-09-13T18:01:52.063275+0000","last_became_active":"2024-09-13T18:01:45.907022+0000","last_became_peered":"2024-09-13T18:01:45.907022+0000","last_unstale":"2024-09-13T18:01:52.063275+0000","last_undegraded":"2024-09-13T18:01:52.063275+0000","last_fullsized":"2024-09-13T18:01:52.063275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:16.800561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109645+0000","last_change":"2024-09-13T18:01:46.341053+0000","last_active":"2024-09-13T18:01:47.109645+0000","last_peered":"2024-09-13T18:01:47.109645+0000","last_clean":"2024-09-13T18:01:47.109645+0000","last_became_active":"2024-09-13T18:01:46.340729+0000","last_became_peered":"2024-09-13T18:01:46.340729+0000","last_unstale":"2024-09-13T18:01:47.109645+0000","last_undegraded":"2024-09-13T18:01:47.109645+0000","last_fullsized":"2024-09-13T18:01:47.109645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:10.585837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882370+0000","last_change":"2024-09-13T18:01:45.908841+0000","last_active":"2024-09-13T18:01:47.882370+0000","last_peered":"2024-09-13T18:01:47.882370+0000","last_clean":"2024-09-13T18:01:47.882370+0000","last_became_active":"2024-09-13T18:01:45.907809+0000","last_became_peered":"2024-09-13T18:01:45.907809+0000","last_unstale":"2024-09-13T18:01:47.882370+0000","last_undegraded":"2024-09-13T18:01:47.882370+0000","last_fullsized":"2024-09-13T18:01:47.882370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:28.830672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326491+0000","last_change":"2024-09-13T18:01:46.351532+0000","last_active":"2024-09-13T18:01:47.326491+0000","last_peered":"2024-09-13T18:01:47.326491+0000","last_clean":"2024-09-13T18:01:47.326491+0000","last_became_active":"2024-09-13T18:01:46.350476+0000","last_became_peered":"2024-09-13T18:01:46.350476+0000","last_unstale":"2024-09-13T18:01:47.326491+0000","last_undegraded":"2024-09-13T18:01:47.326491+0000","last_fullsized":"2024-09-13T18:01:47.326491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:30.558987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:49.356264+0000","last_change":"2024-09-13T18:01:45.909496+0000","last_active":"2024-09-13T18:01:49.356264+0000","last_peered":"2024-09-13T18:01:49.356264+0000","last_clean":"2024-09-13T18:01:49.356264+0000","last_became_active":"2024-09-13T18:01:45.906362+0000","last_became_peered":"2024-09-13T18:01:45.906362+0000","last_unstale":"2024-09-13T18:01:49.356264+0000","last_undegraded":"2024-09-13T18:01:49.356264+0000","last_fullsized":"2024-09-13T18:01:49.356264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:00.508637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329303+0000","last_change":"2024-09-13T18:01:46.344087+0000","last_active":"2024-09-13T18:01:47.329303+0000","last_peered":"2024-09-13T18:01:47.329303+0000","last_clean":"2024-09-13T18:01:47.329303+0000","last_became_active":"2024-09-13T18:01:46.343801+0000","last_became_peered":"2024-09-13T18:01:46.343801+0000","last_unstale":"2024-09-13T18:01:47.329303+0000","last_undegraded":"2024-09-13T18:01:47.329303+0000","last_fullsized":"2024-09-13T18:01:47.329303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:11.305588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.327366+0000","last_change":"2024-09-13T18:01:46.350596+0000","last_active":"2024-09-13T18:01:47.327366+0000","last_peered":"2024-09-13T18:01:47.327366+0000","last_clean":"2024-09-13T18:01:47.327366+0000","last_became_active":"2024-09-13T18:01:46.350171+0000","last_became_peered":"2024-09-13T18:01:46.350171+0000","last_unstale":"2024-09-13T18:01:47.327366+0000","last_undegraded":"2024-09-13T18:01:47.327366+0000","last_fullsized":"2024-09-13T18:01:47.327366+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:53.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.064923+0000","last_change":"2024-09-13T18:01:45.904016+0000","last_active":"2024-09-13T18:01:52.064923+0000","last_peered":"2024-09-13T18:01:52.064923+0000","last_clean":"2024-09-13T18:01:52.064923+0000","last_became_active":"2024-09-13T18:01:45.903446+0000","last_became_peered":"2024-09-13T18:01:45.903446+0000","last_unstale":"2024-09-13T18:01:52.064923+0000","last_undegraded":"2024-09-13T18:01:52.064923+0000","last_fullsized":"2024-09-13T18:01:52.064923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:57.308647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315855+0000","last_change":"2024-09-13T18:01:46.341346+0000","last_active":"2024-09-13T18:01:47.315855+0000","last_peered":"2024-09-13T18:01:47.315855+0000","last_clean":"2024-09-13T18:01:47.315855+0000","last_became_active":"2024-09-13T18:01:46.340969+0000","last_became_peered":"2024-09-13T18:01:46.340969+0000","last_unstale":"2024-09-13T18:01:47.315855+0000","last_undegraded":"2024-09-13T18:01:47.315855+0000","last_fullsized":"2024-09-13T18:01:47.315855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:17.664968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.065405+0000","last_change":"2024-09-13T18:01:45.906196+0000","last_active":"2024-09-13T18:01:52.065405+0000","last_peered":"2024-09-13T18:01:52.065405+0000","last_clean":"2024-09-13T18:01:52.065405+0000","last_became_active":"2024-09-13T18:01:45.905867+0000","last_became_peered":"2024-09-13T18:01:45.905867+0000","last_unstale":"2024-09-13T18:01:52.065405+0000","last_undegraded":"2024-09-13T18:01:52.065405+0000","last_fullsized":"2024-09-13T18:01:52.065405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:06.525027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900699+0000","last_change":"2024-09-13T18:01:46.342392+0000","last_active":"2024-09-13T18:01:47.900699+0000","last_peered":"2024-09-13T18:01:47.900699+0000","last_clean":"2024-09-13T18:01:47.900699+0000","last_became_active":"2024-09-13T18:01:46.341822+0000","last_became_peered":"2024-09-13T18:01:46.341822+0000","last_unstale":"2024-09-13T18:01:47.900699+0000","last_undegraded":"2024-09-13T18:01:47.900699+0000","last_fullsized":"2024-09-13T18:01:47.900699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:13.008898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.928354+0000","last_change":"2024-09-13T18:01:45.907263+0000","last_active":"2024-09-13T18:01:47.928354+0000","last_peered":"2024-09-13T18:01:47.928354+0000","last_clean":"2024-09-13T18:01:47.928354+0000","last_became_active":"2024-09-13T18:01:45.906956+0000","last_became_peered":"2024-09-13T18:01:45.906956+0000","last_unstale":"2024-09-13T18:01:47.928354+0000","last_undegraded":"2024-09-13T18:01:47.928354+0000","last_fullsized":"2024-09-13T18:01:47.928354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:49.474806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326701+0000","last_change":"2024-09-13T18:01:46.350698+0000","last_active":"2024-09-13T18:01:47.326701+0000","last_peered":"2024-09-13T18:01:47.326701+0000","last_clean":"2024-09-13T18:01:47.326701+0000","last_became_active":"2024-09-13T18:01:46.348569+0000","last_became_peered":"2024-09-13T18:01:46.348569+0000","last_unstale":"2024-09-13T18:01:47.326701+0000","last_undegraded":"2024-09-13T18:01:47.326701+0000","last_fullsized":"2024-09-13T18:01:47.326701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:21.104362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882702+0000","last_change":"2024-09-13T18:01:45.911508+0000","last_active":"2024-09-13T18:01:47.882702+0000","last_peered":"2024-09-13T18:01:47.882702+0000","last_clean":"2024-09-13T18:01:47.882702+0000","last_became_active":"2024-09-13T18:01:45.910098+0000","last_became_peered":"2024-09-13T18:01:45.910098+0000","last_unstale":"2024-09-13T18:01:47.882702+0000","last_undegraded":"2024-09-13T18:01:47.882702+0000","last_fullsized":"2024-09-13T18:01:47.882702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:36.875831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":13507,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":33516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350989,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":442521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":10,"up_from":73,"seq":313532612625,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1035917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.32800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.70499999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.499},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45100000000000001}]},{"osd":8,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61599999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.58699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":9,"up_from":68,"seq":292057776150,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":925696,"data_stored":442521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58499999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.84299999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.91000000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.88300000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.96199999999999997}]}]},{"osd":8,"up_from":60,"seq":257698037789,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":443439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69999999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79900000000000004,"5min":0.875,"15min":0.875},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.501,"15min":0.502},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63300000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.499},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.72999999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61099999999999999,"15min":0.622},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76200000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.752,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76800000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72699999999999998,"5min":1.016,"15min":1.016},"last":0.372}]},{"osd":6,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.78800000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53900000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86699999999999999,"5min":1.05,"15min":1.05},"last":0.59299999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64100000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":7,"up_from":52,"seq":223338299425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32624,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712528,"statfs":{"total":95995035648,"available":95961628672,"internally_reserved":0,"allocated":1548288,"data_stored":1035697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.41299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56599999999999995,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41799999999999998,"15min":0.42199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55900000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.30499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.307}]},{"osd":5,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.48799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":0.874,"15min":0.874},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77600000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66400000000000003,"15min":0.65800000000000003},"min":{"1min":0.439,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.504}]},{"osd":8,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63500000000000001,"15min":0.63200000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.48999999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70099999999999996}]},{"osd":9,"last update":"Fri Sep 13 18:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.57399999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:01:33 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.437}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":442340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.68500000000000005,"15min":0.67400000000000004},"min":{"1min":0.47799999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.52200000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.437},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.752,"15min":0.746},"min":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.39400000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.78600000000000003,"15min":0.77600000000000002},"min":{"1min":0.501,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79000000000000004,"15min":0.78500000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83199999999999996,"15min":0.83699999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.073,"5min":1.706,"15min":1.706},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82999999999999996,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1839999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.78200000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.61399999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.631,"15min":1.631},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.875,"15min":0.88300000000000001},"min":{"1min":0.621,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0029999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.88300000000000001}]},{"osd":9,"last update":"Fri Sep 13 18:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.89900000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.82399999999999995}]}]},{"osd":5,"up_from":39,"seq":167503724588,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32632,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712520,"statfs":{"total":95995035648,"available":95961620480,"internally_reserved":0,"allocated":1556480,"data_stored":1035140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77300000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69499999999999995,"5min":0.745,"15min":0.745},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67400000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36599999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.442}]},{"osd":3,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.749,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70499999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:00:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.143,"15min":1.2230000000000001},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88800000000000001,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64300000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47399999999999998,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32800000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71499999999999997}]},{"osd":10,"last update":"Fri Sep 13 18:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69299999999999995}]}]},{"osd":4,"up_from":34,"seq":146028888113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":937984,"data_stored":442557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.47099999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74299999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.51400000000000001,"15min":0.48899999999999999},"min":{"1min":0.38300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.48599999999999999,"5min":0.499,"15min":0.499},"last":0.38},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.48899999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73299999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.51000000000000001},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91400000000000003,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.62}]},{"osd":5,"last update":"Fri Sep 13 18:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.77400000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68500000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44900000000000001,"15min":0.45000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68700000000000006,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42599999999999999}]},{"osd":8,"last update":"Fri Sep 13 18:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82499999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.625},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76400000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59399999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.75700000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:01:36 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149749,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":950272,"data_stored":442155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.45200000000000001,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45300000000000001,"15min":0.41499999999999998},"min":{"1min":0.34200000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.372}]},{"osd":1,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.59199999999999997,"15min":0.54800000000000004},"min":{"1min":0.45000000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.62,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96699999999999997,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63900000000000001,"15min":0.60499999999999998},"min":{"1min":0.49399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.63700000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94999999999999996,"5min":6.8520000000000003,"15min":6.8520000000000003},"last":0.627}]},{"osd":4,"last update":"Fri Sep 13 18:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.56899999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90200000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.502},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69299999999999995,"15min":0.67600000000000005},"min":{"1min":0.48799999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98399999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.61699999999999999,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.752}]},{"osd":7,"last update":"Fri Sep 13 18:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.71099999999999997,"15min":0.69299999999999995},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.88300000000000001}]},{"osd":8,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0580000000000001,"5min":1.421,"15min":1.421},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.115,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.80200000000000005}]},{"osd":9,"last update":"Fri Sep 13 18:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.45800000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.93899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":443537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.52900000000000003,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.48999999999999999},"min":{"1min":0.42499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.499},"min":{"1min":0.42599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59899999999999998,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71499999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.506,"5min":0.72499999999999998,"15min":0.59699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":14.991,"5min":14.991,"15min":14.991},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.38200000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.315},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.33700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:00:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.443}]},{"osd":8,"last update":"Fri Sep 13 18:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.374},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.38600000000000001}]},{"osd":9,"last update":"Fri Sep 13 18:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.499}]},{"osd":10,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":451535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:00:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":0.61599999999999999,"15min":0.54200000000000004},"min":{"1min":0.33000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":10.179,"5min":10.179,"15min":10.179},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.101,"5min":0.63400000000000001,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.117000000000001,"5min":10.117000000000001,"15min":10.117000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58199999999999996,"15min":0.49199999999999999},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73099999999999998,"5min":8.593,"15min":8.593},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.498,"15min":0.47299999999999998},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:01:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.45700000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89200000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.373},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.66800000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86399999999999999,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56499999999999995,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:00:57 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":0.70899999999999996,"15min":0.63500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":10.161,"5min":10.161,"15min":10.161},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 18:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.502,"15min":0.49399999999999999},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51800000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.93799999999999994,"15min":1.0009999999999999},"min":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80800000000000005,"5min":10.141,"15min":10.141},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.435,"15min":0.435},"max":{"1min":0.96699999999999997,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.69699999999999995}]},{"osd":9,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.63900000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.499},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36120,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709032,"statfs":{"total":95995035648,"available":95958048768,"internally_reserved":0,"allocated":929792,"data_stored":442360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.875},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:01:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77700000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60099999999999998,"15min":0.57799999999999996},"min":{"1min":0.442,"5min":0.373,"15min":0.373},"max":{"1min":0.90100000000000002,"5min":1.012,"15min":1.012},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52500000000000002,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.55200000000000005,"15min":0.51600000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.63700000000000001,"15min":0.61099999999999999},"min":{"1min":0.46000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.99199999999999999,"5min":1.016,"15min":1.016},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.64100000000000001,"15min":0.61099999999999999},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92100000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:00:58 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.746,"15min":0.72899999999999998},"min":{"1min":0.56399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79400000000000004,"15min":0.78200000000000003},"min":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.73299999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.876,"15min":0.89200000000000002},"min":{"1min":0.56499999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97199999999999998,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.58199999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95399999999999996,"5min":1.04,"15min":1.04},"last":0.72899999999999998}]},{"osd":9,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.82099999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.93300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":9869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":9853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:01:54.965 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:01:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.157+0000 7fa720c00640 1 -- 172.21.15.27:0/4027805210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c103960 msgr2=0x7fa71c10a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.157+0000 7fa720c00640 1 --2- 172.21.15.27:0/4027805210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c103960 0x7fa71c10a1f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa714009ca0 tx=0x7fa71402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.158+0000 7fa720c00640 1 -- 172.21.15.27:0/4027805210 shutdown_connections 2024-09-13T18:01:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.158+0000 7fa720c00640 1 --2- 172.21.15.27:0/4027805210 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c103960 0x7fa71c10a1f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.158+0000 7fa720c00640 1 --2- 172.21.15.27:0/4027805210 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71c102fa0 0x7fa71c103420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.158+0000 7fa720c00640 1 --2- 172.21.15.27:0/4027805210 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa71c101db0 0x7fa71c1021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.158+0000 7fa720c00640 1 -- 172.21.15.27:0/4027805210 >> 172.21.15.27:0/4027805210 conn(0x7fa71c0fd530 msgr2=0x7fa71c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.158+0000 7fa720c00640 1 -- 172.21.15.27:0/4027805210 shutdown_connections 2024-09-13T18:01:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.158+0000 7fa720c00640 1 -- 172.21.15.27:0/4027805210 wait complete. 2024-09-13T18:01:55.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.158+0000 7fa720c00640 1 Processor -- start 2024-09-13T18:01:55.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa720c00640 1 -- start start 2024-09-13T18:01:55.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa720c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c101db0 0x7fa71c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:55.162 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa720c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71c102fa0 0x7fa71c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa720c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa71c103960 0x7fa71c19f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa720c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c19f940 con 0x7fa71c101db0 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa720c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c19fab0 con 0x7fa71c103960 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa720c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c19fc70 con 0x7fa71c102fa0 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa71b400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c101db0 0x7fa71c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa71b400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c101db0 0x7fa71c197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51170/0 (socket says 172.21.15.27:51170) 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa71b400640 1 -- 172.21.15.27:0/2473141418 learned_addr learned my addr 172.21.15.27:0/2473141418 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa71be00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa71c103960 0x7fa71c19f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.159+0000 7fa712a00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71c102fa0 0x7fa71c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa71b400640 1 -- 172.21.15.27:0/2473141418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71c102fa0 msgr2=0x7fa71c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa71b400640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71c102fa0 0x7fa71c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa71b400640 1 -- 172.21.15.27:0/2473141418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa71c103960 msgr2=0x7fa71c19f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:55.163 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa71b400640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa71c103960 0x7fa71c19f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa71b400640 1 -- 172.21.15.27:0/2473141418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa714009900 con 0x7fa71c101db0 2024-09-13T18:01:55.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa71b400640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c101db0 0x7fa71c197ea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00e9c0 tx=0x7fa70c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:55.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa718c00640 1 -- 172.21.15.27:0/2473141418 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c009700 con 0x7fa71c101db0 2024-09-13T18:01:55.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa718c00640 1 -- 172.21.15.27:0/2473141418 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa70c00cd80 con 0x7fa71c101db0 2024-09-13T18:01:55.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa718c00640 1 -- 172.21.15.27:0/2473141418 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c010430 con 0x7fa71c101db0 2024-09-13T18:01:55.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c19ff50 con 0x7fa71c101db0 2024-09-13T18:01:55.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.160+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c1a0320 con 0x7fa71c101db0 2024-09-13T18:01:55.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.161+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c1021b0 con 0x7fa71c101db0 2024-09-13T18:01:55.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.163+0000 7fa718c00640 1 -- 172.21.15.27:0/2473141418 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa70c003680 con 0x7fa71c101db0 2024-09-13T18:01:55.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.164+0000 7fa718c00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa7000a11a0 0x7fa7000a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:55.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.165+0000 7fa718c00640 1 -- 172.21.15.27:0/2473141418 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa70c014070 con 0x7fa71c101db0 2024-09-13T18:01:55.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.165+0000 7fa712a00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa7000a11a0 0x7fa7000a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:55.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.165+0000 7fa712a00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa7000a11a0 0x7fa7000a3660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa71c199360 tx=0x7fa704005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:55.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.168+0000 7fa718c00640 1 -- 172.21.15.27:0/2473141418 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa70c096490 con 0x7fa71c101db0 2024-09-13T18:01:55.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:55 smithi027 ceph-mon[30611]: pgmap v295: 97 pgs: 97 active+clean; 590 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 8.8 KiB/s wr, 25 op/s 2024-09-13T18:01:55.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:55 smithi027 ceph-mon[30611]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:55.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:55 smithi027 ceph-mon[30611]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T18:01:55.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:55 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2542543255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:55.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:55 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1907353906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:55.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.344+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa71c02c550 con 0x7fa7000a11a0 2024-09-13T18:01:55.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.354+0000 7fa718c00640 1 -- 172.21.15.27:0/2473141418 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335951 (secure 0 0 0) 0x7fa71c02c550 con 0x7fa7000a11a0 2024-09-13T18:01:55.360 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:01:55.362 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-13T18:01:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.358+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa7000a11a0 msgr2=0x7fa7000a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.358+0000 7fa720c00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa7000a11a0 0x7fa7000a3660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa71c199360 tx=0x7fa704005f90 comp rx=0 tx=0).stop 2024-09-13T18:01:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.358+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c101db0 msgr2=0x7fa71c197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.358+0000 7fa720c00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c101db0 0x7fa71c197ea0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa70c00e9c0 tx=0x7fa70c00ee80 comp rx=0 tx=0).stop 2024-09-13T18:01:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.359+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 shutdown_connections 2024-09-13T18:01:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.359+0000 7fa720c00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa7000a11a0 0x7fa7000a3660 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.359+0000 7fa720c00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa71c103960 0x7fa71c19f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.359+0000 7fa720c00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa71c102fa0 0x7fa71c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.359+0000 7fa720c00640 1 --2- 172.21.15.27:0/2473141418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa71c101db0 0x7fa71c197ea0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:55.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.359+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 >> 172.21.15.27:0/2473141418 conn(0x7fa71c0fd530 msgr2=0x7fa71c1063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:55.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.359+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 shutdown_connections 2024-09-13T18:01:55.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:55.359+0000 7fa720c00640 1 -- 172.21.15.27:0/2473141418 wait complete. 2024-09-13T18:01:55.377 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":295,"stamp":"2024-09-13T18:01:53.370167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":603875,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":152,"num_read_kb":135,"num_write":348,"num_write_kb":3004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":284,"ondisk_log_size":284,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":369784,"kb_used_data":12808,"kb_used_omap":18,"kb_used_meta":356845,"kb_avail":1124572040,"statfs":{"total":1151940427776,"available":1151561768960,"internally_reserved":0,"allocated":13115392,"data_stored":7099719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19127,"internal_metadata":365409609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13507,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.480735"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109703+0000","last_change":"2024-09-13T18:01:46.343413+0000","last_active":"2024-09-13T18:01:47.109703+0000","last_peered":"2024-09-13T18:01:47.109703+0000","last_clean":"2024-09-13T18:01:47.109703+0000","last_became_active":"2024-09-13T18:01:46.343086+0000","last_became_peered":"2024-09-13T18:01:46.343086+0000","last_unstale":"2024-09-13T18:01:47.109703+0000","last_undegraded":"2024-09-13T18:01:47.109703+0000","last_fullsized":"2024-09-13T18:01:47.109703+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:11.345474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900616+0000","last_change":"2024-09-13T18:01:46.338910+0000","last_active":"2024-09-13T18:01:47.900616+0000","last_peered":"2024-09-13T18:01:47.900616+0000","last_clean":"2024-09-13T18:01:47.900616+0000","last_became_active":"2024-09-13T18:01:46.338570+0000","last_became_peered":"2024-09-13T18:01:46.338570+0000","last_unstale":"2024-09-13T18:01:47.900616+0000","last_undegraded":"2024-09-13T18:01:47.900616+0000","last_fullsized":"2024-09-13T18:01:47.900616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:24.664195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900719+0000","last_change":"2024-09-13T18:01:46.329371+0000","last_active":"2024-09-13T18:01:47.900719+0000","last_peered":"2024-09-13T18:01:47.900719+0000","last_clean":"2024-09-13T18:01:47.900719+0000","last_became_active":"2024-09-13T18:01:46.328778+0000","last_became_peered":"2024-09-13T18:01:46.328778+0000","last_unstale":"2024-09-13T18:01:47.900719+0000","last_undegraded":"2024-09-13T18:01:47.900719+0000","last_fullsized":"2024-09-13T18:01:47.900719+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:02.025318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:46.996286+0000","last_change":"2024-09-13T18:01:46.357302+0000","last_active":"2024-09-13T18:01:46.996286+0000","last_peered":"2024-09-13T18:01:46.996286+0000","last_clean":"2024-09-13T18:01:46.996286+0000","last_became_active":"2024-09-13T18:01:46.356981+0000","last_became_peered":"2024-09-13T18:01:46.356981+0000","last_unstale":"2024-09-13T18:01:46.996286+0000","last_undegraded":"2024-09-13T18:01:46.996286+0000","last_fullsized":"2024-09-13T18:01:46.996286+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:30.410651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.881879+0000","last_change":"2024-09-13T18:01:46.357813+0000","last_active":"2024-09-13T18:01:47.881879+0000","last_peered":"2024-09-13T18:01:47.881879+0000","last_clean":"2024-09-13T18:01:47.881879+0000","last_became_active":"2024-09-13T18:01:46.357039+0000","last_became_peered":"2024-09-13T18:01:46.357039+0000","last_unstale":"2024-09-13T18:01:47.881879+0000","last_undegraded":"2024-09-13T18:01:47.881879+0000","last_fullsized":"2024-09-13T18:01:47.881879+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:18.772049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.187412+0000","last_change":"2024-09-13T18:01:46.348881+0000","last_active":"2024-09-13T18:01:47.187412+0000","last_peered":"2024-09-13T18:01:47.187412+0000","last_clean":"2024-09-13T18:01:47.187412+0000","last_became_active":"2024-09-13T18:01:46.348576+0000","last_became_peered":"2024-09-13T18:01:46.348576+0000","last_unstale":"2024-09-13T18:01:47.187412+0000","last_undegraded":"2024-09-13T18:01:47.187412+0000","last_fullsized":"2024-09-13T18:01:47.187412+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:56.322188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329151+0000","last_change":"2024-09-13T18:01:46.348568+0000","last_active":"2024-09-13T18:01:47.329151+0000","last_peered":"2024-09-13T18:01:47.329151+0000","last_clean":"2024-09-13T18:01:47.329151+0000","last_became_active":"2024-09-13T18:01:46.347140+0000","last_became_peered":"2024-09-13T18:01:46.347140+0000","last_unstale":"2024-09-13T18:01:47.329151+0000","last_undegraded":"2024-09-13T18:01:47.329151+0000","last_fullsized":"2024-09-13T18:01:47.329151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:53.324943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326233+0000","last_change":"2024-09-13T18:01:46.356670+0000","last_active":"2024-09-13T18:01:47.326233+0000","last_peered":"2024-09-13T18:01:47.326233+0000","last_clean":"2024-09-13T18:01:47.326233+0000","last_became_active":"2024-09-13T18:01:46.354951+0000","last_became_peered":"2024-09-13T18:01:46.354951+0000","last_unstale":"2024-09-13T18:01:47.326233+0000","last_undegraded":"2024-09-13T18:01:47.326233+0000","last_fullsized":"2024-09-13T18:01:47.326233+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:26.335474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315904+0000","last_change":"2024-09-13T18:01:46.339105+0000","last_active":"2024-09-13T18:01:47.315904+0000","last_peered":"2024-09-13T18:01:47.315904+0000","last_clean":"2024-09-13T18:01:47.315904+0000","last_became_active":"2024-09-13T18:01:46.338760+0000","last_became_peered":"2024-09-13T18:01:46.338760+0000","last_unstale":"2024-09-13T18:01:47.315904+0000","last_undegraded":"2024-09-13T18:01:47.315904+0000","last_fullsized":"2024-09-13T18:01:47.315904+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:30.071385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.187510+0000","last_change":"2024-09-13T18:01:46.349900+0000","last_active":"2024-09-13T18:01:47.187510+0000","last_peered":"2024-09-13T18:01:47.187510+0000","last_clean":"2024-09-13T18:01:47.187510+0000","last_became_active":"2024-09-13T18:01:46.348934+0000","last_became_peered":"2024-09-13T18:01:46.348934+0000","last_unstale":"2024-09-13T18:01:47.187510+0000","last_undegraded":"2024-09-13T18:01:47.187510+0000","last_fullsized":"2024-09-13T18:01:47.187510+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:33.337730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329632+0000","last_change":"2024-09-13T18:01:46.345358+0000","last_active":"2024-09-13T18:01:47.329632+0000","last_peered":"2024-09-13T18:01:47.329632+0000","last_clean":"2024-09-13T18:01:47.329632+0000","last_became_active":"2024-09-13T18:01:46.345050+0000","last_became_peered":"2024-09-13T18:01:46.345050+0000","last_unstale":"2024-09-13T18:01:47.329632+0000","last_undegraded":"2024-09-13T18:01:47.329632+0000","last_fullsized":"2024-09-13T18:01:47.329632+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:30.925633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:46.996297+0000","last_change":"2024-09-13T18:01:46.349011+0000","last_active":"2024-09-13T18:01:46.996297+0000","last_peered":"2024-09-13T18:01:46.996297+0000","last_clean":"2024-09-13T18:01:46.996297+0000","last_became_active":"2024-09-13T18:01:46.348245+0000","last_became_peered":"2024-09-13T18:01:46.348245+0000","last_unstale":"2024-09-13T18:01:46.996297+0000","last_undegraded":"2024-09-13T18:01:46.996297+0000","last_fullsized":"2024-09-13T18:01:46.996297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:47.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882508+0000","last_change":"2024-09-13T18:01:46.342540+0000","last_active":"2024-09-13T18:01:47.882508+0000","last_peered":"2024-09-13T18:01:47.882508+0000","last_clean":"2024-09-13T18:01:47.882508+0000","last_became_active":"2024-09-13T18:01:46.342143+0000","last_became_peered":"2024-09-13T18:01:46.342143+0000","last_unstale":"2024-09-13T18:01:47.882508+0000","last_undegraded":"2024-09-13T18:01:47.882508+0000","last_fullsized":"2024-09-13T18:01:47.882508+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:49.934091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900370+0000","last_change":"2024-09-13T18:01:46.338915+0000","last_active":"2024-09-13T18:01:47.900370+0000","last_peered":"2024-09-13T18:01:47.900370+0000","last_clean":"2024-09-13T18:01:47.900370+0000","last_became_active":"2024-09-13T18:01:46.338384+0000","last_became_peered":"2024-09-13T18:01:46.338384+0000","last_unstale":"2024-09-13T18:01:47.900370+0000","last_undegraded":"2024-09-13T18:01:47.900370+0000","last_fullsized":"2024-09-13T18:01:47.900370+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:13.478337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900377+0000","last_change":"2024-09-13T18:01:46.343959+0000","last_active":"2024-09-13T18:01:47.900377+0000","last_peered":"2024-09-13T18:01:47.900377+0000","last_clean":"2024-09-13T18:01:47.900377+0000","last_became_active":"2024-09-13T18:01:46.341063+0000","last_became_peered":"2024-09-13T18:01:46.341063+0000","last_unstale":"2024-09-13T18:01:47.900377+0000","last_undegraded":"2024-09-13T18:01:47.900377+0000","last_fullsized":"2024-09-13T18:01:47.900377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.447487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315810+0000","last_change":"2024-09-13T18:01:46.341971+0000","last_active":"2024-09-13T18:01:47.315810+0000","last_peered":"2024-09-13T18:01:47.315810+0000","last_clean":"2024-09-13T18:01:47.315810+0000","last_became_active":"2024-09-13T18:01:46.341636+0000","last_became_peered":"2024-09-13T18:01:46.341636+0000","last_unstale":"2024-09-13T18:01:47.315810+0000","last_undegraded":"2024-09-13T18:01:47.315810+0000","last_fullsized":"2024-09-13T18:01:47.315810+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:27.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109713+0000","last_change":"2024-09-13T18:01:46.344009+0000","last_active":"2024-09-13T18:01:47.109713+0000","last_peered":"2024-09-13T18:01:47.109713+0000","last_clean":"2024-09-13T18:01:47.109713+0000","last_became_active":"2024-09-13T18:01:46.343639+0000","last_became_peered":"2024-09-13T18:01:46.343639+0000","last_unstale":"2024-09-13T18:01:47.109713+0000","last_undegraded":"2024-09-13T18:01:47.109713+0000","last_fullsized":"2024-09-13T18:01:47.109713+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:09.271452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882712+0000","last_change":"2024-09-13T18:01:46.343502+0000","last_active":"2024-09-13T18:01:47.882712+0000","last_peered":"2024-09-13T18:01:47.882712+0000","last_clean":"2024-09-13T18:01:47.882712+0000","last_became_active":"2024-09-13T18:01:46.343169+0000","last_became_peered":"2024-09-13T18:01:46.343169+0000","last_unstale":"2024-09-13T18:01:47.882712+0000","last_undegraded":"2024-09-13T18:01:47.882712+0000","last_fullsized":"2024-09-13T18:01:47.882712+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:25.351119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882607+0000","last_change":"2024-09-13T18:01:46.348957+0000","last_active":"2024-09-13T18:01:47.882607+0000","last_peered":"2024-09-13T18:01:47.882607+0000","last_clean":"2024-09-13T18:01:47.882607+0000","last_became_active":"2024-09-13T18:01:46.348617+0000","last_became_peered":"2024-09-13T18:01:46.348617+0000","last_unstale":"2024-09-13T18:01:47.882607+0000","last_undegraded":"2024-09-13T18:01:47.882607+0000","last_fullsized":"2024-09-13T18:01:47.882607+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:24.981539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109660+0000","last_change":"2024-09-13T18:01:46.352010+0000","last_active":"2024-09-13T18:01:47.109660+0000","last_peered":"2024-09-13T18:01:47.109660+0000","last_clean":"2024-09-13T18:01:47.109660+0000","last_became_active":"2024-09-13T18:01:46.351708+0000","last_became_peered":"2024-09-13T18:01:46.351708+0000","last_unstale":"2024-09-13T18:01:47.109660+0000","last_undegraded":"2024-09-13T18:01:47.109660+0000","last_fullsized":"2024-09-13T18:01:47.109660+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:04.022440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882581+0000","last_change":"2024-09-13T18:01:46.346106+0000","last_active":"2024-09-13T18:01:47.882581+0000","last_peered":"2024-09-13T18:01:47.882581+0000","last_clean":"2024-09-13T18:01:47.882581+0000","last_became_active":"2024-09-13T18:01:46.345814+0000","last_became_peered":"2024-09-13T18:01:46.345814+0000","last_unstale":"2024-09-13T18:01:47.882581+0000","last_undegraded":"2024-09-13T18:01:47.882581+0000","last_fullsized":"2024-09-13T18:01:47.882581+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:04.030278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315839+0000","last_change":"2024-09-13T18:01:46.358966+0000","last_active":"2024-09-13T18:01:47.315839+0000","last_peered":"2024-09-13T18:01:47.315839+0000","last_clean":"2024-09-13T18:01:47.315839+0000","last_became_active":"2024-09-13T18:01:46.358048+0000","last_became_peered":"2024-09-13T18:01:46.358048+0000","last_unstale":"2024-09-13T18:01:47.315839+0000","last_undegraded":"2024-09-13T18:01:47.315839+0000","last_fullsized":"2024-09-13T18:01:47.315839+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:02.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326220+0000","last_change":"2024-09-13T18:01:46.352545+0000","last_active":"2024-09-13T18:01:47.326220+0000","last_peered":"2024-09-13T18:01:47.326220+0000","last_clean":"2024-09-13T18:01:47.326220+0000","last_became_active":"2024-09-13T18:01:46.352231+0000","last_became_peered":"2024-09-13T18:01:46.352231+0000","last_unstale":"2024-09-13T18:01:47.326220+0000","last_undegraded":"2024-09-13T18:01:47.326220+0000","last_fullsized":"2024-09-13T18:01:47.326220+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:01.420823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326962+0000","last_change":"2024-09-13T18:01:46.355755+0000","last_active":"2024-09-13T18:01:47.326962+0000","last_peered":"2024-09-13T18:01:47.326962+0000","last_clean":"2024-09-13T18:01:47.326962+0000","last_became_active":"2024-09-13T18:01:46.355251+0000","last_became_peered":"2024-09-13T18:01:46.355251+0000","last_unstale":"2024-09-13T18:01:47.326962+0000","last_undegraded":"2024-09-13T18:01:47.326962+0000","last_fullsized":"2024-09-13T18:01:47.326962+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:28.658446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326630+0000","last_change":"2024-09-13T18:01:46.359891+0000","last_active":"2024-09-13T18:01:47.326630+0000","last_peered":"2024-09-13T18:01:47.326630+0000","last_clean":"2024-09-13T18:01:47.326630+0000","last_became_active":"2024-09-13T18:01:46.359445+0000","last_became_peered":"2024-09-13T18:01:46.359445+0000","last_unstale":"2024-09-13T18:01:47.326630+0000","last_undegraded":"2024-09-13T18:01:47.326630+0000","last_fullsized":"2024-09-13T18:01:47.326630+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:14.287904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.883008+0000","last_change":"2024-09-13T18:01:46.337012+0000","last_active":"2024-09-13T18:01:47.883008+0000","last_peered":"2024-09-13T18:01:47.883008+0000","last_clean":"2024-09-13T18:01:47.883008+0000","last_became_active":"2024-09-13T18:01:46.335134+0000","last_became_peered":"2024-09-13T18:01:46.335134+0000","last_unstale":"2024-09-13T18:01:47.883008+0000","last_undegraded":"2024-09-13T18:01:47.883008+0000","last_fullsized":"2024-09-13T18:01:47.883008+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:00.932899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109678+0000","last_change":"2024-09-13T18:01:46.345537+0000","last_active":"2024-09-13T18:01:47.109678+0000","last_peered":"2024-09-13T18:01:47.109678+0000","last_clean":"2024-09-13T18:01:47.109678+0000","last_became_active":"2024-09-13T18:01:46.344988+0000","last_became_peered":"2024-09-13T18:01:46.344988+0000","last_unstale":"2024-09-13T18:01:47.109678+0000","last_undegraded":"2024-09-13T18:01:47.109678+0000","last_fullsized":"2024-09-13T18:01:47.109678+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:01.631371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882295+0000","last_change":"2024-09-13T18:01:46.352355+0000","last_active":"2024-09-13T18:01:47.882295+0000","last_peered":"2024-09-13T18:01:47.882295+0000","last_clean":"2024-09-13T18:01:47.882295+0000","last_became_active":"2024-09-13T18:01:46.352027+0000","last_became_peered":"2024-09-13T18:01:46.352027+0000","last_unstale":"2024-09-13T18:01:47.882295+0000","last_undegraded":"2024-09-13T18:01:47.882295+0000","last_fullsized":"2024-09-13T18:01:47.882295+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:21.204326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900603+0000","last_change":"2024-09-13T18:01:46.353703+0000","last_active":"2024-09-13T18:01:47.900603+0000","last_peered":"2024-09-13T18:01:47.900603+0000","last_clean":"2024-09-13T18:01:47.900603+0000","last_became_active":"2024-09-13T18:01:46.353278+0000","last_became_peered":"2024-09-13T18:01:46.353278+0000","last_unstale":"2024-09-13T18:01:47.900603+0000","last_undegraded":"2024-09-13T18:01:47.900603+0000","last_fullsized":"2024-09-13T18:01:47.900603+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:13.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882706+0000","last_change":"2024-09-13T18:01:46.348944+0000","last_active":"2024-09-13T18:01:47.882706+0000","last_peered":"2024-09-13T18:01:47.882706+0000","last_clean":"2024-09-13T18:01:47.882706+0000","last_became_active":"2024-09-13T18:01:46.348600+0000","last_became_peered":"2024-09-13T18:01:46.348600+0000","last_unstale":"2024-09-13T18:01:47.882706+0000","last_undegraded":"2024-09-13T18:01:47.882706+0000","last_fullsized":"2024-09-13T18:01:47.882706+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:52.474038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882666+0000","last_change":"2024-09-13T18:01:46.343072+0000","last_active":"2024-09-13T18:01:47.882666+0000","last_peered":"2024-09-13T18:01:47.882666+0000","last_clean":"2024-09-13T18:01:47.882666+0000","last_became_active":"2024-09-13T18:01:46.342604+0000","last_became_peered":"2024-09-13T18:01:46.342604+0000","last_unstale":"2024-09-13T18:01:47.882666+0000","last_undegraded":"2024-09-13T18:01:47.882666+0000","last_fullsized":"2024-09-13T18:01:47.882666+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:39.018568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109622+0000","last_change":"2024-09-13T18:01:46.345568+0000","last_active":"2024-09-13T18:01:47.109622+0000","last_peered":"2024-09-13T18:01:47.109622+0000","last_clean":"2024-09-13T18:01:47.109622+0000","last_became_active":"2024-09-13T18:01:46.344980+0000","last_became_peered":"2024-09-13T18:01:46.344980+0000","last_unstale":"2024-09-13T18:01:47.109622+0000","last_undegraded":"2024-09-13T18:01:47.109622+0000","last_fullsized":"2024-09-13T18:01:47.109622+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:10.337136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882208+0000","last_change":"2024-09-13T18:01:46.343778+0000","last_active":"2024-09-13T18:01:47.882208+0000","last_peered":"2024-09-13T18:01:47.882208+0000","last_clean":"2024-09-13T18:01:47.882208+0000","last_became_active":"2024-09-13T18:01:46.343315+0000","last_became_peered":"2024-09-13T18:01:46.343315+0000","last_unstale":"2024-09-13T18:01:47.882208+0000","last_undegraded":"2024-09-13T18:01:47.882208+0000","last_fullsized":"2024-09-13T18:01:47.882208+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:37.300512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"86'6","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.057541+0000","last_change":"2024-09-13T18:01:45.907544+0000","last_active":"2024-09-13T18:01:52.057541+0000","last_peered":"2024-09-13T18:01:52.057541+0000","last_clean":"2024-09-13T18:01:52.057541+0000","last_became_active":"2024-09-13T18:01:45.905723+0000","last_became_peered":"2024-09-13T18:01:45.905723+0000","last_unstale":"2024-09-13T18:01:52.057541+0000","last_undegraded":"2024-09-13T18:01:52.057541+0000","last_fullsized":"2024-09-13T18:01:52.057541+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:36.956332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":966,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326992+0000","last_change":"2024-09-13T18:01:46.354386+0000","last_active":"2024-09-13T18:01:47.326992+0000","last_peered":"2024-09-13T18:01:47.326992+0000","last_clean":"2024-09-13T18:01:47.326992+0000","last_became_active":"2024-09-13T18:01:46.353826+0000","last_became_peered":"2024-09-13T18:01:46.353826+0000","last_unstale":"2024-09-13T18:01:47.326992+0000","last_undegraded":"2024-09-13T18:01:47.326992+0000","last_fullsized":"2024-09-13T18:01:47.326992+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:52.882814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:51.376862+0000","last_change":"2024-09-13T18:01:45.905700+0000","last_active":"2024-09-13T18:01:51.376862+0000","last_peered":"2024-09-13T18:01:51.376862+0000","last_clean":"2024-09-13T18:01:51.376862+0000","last_became_active":"2024-09-13T18:01:45.905041+0000","last_became_peered":"2024-09-13T18:01:45.905041+0000","last_unstale":"2024-09-13T18:01:51.376862+0000","last_undegraded":"2024-09-13T18:01:51.376862+0000","last_fullsized":"2024-09-13T18:01:51.376862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:42.452899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:50.370204+0000","last_change":"2024-09-13T18:01:45.909342+0000","last_active":"2024-09-13T18:01:50.370204+0000","last_peered":"2024-09-13T18:01:50.370204+0000","last_clean":"2024-09-13T18:01:50.370204+0000","last_became_active":"2024-09-13T18:01:45.903521+0000","last_became_peered":"2024-09-13T18:01:45.903521+0000","last_unstale":"2024-09-13T18:01:50.370204+0000","last_undegraded":"2024-09-13T18:01:50.370204+0000","last_fullsized":"2024-09-13T18:01:50.370204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:51.641256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326303+0000","last_change":"2024-09-13T18:01:46.352544+0000","last_active":"2024-09-13T18:01:47.326303+0000","last_peered":"2024-09-13T18:01:47.326303+0000","last_clean":"2024-09-13T18:01:47.326303+0000","last_became_active":"2024-09-13T18:01:46.352037+0000","last_became_peered":"2024-09-13T18:01:46.352037+0000","last_unstale":"2024-09-13T18:01:47.326303+0000","last_undegraded":"2024-09-13T18:01:47.326303+0000","last_fullsized":"2024-09-13T18:01:47.326303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:39.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.057421+0000","last_change":"2024-09-13T18:01:45.908424+0000","last_active":"2024-09-13T18:01:52.057421+0000","last_peered":"2024-09-13T18:01:52.057421+0000","last_clean":"2024-09-13T18:01:52.057421+0000","last_became_active":"2024-09-13T18:01:45.908046+0000","last_became_peered":"2024-09-13T18:01:45.908046+0000","last_unstale":"2024-09-13T18:01:52.057421+0000","last_undegraded":"2024-09-13T18:01:52.057421+0000","last_fullsized":"2024-09-13T18:01:52.057421+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:36.894538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882243+0000","last_change":"2024-09-13T18:01:46.356279+0000","last_active":"2024-09-13T18:01:47.882243+0000","last_peered":"2024-09-13T18:01:47.882243+0000","last_clean":"2024-09-13T18:01:47.882243+0000","last_became_active":"2024-09-13T18:01:46.355954+0000","last_became_peered":"2024-09-13T18:01:46.355954+0000","last_unstale":"2024-09-13T18:01:47.882243+0000","last_undegraded":"2024-09-13T18:01:47.882243+0000","last_fullsized":"2024-09-13T18:01:47.882243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:30.595635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.054407+0000","last_change":"2024-09-13T18:01:45.903952+0000","last_active":"2024-09-13T18:01:52.054407+0000","last_peered":"2024-09-13T18:01:52.054407+0000","last_clean":"2024-09-13T18:01:52.054407+0000","last_became_active":"2024-09-13T18:01:45.903664+0000","last_became_peered":"2024-09-13T18:01:45.903664+0000","last_unstale":"2024-09-13T18:01:52.054407+0000","last_undegraded":"2024-09-13T18:01:52.054407+0000","last_fullsized":"2024-09-13T18:01:52.054407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:08.599379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315892+0000","last_change":"2024-09-13T18:01:46.343183+0000","last_active":"2024-09-13T18:01:47.315892+0000","last_peered":"2024-09-13T18:01:47.315892+0000","last_clean":"2024-09-13T18:01:47.315892+0000","last_became_active":"2024-09-13T18:01:46.342773+0000","last_became_peered":"2024-09-13T18:01:46.342773+0000","last_unstale":"2024-09-13T18:01:47.315892+0000","last_undegraded":"2024-09-13T18:01:47.315892+0000","last_fullsized":"2024-09-13T18:01:47.315892+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:50.038027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.064127+0000","last_change":"2024-09-13T18:01:45.911889+0000","last_active":"2024-09-13T18:01:52.064127+0000","last_peered":"2024-09-13T18:01:52.064127+0000","last_clean":"2024-09-13T18:01:52.064127+0000","last_became_active":"2024-09-13T18:01:45.911418+0000","last_became_peered":"2024-09-13T18:01:45.911418+0000","last_unstale":"2024-09-13T18:01:52.064127+0000","last_undegraded":"2024-09-13T18:01:52.064127+0000","last_fullsized":"2024-09-13T18:01:52.064127+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:05.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900773+0000","last_change":"2024-09-13T18:01:46.354364+0000","last_active":"2024-09-13T18:01:47.900773+0000","last_peered":"2024-09-13T18:01:47.900773+0000","last_clean":"2024-09-13T18:01:47.900773+0000","last_became_active":"2024-09-13T18:01:46.354026+0000","last_became_peered":"2024-09-13T18:01:46.354026+0000","last_unstale":"2024-09-13T18:01:47.900773+0000","last_undegraded":"2024-09-13T18:01:47.900773+0000","last_fullsized":"2024-09-13T18:01:47.900773+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:51.375950+0000","last_change":"2024-09-13T18:01:45.901597+0000","last_active":"2024-09-13T18:01:51.375950+0000","last_peered":"2024-09-13T18:01:51.375950+0000","last_clean":"2024-09-13T18:01:51.375950+0000","last_became_active":"2024-09-13T18:01:45.901239+0000","last_became_peered":"2024-09-13T18:01:45.901239+0000","last_unstale":"2024-09-13T18:01:51.375950+0000","last_undegraded":"2024-09-13T18:01:51.375950+0000","last_fullsized":"2024-09-13T18:01:51.375950+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:10.833206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315880+0000","last_change":"2024-09-13T18:01:46.351157+0000","last_active":"2024-09-13T18:01:47.315880+0000","last_peered":"2024-09-13T18:01:47.315880+0000","last_clean":"2024-09-13T18:01:47.315880+0000","last_became_active":"2024-09-13T18:01:46.350805+0000","last_became_peered":"2024-09-13T18:01:46.350805+0000","last_unstale":"2024-09-13T18:01:47.315880+0000","last_undegraded":"2024-09-13T18:01:47.315880+0000","last_fullsized":"2024-09-13T18:01:47.315880+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:15.680744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'13","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.063927+0000","last_change":"2024-09-13T18:01:45.898614+0000","last_active":"2024-09-13T18:01:52.063927+0000","last_peered":"2024-09-13T18:01:52.063927+0000","last_clean":"2024-09-13T18:01:52.063927+0000","last_became_active":"2024-09-13T18:01:45.898279+0000","last_became_peered":"2024-09-13T18:01:45.898279+0000","last_unstale":"2024-09-13T18:01:52.063927+0000","last_undegraded":"2024-09-13T18:01:52.063927+0000","last_fullsized":"2024-09-13T18:01:52.063927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:49.174143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8165,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":6,"num_write":15,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882372+0000","last_change":"2024-09-13T18:01:46.340270+0000","last_active":"2024-09-13T18:01:47.882372+0000","last_peered":"2024-09-13T18:01:47.882372+0000","last_clean":"2024-09-13T18:01:47.882372+0000","last_became_active":"2024-09-13T18:01:46.339968+0000","last_became_peered":"2024-09-13T18:01:46.339968+0000","last_unstale":"2024-09-13T18:01:47.882372+0000","last_undegraded":"2024-09-13T18:01:47.882372+0000","last_fullsized":"2024-09-13T18:01:47.882372+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:42.070652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882782+0000","last_change":"2024-09-13T18:01:45.909336+0000","last_active":"2024-09-13T18:01:47.882782+0000","last_peered":"2024-09-13T18:01:47.882782+0000","last_clean":"2024-09-13T18:01:47.882782+0000","last_became_active":"2024-09-13T18:01:45.908956+0000","last_became_peered":"2024-09-13T18:01:45.908956+0000","last_unstale":"2024-09-13T18:01:47.882782+0000","last_undegraded":"2024-09-13T18:01:47.882782+0000","last_fullsized":"2024-09-13T18:01:47.882782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:29.327701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882114+0000","last_change":"2024-09-13T18:01:46.354627+0000","last_active":"2024-09-13T18:01:47.882114+0000","last_peered":"2024-09-13T18:01:47.882114+0000","last_clean":"2024-09-13T18:01:47.882114+0000","last_became_active":"2024-09-13T18:01:46.354318+0000","last_became_peered":"2024-09-13T18:01:46.354318+0000","last_unstale":"2024-09-13T18:01:47.882114+0000","last_undegraded":"2024-09-13T18:01:47.882114+0000","last_fullsized":"2024-09-13T18:01:47.882114+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:55.814673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.064368+0000","last_change":"2024-09-13T18:01:45.909477+0000","last_active":"2024-09-13T18:01:52.064368+0000","last_peered":"2024-09-13T18:01:52.064368+0000","last_clean":"2024-09-13T18:01:52.064368+0000","last_became_active":"2024-09-13T18:01:45.909143+0000","last_became_peered":"2024-09-13T18:01:45.909143+0000","last_unstale":"2024-09-13T18:01:52.064368+0000","last_undegraded":"2024-09-13T18:01:52.064368+0000","last_fullsized":"2024-09-13T18:01:52.064368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:52.276839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329315+0000","last_change":"2024-09-13T18:01:46.351293+0000","last_active":"2024-09-13T18:01:47.329315+0000","last_peered":"2024-09-13T18:01:47.329315+0000","last_clean":"2024-09-13T18:01:47.329315+0000","last_became_active":"2024-09-13T18:01:46.350980+0000","last_became_peered":"2024-09-13T18:01:46.350980+0000","last_unstale":"2024-09-13T18:01:47.329315+0000","last_undegraded":"2024-09-13T18:01:47.329315+0000","last_fullsized":"2024-09-13T18:01:47.329315+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:20.656282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:51.373920+0000","last_change":"2024-09-13T18:01:45.905434+0000","last_active":"2024-09-13T18:01:51.373920+0000","last_peered":"2024-09-13T18:01:51.373920+0000","last_clean":"2024-09-13T18:01:51.373920+0000","last_became_active":"2024-09-13T18:01:45.904719+0000","last_became_peered":"2024-09-13T18:01:45.904719+0000","last_unstale":"2024-09-13T18:01:51.373920+0000","last_undegraded":"2024-09-13T18:01:51.373920+0000","last_fullsized":"2024-09-13T18:01:51.373920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:43.949977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329122+0000","last_change":"2024-09-13T18:01:46.348191+0000","last_active":"2024-09-13T18:01:47.329122+0000","last_peered":"2024-09-13T18:01:47.329122+0000","last_clean":"2024-09-13T18:01:47.329122+0000","last_became_active":"2024-09-13T18:01:46.347886+0000","last_became_peered":"2024-09-13T18:01:46.347886+0000","last_unstale":"2024-09-13T18:01:47.329122+0000","last_undegraded":"2024-09-13T18:01:47.329122+0000","last_fullsized":"2024-09-13T18:01:47.329122+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:40.986385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.052888+0000","last_change":"2024-09-13T18:01:45.904429+0000","last_active":"2024-09-13T18:01:52.052888+0000","last_peered":"2024-09-13T18:01:52.052888+0000","last_clean":"2024-09-13T18:01:52.052888+0000","last_became_active":"2024-09-13T18:01:45.904134+0000","last_became_peered":"2024-09-13T18:01:45.904134+0000","last_unstale":"2024-09-13T18:01:52.052888+0000","last_undegraded":"2024-09-13T18:01:52.052888+0000","last_fullsized":"2024-09-13T18:01:52.052888+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:54.073044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.327305+0000","last_change":"2024-09-13T18:01:46.350725+0000","last_active":"2024-09-13T18:01:47.327305+0000","last_peered":"2024-09-13T18:01:47.327305+0000","last_clean":"2024-09-13T18:01:47.327305+0000","last_became_active":"2024-09-13T18:01:46.350061+0000","last_became_peered":"2024-09-13T18:01:46.350061+0000","last_unstale":"2024-09-13T18:01:47.327305+0000","last_undegraded":"2024-09-13T18:01:47.327305+0000","last_fullsized":"2024-09-13T18:01:47.327305+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:09.649534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.052782+0000","last_change":"2024-09-13T18:01:45.903251+0000","last_active":"2024-09-13T18:01:52.052782+0000","last_peered":"2024-09-13T18:01:52.052782+0000","last_clean":"2024-09-13T18:01:52.052782+0000","last_became_active":"2024-09-13T18:01:45.901593+0000","last_became_peered":"2024-09-13T18:01:45.901593+0000","last_unstale":"2024-09-13T18:01:52.052782+0000","last_undegraded":"2024-09-13T18:01:52.052782+0000","last_fullsized":"2024-09-13T18:01:52.052782+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.197806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109691+0000","last_change":"2024-09-13T18:01:46.351524+0000","last_active":"2024-09-13T18:01:47.109691+0000","last_peered":"2024-09-13T18:01:47.109691+0000","last_clean":"2024-09-13T18:01:47.109691+0000","last_became_active":"2024-09-13T18:01:46.351136+0000","last_became_peered":"2024-09-13T18:01:46.351136+0000","last_unstale":"2024-09-13T18:01:47.109691+0000","last_undegraded":"2024-09-13T18:01:47.109691+0000","last_fullsized":"2024-09-13T18:01:47.109691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:39.639592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.063396+0000","last_change":"2024-09-13T18:01:45.914866+0000","last_active":"2024-09-13T18:01:52.063396+0000","last_peered":"2024-09-13T18:01:52.063396+0000","last_clean":"2024-09-13T18:01:52.063396+0000","last_became_active":"2024-09-13T18:01:45.914549+0000","last_became_peered":"2024-09-13T18:01:45.914549+0000","last_unstale":"2024-09-13T18:01:52.063396+0000","last_undegraded":"2024-09-13T18:01:52.063396+0000","last_fullsized":"2024-09-13T18:01:52.063396+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:46.789559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329752+0000","last_change":"2024-09-13T18:01:46.342386+0000","last_active":"2024-09-13T18:01:47.329752+0000","last_peered":"2024-09-13T18:01:47.329752+0000","last_clean":"2024-09-13T18:01:47.329752+0000","last_became_active":"2024-09-13T18:01:46.342086+0000","last_became_peered":"2024-09-13T18:01:46.342086+0000","last_unstale":"2024-09-13T18:01:47.329752+0000","last_undegraded":"2024-09-13T18:01:47.329752+0000","last_fullsized":"2024-09-13T18:01:47.329752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:44.379756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.052810+0000","last_change":"2024-09-13T18:01:45.909247+0000","last_active":"2024-09-13T18:01:52.052810+0000","last_peered":"2024-09-13T18:01:52.052810+0000","last_clean":"2024-09-13T18:01:52.052810+0000","last_became_active":"2024-09-13T18:01:45.908930+0000","last_became_peered":"2024-09-13T18:01:45.908930+0000","last_unstale":"2024-09-13T18:01:52.052810+0000","last_undegraded":"2024-09-13T18:01:52.052810+0000","last_fullsized":"2024-09-13T18:01:52.052810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:46.433561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329552+0000","last_change":"2024-09-13T18:01:46.358240+0000","last_active":"2024-09-13T18:01:47.329552+0000","last_peered":"2024-09-13T18:01:47.329552+0000","last_clean":"2024-09-13T18:01:47.329552+0000","last_became_active":"2024-09-13T18:01:46.357893+0000","last_became_peered":"2024-09-13T18:01:46.357893+0000","last_unstale":"2024-09-13T18:01:47.329552+0000","last_undegraded":"2024-09-13T18:01:47.329552+0000","last_fullsized":"2024-09-13T18:01:47.329552+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:41.725958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882640+0000","last_change":"2024-09-13T18:01:45.906743+0000","last_active":"2024-09-13T18:01:47.882640+0000","last_peered":"2024-09-13T18:01:47.882640+0000","last_clean":"2024-09-13T18:01:47.882640+0000","last_became_active":"2024-09-13T18:01:45.906149+0000","last_became_peered":"2024-09-13T18:01:45.906149+0000","last_unstale":"2024-09-13T18:01:47.882640+0000","last_undegraded":"2024-09-13T18:01:47.882640+0000","last_fullsized":"2024-09-13T18:01:47.882640+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:36.609259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329685+0000","last_change":"2024-09-13T18:01:46.343336+0000","last_active":"2024-09-13T18:01:47.329685+0000","last_peered":"2024-09-13T18:01:47.329685+0000","last_clean":"2024-09-13T18:01:47.329685+0000","last_became_active":"2024-09-13T18:01:46.342941+0000","last_became_peered":"2024-09-13T18:01:46.342941+0000","last_unstale":"2024-09-13T18:01:47.329685+0000","last_undegraded":"2024-09-13T18:01:47.329685+0000","last_fullsized":"2024-09-13T18:01:47.329685+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:13.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":329,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:46.334343+0000","last_change":"2024-09-13T18:00:36.038635+0000","last_active":"2024-09-13T18:01:46.334343+0000","last_peered":"2024-09-13T18:01:46.334343+0000","last_clean":"2024-09-13T18:01:46.334343+0000","last_became_active":"2024-09-13T18:00:36.038227+0000","last_became_peered":"2024-09-13T18:00:36.038227+0000","last_unstale":"2024-09-13T18:01:46.334343+0000","last_undegraded":"2024-09-13T18:01:46.334343+0000","last_fullsized":"2024-09-13T18:01:46.334343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:57:10.088656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:57:10.088656+0000","last_clean_scrub_stamp":"2024-09-13T17:57:10.088656+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:54.824216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:51.374286+0000","last_change":"2024-09-13T18:01:45.901622+0000","last_active":"2024-09-13T18:01:51.374286+0000","last_peered":"2024-09-13T18:01:51.374286+0000","last_clean":"2024-09-13T18:01:51.374286+0000","last_became_active":"2024-09-13T18:01:45.901212+0000","last_became_peered":"2024-09-13T18:01:45.901212+0000","last_unstale":"2024-09-13T18:01:51.374286+0000","last_undegraded":"2024-09-13T18:01:51.374286+0000","last_fullsized":"2024-09-13T18:01:51.374286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:57.417769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326246+0000","last_change":"2024-09-13T18:01:46.351439+0000","last_active":"2024-09-13T18:01:47.326246+0000","last_peered":"2024-09-13T18:01:47.326246+0000","last_clean":"2024-09-13T18:01:47.326246+0000","last_became_active":"2024-09-13T18:01:46.350801+0000","last_became_peered":"2024-09-13T18:01:46.350801+0000","last_unstale":"2024-09-13T18:01:47.326246+0000","last_undegraded":"2024-09-13T18:01:47.326246+0000","last_fullsized":"2024-09-13T18:01:47.326246+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:32.407058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:50.367634+0000","last_change":"2024-09-13T18:01:45.907122+0000","last_active":"2024-09-13T18:01:50.367634+0000","last_peered":"2024-09-13T18:01:50.367634+0000","last_clean":"2024-09-13T18:01:50.367634+0000","last_became_active":"2024-09-13T18:01:45.906741+0000","last_became_peered":"2024-09-13T18:01:45.906741+0000","last_unstale":"2024-09-13T18:01:50.367634+0000","last_undegraded":"2024-09-13T18:01:50.367634+0000","last_fullsized":"2024-09-13T18:01:50.367634+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:09.242844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882036+0000","last_change":"2024-09-13T18:01:46.341715+0000","last_active":"2024-09-13T18:01:47.882036+0000","last_peered":"2024-09-13T18:01:47.882036+0000","last_clean":"2024-09-13T18:01:47.882036+0000","last_became_active":"2024-09-13T18:01:46.340930+0000","last_became_peered":"2024-09-13T18:01:46.340930+0000","last_unstale":"2024-09-13T18:01:47.882036+0000","last_undegraded":"2024-09-13T18:01:47.882036+0000","last_fullsized":"2024-09-13T18:01:47.882036+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:02.050831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:53.058925+0000","last_change":"2024-09-13T18:01:45.918611+0000","last_active":"2024-09-13T18:01:53.058925+0000","last_peered":"2024-09-13T18:01:53.058925+0000","last_clean":"2024-09-13T18:01:53.058925+0000","last_became_active":"2024-09-13T18:01:45.916885+0000","last_became_peered":"2024-09-13T18:01:45.916885+0000","last_unstale":"2024-09-13T18:01:53.058925+0000","last_undegraded":"2024-09-13T18:01:53.058925+0000","last_fullsized":"2024-09-13T18:01:53.058925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:59.917562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.327082+0000","last_change":"2024-09-13T18:01:46.350526+0000","last_active":"2024-09-13T18:01:47.327082+0000","last_peered":"2024-09-13T18:01:47.327082+0000","last_clean":"2024-09-13T18:01:47.327082+0000","last_became_active":"2024-09-13T18:01:46.350065+0000","last_became_peered":"2024-09-13T18:01:46.350065+0000","last_unstale":"2024-09-13T18:01:47.327082+0000","last_undegraded":"2024-09-13T18:01:47.327082+0000","last_fullsized":"2024-09-13T18:01:47.327082+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:43.573806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.064425+0000","last_change":"2024-09-13T18:01:45.911811+0000","last_active":"2024-09-13T18:01:52.064425+0000","last_peered":"2024-09-13T18:01:52.064425+0000","last_clean":"2024-09-13T18:01:52.064425+0000","last_became_active":"2024-09-13T18:01:45.911086+0000","last_became_peered":"2024-09-13T18:01:45.911086+0000","last_unstale":"2024-09-13T18:01:52.064425+0000","last_undegraded":"2024-09-13T18:01:52.064425+0000","last_fullsized":"2024-09-13T18:01:52.064425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:31.743257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.187452+0000","last_change":"2024-09-13T18:01:46.349538+0000","last_active":"2024-09-13T18:01:47.187452+0000","last_peered":"2024-09-13T18:01:47.187452+0000","last_clean":"2024-09-13T18:01:47.187452+0000","last_became_active":"2024-09-13T18:01:46.349241+0000","last_became_peered":"2024-09-13T18:01:46.349241+0000","last_unstale":"2024-09-13T18:01:47.187452+0000","last_undegraded":"2024-09-13T18:01:47.187452+0000","last_fullsized":"2024-09-13T18:01:47.187452+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:16:49.245551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882614+0000","last_change":"2024-09-13T18:01:45.912239+0000","last_active":"2024-09-13T18:01:47.882614+0000","last_peered":"2024-09-13T18:01:47.882614+0000","last_clean":"2024-09-13T18:01:47.882614+0000","last_became_active":"2024-09-13T18:01:45.911898+0000","last_became_peered":"2024-09-13T18:01:45.911898+0000","last_unstale":"2024-09-13T18:01:47.882614+0000","last_undegraded":"2024-09-13T18:01:47.882614+0000","last_fullsized":"2024-09-13T18:01:47.882614+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.473369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.187500+0000","last_change":"2024-09-13T18:01:46.353872+0000","last_active":"2024-09-13T18:01:47.187500+0000","last_peered":"2024-09-13T18:01:47.187500+0000","last_clean":"2024-09-13T18:01:47.187500+0000","last_became_active":"2024-09-13T18:01:46.353253+0000","last_became_peered":"2024-09-13T18:01:46.353253+0000","last_unstale":"2024-09-13T18:01:47.187500+0000","last_undegraded":"2024-09-13T18:01:47.187500+0000","last_fullsized":"2024-09-13T18:01:47.187500+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:11.247278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.053530+0000","last_change":"2024-09-13T18:01:45.911329+0000","last_active":"2024-09-13T18:01:52.053530+0000","last_peered":"2024-09-13T18:01:52.053530+0000","last_clean":"2024-09-13T18:01:52.053530+0000","last_became_active":"2024-09-13T18:01:45.911036+0000","last_became_peered":"2024-09-13T18:01:45.911036+0000","last_unstale":"2024-09-13T18:01:52.053530+0000","last_undegraded":"2024-09-13T18:01:52.053530+0000","last_fullsized":"2024-09-13T18:01:52.053530+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:17.661879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882322+0000","last_change":"2024-09-13T18:01:46.341156+0000","last_active":"2024-09-13T18:01:47.882322+0000","last_peered":"2024-09-13T18:01:47.882322+0000","last_clean":"2024-09-13T18:01:47.882322+0000","last_became_active":"2024-09-13T18:01:46.340770+0000","last_became_peered":"2024-09-13T18:01:46.340770+0000","last_unstale":"2024-09-13T18:01:47.882322+0000","last_undegraded":"2024-09-13T18:01:47.882322+0000","last_fullsized":"2024-09-13T18:01:47.882322+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:27.782016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882737+0000","last_change":"2024-09-13T18:01:45.910311+0000","last_active":"2024-09-13T18:01:47.882737+0000","last_peered":"2024-09-13T18:01:47.882737+0000","last_clean":"2024-09-13T18:01:47.882737+0000","last_became_active":"2024-09-13T18:01:45.909959+0000","last_became_peered":"2024-09-13T18:01:45.909959+0000","last_unstale":"2024-09-13T18:01:47.882737+0000","last_undegraded":"2024-09-13T18:01:47.882737+0000","last_fullsized":"2024-09-13T18:01:47.882737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:58.840803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326709+0000","last_change":"2024-09-13T18:01:46.354213+0000","last_active":"2024-09-13T18:01:47.326709+0000","last_peered":"2024-09-13T18:01:47.326709+0000","last_clean":"2024-09-13T18:01:47.326709+0000","last_became_active":"2024-09-13T18:01:46.353381+0000","last_became_peered":"2024-09-13T18:01:46.353381+0000","last_unstale":"2024-09-13T18:01:47.326709+0000","last_undegraded":"2024-09-13T18:01:47.326709+0000","last_fullsized":"2024-09-13T18:01:47.326709+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:17.236617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'5","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:49.356658+0000","last_change":"2024-09-13T18:01:45.915203+0000","last_active":"2024-09-13T18:01:49.356658+0000","last_peered":"2024-09-13T18:01:49.356658+0000","last_clean":"2024-09-13T18:01:49.356658+0000","last_became_active":"2024-09-13T18:01:45.914901+0000","last_became_peered":"2024-09-13T18:01:45.914901+0000","last_unstale":"2024-09-13T18:01:49.356658+0000","last_undegraded":"2024-09-13T18:01:49.356658+0000","last_fullsized":"2024-09-13T18:01:49.356658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:52.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900655+0000","last_change":"2024-09-13T18:01:46.351561+0000","last_active":"2024-09-13T18:01:47.900655+0000","last_peered":"2024-09-13T18:01:47.900655+0000","last_clean":"2024-09-13T18:01:47.900655+0000","last_became_active":"2024-09-13T18:01:46.351245+0000","last_became_peered":"2024-09-13T18:01:46.351245+0000","last_unstale":"2024-09-13T18:01:47.900655+0000","last_undegraded":"2024-09-13T18:01:47.900655+0000","last_fullsized":"2024-09-13T18:01:47.900655+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:16.878552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:49.357037+0000","last_change":"2024-09-13T18:01:45.904200+0000","last_active":"2024-09-13T18:01:49.357037+0000","last_peered":"2024-09-13T18:01:49.357037+0000","last_clean":"2024-09-13T18:01:49.357037+0000","last_became_active":"2024-09-13T18:01:45.903139+0000","last_became_peered":"2024-09-13T18:01:45.903139+0000","last_unstale":"2024-09-13T18:01:49.357037+0000","last_undegraded":"2024-09-13T18:01:49.357037+0000","last_fullsized":"2024-09-13T18:01:49.357037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:19.104048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.881791+0000","last_change":"2024-09-13T18:01:46.339384+0000","last_active":"2024-09-13T18:01:47.881791+0000","last_peered":"2024-09-13T18:01:47.881791+0000","last_clean":"2024-09-13T18:01:47.881791+0000","last_became_active":"2024-09-13T18:01:46.338962+0000","last_became_peered":"2024-09-13T18:01:46.338962+0000","last_unstale":"2024-09-13T18:01:47.881791+0000","last_undegraded":"2024-09-13T18:01:47.881791+0000","last_fullsized":"2024-09-13T18:01:47.881791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:09.452756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.063275+0000","last_change":"2024-09-13T18:01:45.907717+0000","last_active":"2024-09-13T18:01:52.063275+0000","last_peered":"2024-09-13T18:01:52.063275+0000","last_clean":"2024-09-13T18:01:52.063275+0000","last_became_active":"2024-09-13T18:01:45.907022+0000","last_became_peered":"2024-09-13T18:01:45.907022+0000","last_unstale":"2024-09-13T18:01:52.063275+0000","last_undegraded":"2024-09-13T18:01:52.063275+0000","last_fullsized":"2024-09-13T18:01:52.063275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:16.800561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.109645+0000","last_change":"2024-09-13T18:01:46.341053+0000","last_active":"2024-09-13T18:01:47.109645+0000","last_peered":"2024-09-13T18:01:47.109645+0000","last_clean":"2024-09-13T18:01:47.109645+0000","last_became_active":"2024-09-13T18:01:46.340729+0000","last_became_peered":"2024-09-13T18:01:46.340729+0000","last_unstale":"2024-09-13T18:01:47.109645+0000","last_undegraded":"2024-09-13T18:01:47.109645+0000","last_fullsized":"2024-09-13T18:01:47.109645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:10.585837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882370+0000","last_change":"2024-09-13T18:01:45.908841+0000","last_active":"2024-09-13T18:01:47.882370+0000","last_peered":"2024-09-13T18:01:47.882370+0000","last_clean":"2024-09-13T18:01:47.882370+0000","last_became_active":"2024-09-13T18:01:45.907809+0000","last_became_peered":"2024-09-13T18:01:45.907809+0000","last_unstale":"2024-09-13T18:01:47.882370+0000","last_undegraded":"2024-09-13T18:01:47.882370+0000","last_fullsized":"2024-09-13T18:01:47.882370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:28.830672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326491+0000","last_change":"2024-09-13T18:01:46.351532+0000","last_active":"2024-09-13T18:01:47.326491+0000","last_peered":"2024-09-13T18:01:47.326491+0000","last_clean":"2024-09-13T18:01:47.326491+0000","last_became_active":"2024-09-13T18:01:46.350476+0000","last_became_peered":"2024-09-13T18:01:46.350476+0000","last_unstale":"2024-09-13T18:01:47.326491+0000","last_undegraded":"2024-09-13T18:01:47.326491+0000","last_fullsized":"2024-09-13T18:01:47.326491+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:30.558987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:49.356264+0000","last_change":"2024-09-13T18:01:45.909496+0000","last_active":"2024-09-13T18:01:49.356264+0000","last_peered":"2024-09-13T18:01:49.356264+0000","last_clean":"2024-09-13T18:01:49.356264+0000","last_became_active":"2024-09-13T18:01:45.906362+0000","last_became_peered":"2024-09-13T18:01:45.906362+0000","last_unstale":"2024-09-13T18:01:49.356264+0000","last_undegraded":"2024-09-13T18:01:49.356264+0000","last_fullsized":"2024-09-13T18:01:49.356264+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:00.508637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.329303+0000","last_change":"2024-09-13T18:01:46.344087+0000","last_active":"2024-09-13T18:01:47.329303+0000","last_peered":"2024-09-13T18:01:47.329303+0000","last_clean":"2024-09-13T18:01:47.329303+0000","last_became_active":"2024-09-13T18:01:46.343801+0000","last_became_peered":"2024-09-13T18:01:46.343801+0000","last_unstale":"2024-09-13T18:01:47.329303+0000","last_undegraded":"2024-09-13T18:01:47.329303+0000","last_fullsized":"2024-09-13T18:01:47.329303+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:11.305588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.327366+0000","last_change":"2024-09-13T18:01:46.350596+0000","last_active":"2024-09-13T18:01:47.327366+0000","last_peered":"2024-09-13T18:01:47.327366+0000","last_clean":"2024-09-13T18:01:47.327366+0000","last_became_active":"2024-09-13T18:01:46.350171+0000","last_became_peered":"2024-09-13T18:01:46.350171+0000","last_unstale":"2024-09-13T18:01:47.327366+0000","last_undegraded":"2024-09-13T18:01:47.327366+0000","last_fullsized":"2024-09-13T18:01:47.327366+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:53.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.064923+0000","last_change":"2024-09-13T18:01:45.904016+0000","last_active":"2024-09-13T18:01:52.064923+0000","last_peered":"2024-09-13T18:01:52.064923+0000","last_clean":"2024-09-13T18:01:52.064923+0000","last_became_active":"2024-09-13T18:01:45.903446+0000","last_became_peered":"2024-09-13T18:01:45.903446+0000","last_unstale":"2024-09-13T18:01:52.064923+0000","last_undegraded":"2024-09-13T18:01:52.064923+0000","last_fullsized":"2024-09-13T18:01:52.064923+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:57.308647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.315855+0000","last_change":"2024-09-13T18:01:46.341346+0000","last_active":"2024-09-13T18:01:47.315855+0000","last_peered":"2024-09-13T18:01:47.315855+0000","last_clean":"2024-09-13T18:01:47.315855+0000","last_became_active":"2024-09-13T18:01:46.340969+0000","last_became_peered":"2024-09-13T18:01:46.340969+0000","last_unstale":"2024-09-13T18:01:47.315855+0000","last_undegraded":"2024-09-13T18:01:47.315855+0000","last_fullsized":"2024-09-13T18:01:47.315855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:17.664968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'11","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:52.065405+0000","last_change":"2024-09-13T18:01:45.906196+0000","last_active":"2024-09-13T18:01:52.065405+0000","last_peered":"2024-09-13T18:01:52.065405+0000","last_clean":"2024-09-13T18:01:52.065405+0000","last_became_active":"2024-09-13T18:01:45.905867+0000","last_became_peered":"2024-09-13T18:01:45.905867+0000","last_unstale":"2024-09-13T18:01:52.065405+0000","last_undegraded":"2024-09-13T18:01:52.065405+0000","last_fullsized":"2024-09-13T18:01:52.065405+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:06.525027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.900699+0000","last_change":"2024-09-13T18:01:46.342392+0000","last_active":"2024-09-13T18:01:47.900699+0000","last_peered":"2024-09-13T18:01:47.900699+0000","last_clean":"2024-09-13T18:01:47.900699+0000","last_became_active":"2024-09-13T18:01:46.341822+0000","last_became_peered":"2024-09-13T18:01:46.341822+0000","last_unstale":"2024-09-13T18:01:47.900699+0000","last_undegraded":"2024-09-13T18:01:47.900699+0000","last_fullsized":"2024-09-13T18:01:47.900699+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:13.008898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":14,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.928354+0000","last_change":"2024-09-13T18:01:45.907263+0000","last_active":"2024-09-13T18:01:47.928354+0000","last_peered":"2024-09-13T18:01:47.928354+0000","last_clean":"2024-09-13T18:01:47.928354+0000","last_became_active":"2024-09-13T18:01:45.906956+0000","last_became_peered":"2024-09-13T18:01:45.906956+0000","last_unstale":"2024-09-13T18:01:47.928354+0000","last_undegraded":"2024-09-13T18:01:47.928354+0000","last_fullsized":"2024-09-13T18:01:47.928354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:49.474806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.326701+0000","last_change":"2024-09-13T18:01:46.350698+0000","last_active":"2024-09-13T18:01:47.326701+0000","last_peered":"2024-09-13T18:01:47.326701+0000","last_clean":"2024-09-13T18:01:47.326701+0000","last_became_active":"2024-09-13T18:01:46.348569+0000","last_became_peered":"2024-09-13T18:01:46.348569+0000","last_unstale":"2024-09-13T18:01:47.326701+0000","last_undegraded":"2024-09-13T18:01:47.326701+0000","last_fullsized":"2024-09-13T18:01:47.326701+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:21.104362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"85'4","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-09-13T18:01:47.882702+0000","last_change":"2024-09-13T18:01:45.911508+0000","last_active":"2024-09-13T18:01:47.882702+0000","last_peered":"2024-09-13T18:01:47.882702+0000","last_clean":"2024-09-13T18:01:47.882702+0000","last_became_active":"2024-09-13T18:01:45.910098+0000","last_became_peered":"2024-09-13T18:01:45.910098+0000","last_unstale":"2024-09-13T18:01:47.882702+0000","last_undegraded":"2024-09-13T18:01:47.882702+0000","last_fullsized":"2024-09-13T18:01:47.882702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:36.875831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":13507,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":167,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":307200,"data_stored":33516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892350989,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":925696,"data_stored":442521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]}]},{"osd":10,"up_from":73,"seq":313532612625,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1035917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.32800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.468,"5min":1.468,"15min":1.468},"last":0.70499999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.499},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.927,"5min":2.927,"15min":2.927},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45100000000000001}]},{"osd":8,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.61599999999999999}]},{"osd":9,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.58699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":9,"up_from":68,"seq":292057776150,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":925696,"data_stored":442521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.58499999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.79900000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.78100000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.84299999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.91000000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.88300000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.96199999999999997}]}]},{"osd":8,"up_from":60,"seq":257698037789,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":954368,"data_stored":443439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69999999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57399999999999995,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79900000000000004,"5min":0.875,"15min":0.875},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.501,"15min":0.502},"min":{"1min":0.38,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63300000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.499},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.41599999999999998,"15min":0.41399999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60399999999999998,"15min":0.60799999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.72999999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.61099999999999999,"15min":0.622},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76200000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58099999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.752,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.42299999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76800000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.47799999999999998,"15min":0.47399999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.72699999999999998,"5min":1.016,"15min":1.016},"last":0.372}]},{"osd":6,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64600000000000002,"15min":0.65300000000000002},"min":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.78800000000000003,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53900000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.42999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86699999999999999,"5min":1.05,"15min":1.05},"last":0.59299999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.64100000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":7,"up_from":52,"seq":223338299425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32624,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712528,"statfs":{"total":95995035648,"available":95961628672,"internally_reserved":0,"allocated":1548288,"data_stored":1035697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.41299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56599999999999995,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.41799999999999998,"15min":0.42199999999999999},"min":{"1min":0.27900000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.55900000000000005,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58499999999999996,"15min":0.58299999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61399999999999999,"15min":0.60699999999999998},"min":{"1min":0.42699999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.34300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46000000000000002,"15min":0.46100000000000002},"min":{"1min":0.30499999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.307}]},{"osd":5,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.61199999999999999,"15min":0.60799999999999998},"min":{"1min":0.48799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":0.874,"15min":0.874},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.63200000000000001,"15min":0.63400000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77600000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67800000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.66400000000000003,"15min":0.65800000000000003},"min":{"1min":0.439,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.504}]},{"osd":8,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.63500000000000001,"15min":0.63200000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.48999999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70099999999999996}]},{"osd":9,"last update":"Fri Sep 13 18:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.57399999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:01:33 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.437}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462950,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":442340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.48999999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.68500000000000005,"15min":0.67400000000000004},"min":{"1min":0.47799999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.33500000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.52200000000000002,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.437},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.64700000000000002,"15min":0.63700000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.69999999999999996,"15min":0.70199999999999996},"min":{"1min":0.40699999999999997,"5min":0.375,"15min":0.375},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.752,"15min":0.746},"min":{"1min":0.54000000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":0.39400000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.78600000000000003,"15min":0.77600000000000002},"min":{"1min":0.501,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.79000000000000004,"15min":0.78500000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.83199999999999996,"15min":0.83699999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.073,"5min":1.706,"15min":1.706},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82999999999999996,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.1839999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.78200000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.61399999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.012,"5min":1.631,"15min":1.631},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.875,"15min":0.88300000000000001},"min":{"1min":0.621,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0029999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.88300000000000001}]},{"osd":9,"last update":"Fri Sep 13 18:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.89900000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.82399999999999995}]}]},{"osd":5,"up_from":39,"seq":167503724588,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32632,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712520,"statfs":{"total":95995035648,"available":95961620480,"internally_reserved":0,"allocated":1556480,"data_stored":1035140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.77300000000000002,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.69499999999999995,"5min":0.745,"15min":0.745},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.67400000000000004,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.36699999999999999,"15min":0.36599999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.442}]},{"osd":3,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59399999999999997,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.751,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.42999999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.749,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70499999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:01:28 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.72899999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:00:59 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":1.143,"15min":1.2230000000000001},"min":{"1min":0.505,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.88800000000000001,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64300000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47399999999999998,"15min":0.47799999999999998},"min":{"1min":0.32800000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.32800000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59499999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71499999999999997}]},{"osd":10,"last update":"Fri Sep 13 18:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.69299999999999995}]}]},{"osd":4,"up_from":34,"seq":146028888113,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32028,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713124,"statfs":{"total":95995035648,"available":95962238976,"internally_reserved":0,"allocated":937984,"data_stored":442557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.47099999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74299999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.51400000000000001,"15min":0.48899999999999999},"min":{"1min":0.38300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.54600000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33800000000000002,"15min":0.33600000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.48599999999999999,"5min":0.499,"15min":0.499},"last":0.38},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.34899999999999998,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.48899999999999999,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73299999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.50600000000000001,"15min":0.498},"min":{"1min":0.34999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.53000000000000003,"15min":0.51000000000000001},"min":{"1min":0.374,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91400000000000003,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.62}]},{"osd":5,"last update":"Fri Sep 13 18:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.77400000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68500000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:01:00 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.63300000000000001,"15min":0.625},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.623,"15min":0.61699999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.47099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.44900000000000001,"15min":0.45000000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68700000000000006,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.68899999999999995,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.42599999999999999}]},{"osd":8,"last update":"Fri Sep 13 18:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.39500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82499999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.624,"15min":0.625},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.76400000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59399999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:01:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.75700000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:01:36 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149749,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36136,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709016,"statfs":{"total":95995035648,"available":95958032384,"internally_reserved":0,"allocated":950272,"data_stored":442155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.45200000000000001,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45300000000000001,"15min":0.41499999999999998},"min":{"1min":0.34200000000000003,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.372}]},{"osd":1,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.59199999999999997,"15min":0.54800000000000004},"min":{"1min":0.45000000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.62,"15min":0.59799999999999998},"min":{"1min":0.45900000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.96699999999999997,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.73099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63900000000000001,"15min":0.60499999999999998},"min":{"1min":0.49399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.71399999999999997,"15min":0.63700000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94999999999999996,"5min":6.8520000000000003,"15min":6.8520000000000003},"last":0.627}]},{"osd":4,"last update":"Fri Sep 13 18:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.56899999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.90200000000000002,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.502},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69299999999999995,"15min":0.67600000000000005},"min":{"1min":0.48799999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98399999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.62,"15min":0.59999999999999998},"min":{"1min":0.41999999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.61699999999999999,"15min":0.59099999999999997},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.752}]},{"osd":7,"last update":"Fri Sep 13 18:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.71099999999999997,"15min":0.69299999999999995},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.88300000000000001}]},{"osd":8,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0580000000000001,"5min":1.421,"15min":1.421},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.115,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.80200000000000005}]},{"osd":9,"last update":"Fri Sep 13 18:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.45800000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.93899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":937984,"data_stored":443537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.52900000000000003,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.48999999999999999},"min":{"1min":0.42499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.499},"min":{"1min":0.42599999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59899999999999998,"15min":0.57899999999999996},"min":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.58999999999999997,"15min":0.58499999999999996},"min":{"1min":0.37,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71499999999999997,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52600000000000002,"15min":0.51400000000000001},"min":{"1min":0.42199999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.506,"5min":0.72499999999999998,"15min":0.59699999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":14.991,"5min":14.991,"15min":14.991},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.38200000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.315},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40699999999999997,"15min":0.39700000000000002},"min":{"1min":0.27900000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.33700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:00:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.61099999999999999,"15min":0.60499999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60499999999999998,"15min":0.59999999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.56699999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.443}]},{"osd":8,"last update":"Fri Sep 13 18:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.51800000000000002,"15min":0.52800000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.374},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.52300000000000002,"15min":0.53100000000000003},"min":{"1min":0.34300000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.38600000000000001}]},{"osd":9,"last update":"Fri Sep 13 18:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.499}]},{"osd":10,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.54000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":451535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:00:50 2024","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":0.61599999999999999,"15min":0.54200000000000004},"min":{"1min":0.33000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":10.179,"5min":10.179,"15min":10.179},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.101,"5min":0.63400000000000001,"15min":0.55300000000000005},"min":{"1min":0.35099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":10.117000000000001,"5min":10.117000000000001,"15min":10.117000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:01:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.58199999999999996,"15min":0.49199999999999999},"min":{"1min":0.37,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73099999999999998,"5min":8.593,"15min":8.593},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.498,"15min":0.47299999999999998},"min":{"1min":0.37,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:01:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.45700000000000002,"5min":0.377,"15min":0.377},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57899999999999996,"15min":0.57199999999999995},"min":{"1min":0.39600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89200000000000002,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.373},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.66800000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:01:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.40999999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86399999999999999,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56499999999999995,"15min":0.54900000000000004},"min":{"1min":0.39700000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.73599999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:00:57 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":0.70899999999999996,"15min":0.63500000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":10.161,"5min":10.161,"15min":10.161},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.626}]},{"osd":7,"last update":"Fri Sep 13 18:01:18 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.502,"15min":0.49399999999999999},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.47899999999999998},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51800000000000002}]},{"osd":8,"last update":"Fri Sep 13 18:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.93799999999999994,"15min":1.0009999999999999},"min":{"1min":0.39500000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80800000000000005,"5min":10.141,"15min":10.141},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.5,"5min":0.435,"15min":0.435},"max":{"1min":0.96699999999999997,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.69699999999999995}]},{"osd":9,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.63900000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.499},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.77400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36120,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93709032,"statfs":{"total":95995035648,"available":95958048768,"internally_reserved":0,"allocated":929792,"data_stored":442360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.875},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:01:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77700000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.60099999999999998,"15min":0.57799999999999996},"min":{"1min":0.442,"5min":0.373,"15min":0.373},"max":{"1min":0.90100000000000002,"5min":1.012,"15min":1.012},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.52500000000000002,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.55200000000000005,"15min":0.51600000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.79000000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:01:06 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.63700000000000001,"15min":0.61099999999999999},"min":{"1min":0.46000000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.46600000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69399999999999995,"15min":0.66900000000000004},"min":{"1min":0.51000000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.99199999999999999,"5min":1.016,"15min":1.016},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.64100000000000001,"15min":0.61099999999999999},"min":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92100000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:00:58 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.746,"15min":0.72899999999999998},"min":{"1min":0.56399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83299999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79400000000000004,"15min":0.78200000000000003},"min":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.73299999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:01:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.876,"15min":0.89200000000000002},"min":{"1min":0.56499999999999995,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.97199999999999998,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.58199999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.95399999999999996,"5min":1.04,"15min":1.04},"last":0.72899999999999998}]},{"osd":9,"last update":"Fri Sep 13 18:01:10 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.82099999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:01:34 2024","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.93300000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":9869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":9853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:01:55.383 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:01:55.384 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T18:01:55.384 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T18:01:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:55 smithi122 ceph-mon[35310]: pgmap v295: 97 pgs: 97 active+clean; 590 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 8.8 KiB/s wr, 25 op/s 2024-09-13T18:01:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:55 smithi122 ceph-mon[35310]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:55 smithi122 ceph-mon[35310]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T18:01:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:55 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2542543255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:55 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1907353906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:55.464 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:55 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b[65606]: 2024-09-13T18:01:55.226+0000 7f5fc32cf640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-13T18:01:55.464 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:01:55 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b[65606]: 2024-09-13T18:01:55.226+0000 7f5fc32cf640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-13T18:01:55.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:55 smithi143 ceph-mon[38210]: pgmap v295: 97 pgs: 97 active+clean; 590 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 8.8 KiB/s wr, 25 op/s 2024-09-13T18:01:55.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:55 smithi143 ceph-mon[38210]: from='client.14646 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:01:55.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:55 smithi143 ceph-mon[38210]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-13T18:01:55.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:55 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2542543255' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:01:55.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:55 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1907353906' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:01:55.744 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:01:56.153 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:56 smithi027 ceph-mon[30611]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:01:56.153 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:56 smithi027 ceph-mon[30611]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:01:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:56 smithi122 ceph-mon[35310]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:01:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:56 smithi122 ceph-mon[35310]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:01:56.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:56 smithi143 ceph-mon[38210]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:01:56.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:56 smithi143 ceph-mon[38210]: from='client.14670 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:01:57.387 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:57 smithi027 ceph-mon[30611]: pgmap v296: 97 pgs: 97 active+clean; 591 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7.7 KiB/s wr, 26 op/s 2024-09-13T18:01:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:57 smithi122 ceph-mon[35310]: pgmap v296: 97 pgs: 97 active+clean; 591 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7.7 KiB/s wr, 26 op/s 2024-09-13T18:01:57.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:57 smithi143 ceph-mon[38210]: pgmap v296: 97 pgs: 97 active+clean; 591 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 7.7 KiB/s wr, 26 op/s 2024-09-13T18:01:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.839+0000 7fa683600640 1 -- 172.21.15.27:0/162210256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c103210 msgr2=0x7fa67c103690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.839+0000 7fa683600640 1 --2- 172.21.15.27:0/162210256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c103210 0x7fa67c103690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa664009900 tx=0x7fa66402a410 comp rx=0 tx=0).stop 2024-09-13T18:01:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.839+0000 7fa683600640 1 -- 172.21.15.27:0/162210256 shutdown_connections 2024-09-13T18:01:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.839+0000 7fa683600640 1 --2- 172.21.15.27:0/162210256 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c103bd0 0x7fa67c10a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.839+0000 7fa683600640 1 --2- 172.21.15.27:0/162210256 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c103210 0x7fa67c103690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.839+0000 7fa683600640 1 --2- 172.21.15.27:0/162210256 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c102010 0x7fa67c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.839+0000 7fa683600640 1 -- 172.21.15.27:0/162210256 >> 172.21.15.27:0/162210256 conn(0x7fa67c0fd7a0 msgr2=0x7fa67c0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.839+0000 7fa683600640 1 -- 172.21.15.27:0/162210256 shutdown_connections 2024-09-13T18:01:57.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.839+0000 7fa683600640 1 -- 172.21.15.27:0/162210256 wait complete. 2024-09-13T18:01:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.840+0000 7fa683600640 1 Processor -- start 2024-09-13T18:01:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa683600640 1 -- start start 2024-09-13T18:01:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa683600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c102010 0x7fa67c198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa683600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c103210 0x7fa67c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa683600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c103bd0 0x7fa67c19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa683600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c19fc00 con 0x7fa67c102010 2024-09-13T18:01:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa683600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c19fd70 con 0x7fa67c103bd0 2024-09-13T18:01:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa683600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67c19ff30 con 0x7fa67c103210 2024-09-13T18:01:57.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa680c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c102010 0x7fa67c198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa680c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c102010 0x7fa67c198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:51196/0 (socket says 172.21.15.27:51196) 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa680c00640 1 -- 172.21.15.27:0/655421815 learned_addr learned my addr 172.21.15.27:0/655421815 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa673e00640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c103210 0x7fa67c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.841+0000 7fa681600640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c103bd0 0x7fa67c19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.842+0000 7fa680c00640 1 -- 172.21.15.27:0/655421815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c103210 msgr2=0x7fa67c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.842+0000 7fa680c00640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c103210 0x7fa67c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.842+0000 7fa680c00640 1 -- 172.21.15.27:0/655421815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c103bd0 msgr2=0x7fa67c19f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.842+0000 7fa680c00640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c103bd0 0x7fa67c19f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.842+0000 7fa680c00640 1 -- 172.21.15.27:0/655421815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664009560 con 0x7fa67c102010 2024-09-13T18:01:57.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.842+0000 7fa680c00640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c102010 0x7fa67c198100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00d950 tx=0x7fa66c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.842+0000 7fa67a000640 1 -- 172.21.15.27:0/655421815 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c009c30 con 0x7fa67c102010 2024-09-13T18:01:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.842+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c1a0210 con 0x7fa67c102010 2024-09-13T18:01:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.842+0000 7fa67a000640 1 -- 172.21.15.27:0/655421815 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa66c009d90 con 0x7fa67c102010 2024-09-13T18:01:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.843+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67c1a0690 con 0x7fa67c102010 2024-09-13T18:01:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.843+0000 7fa67a000640 1 -- 172.21.15.27:0/655421815 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00f740 con 0x7fa67c102010 2024-09-13T18:01:57.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.844+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa67c102410 con 0x7fa67c102010 2024-09-13T18:01:57.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.846+0000 7fa67a000640 1 -- 172.21.15.27:0/655421815 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa66c010460 con 0x7fa67c102010 2024-09-13T18:01:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.847+0000 7fa67a000640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa6600a1140 0x7fa6600a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:01:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.847+0000 7fa67a000640 1 -- 172.21.15.27:0/655421815 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa66c0cc6a0 con 0x7fa67c102010 2024-09-13T18:01:57.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.847+0000 7fa673e00640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa6600a1140 0x7fa6600a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:01:57.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.848+0000 7fa673e00640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa6600a1140 0x7fa6600a3600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa664005ab0 tx=0x7fa664005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:01:57.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:57.850+0000 7fa67a000640 1 -- 172.21.15.27:0/655421815 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa66c095e30 con 0x7fa67c102010 2024-09-13T18:01:58.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.099+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fa67c109400 con 0x7fa67c102010 2024-09-13T18:01:58.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.103+0000 7fa67a000640 1 -- 172.21.15.27:0/655421815 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7fa66c0210f0 con 0x7fa67c102010 2024-09-13T18:01:58.105 INFO:teuthology.orchestra.run.smithi027.stdout:[client.0] 2024-09-13T18:01:58.105 INFO:teuthology.orchestra.run.smithi027.stdout: key = AQAWfuRmkO78BRAAI5g8q/lGyv02D3/MiFXUxA== 2024-09-13T18:01:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.105+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa6600a1140 msgr2=0x7fa6600a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.105+0000 7fa683600640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa6600a1140 0x7fa6600a3600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa664005ab0 tx=0x7fa664005a20 comp rx=0 tx=0).stop 2024-09-13T18:01:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c102010 msgr2=0x7fa67c198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:01:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c102010 0x7fa67c198100 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00d950 tx=0x7fa66c00de10 comp rx=0 tx=0).stop 2024-09-13T18:01:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 shutdown_connections 2024-09-13T18:01:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa6600a1140 0x7fa6600a3600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa67c103bd0 0x7fa67c19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:58.108 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa67c103210 0x7fa67c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 --2- 172.21.15.27:0/655421815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa67c102010 0x7fa67c198100 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:01:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 >> 172.21.15.27:0/655421815 conn(0x7fa67c0fd7a0 msgr2=0x7fa67c1065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:01:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 shutdown_connections 2024-09-13T18:01:58.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:01:58.106+0000 7fa683600640 1 -- 172.21.15.27:0/655421815 wait complete. 2024-09-13T18:01:59.040 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T18:01:59.040 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T18:01:59.040 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:01:59.125 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:01:59.125 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:01:59.125 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T18:01:59.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:59 smithi143 ceph-mon[38210]: pgmap v297: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 KiB/s wr, 28 op/s 2024-09-13T18:01:59.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:59 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/655421815' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:01:59.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:01:59 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/655421815' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:01:59.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:59 smithi027 ceph-mon[30611]: pgmap v297: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 KiB/s wr, 28 op/s 2024-09-13T18:01:59.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:59 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/655421815' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:01:59.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:01:59 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/655421815' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:01:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:59 smithi122 ceph-mon[35310]: pgmap v297: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 11 KiB/s wr, 28 op/s 2024-09-13T18:01:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:59 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/655421815' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T18:01:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:01:59 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/655421815' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T18:01:59.494 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:01.343 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:01 smithi027 ceph-mon[30611]: pgmap v298: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.9 KiB/s wr, 25 op/s 2024-09-13T18:02:01.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.455+0000 7fccc3200640 1 -- 172.21.15.27:0/1004487303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccbc106fa0 msgr2=0x7fccbc10aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:01.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.455+0000 7fccc3200640 1 --2- 172.21.15.27:0/1004487303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccbc106fa0 0x7fccbc10aff0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009930 tx=0x7fcca802a420 comp rx=0 tx=0).stop 2024-09-13T18:02:01.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.455+0000 7fccc3200640 1 -- 172.21.15.27:0/1004487303 shutdown_connections 2024-09-13T18:02:01.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.455+0000 7fccc3200640 1 --2- 172.21.15.27:0/1004487303 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccbc10b720 0x7fccbc1132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.455+0000 7fccc3200640 1 --2- 172.21.15.27:0/1004487303 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccbc106fa0 0x7fccbc10aff0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.458 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.455+0000 7fccc3200640 1 --2- 172.21.15.27:0/1004487303 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccbc1065f0 0x7fccbc1069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.455+0000 7fccc3200640 1 -- 172.21.15.27:0/1004487303 >> 172.21.15.27:0/1004487303 conn(0x7fccbc075d10 msgr2=0x7fccbc078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:01.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.456+0000 7fccc3200640 1 -- 172.21.15.27:0/1004487303 shutdown_connections 2024-09-13T18:02:01.459 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.456+0000 7fccc3200640 1 -- 172.21.15.27:0/1004487303 wait complete. 2024-09-13T18:02:01.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.457+0000 7fccc3200640 1 Processor -- start 2024-09-13T18:02:01.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.457+0000 7fccc3200640 1 -- start start 2024-09-13T18:02:01.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.457+0000 7fccc3200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccbc1065f0 0x7fccbc19ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:01.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.457+0000 7fccc3200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccbc106fa0 0x7fccbc19cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:01.460 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.457+0000 7fccc3200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccbc10b720 0x7fccbc1a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.457+0000 7fccc3200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc1a1930 con 0x7fccbc106fa0 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.457+0000 7fccc3200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc1a1aa0 con 0x7fccbc1065f0 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.457+0000 7fccc3200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc1a1c60 con 0x7fccbc10b720 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.457+0000 7fccbbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccbc1065f0 0x7fccbc19ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccbc1065f0 0x7fccbc19ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:39520/0 (socket says 172.21.15.27:39520) 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbbe00640 1 -- 172.21.15.27:0/1911378859 learned_addr learned my addr 172.21.15.27:0/1911378859 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbb400640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccbc106fa0 0x7fccbc19cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccc1200640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccbc10b720 0x7fccbc1a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbb400640 1 -- 172.21.15.27:0/1911378859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccbc10b720 msgr2=0x7fccbc1a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbb400640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccbc10b720 0x7fccbc1a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbb400640 1 -- 172.21.15.27:0/1911378859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccbc1065f0 msgr2=0x7fccbc19ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbb400640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccbc1065f0 0x7fccbc19ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbb400640 1 -- 172.21.15.27:0/1911378859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca8009560 con 0x7fccbc106fa0 2024-09-13T18:02:01.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbbe00640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccbc1065f0 0x7fccbc19ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:01.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccc1200640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccbc10b720 0x7fccbc1a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:01.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.458+0000 7fccbb400640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccbc106fa0 0x7fccbc19cf50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009230 tx=0x7fcca8005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:01.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.459+0000 7fccb8c00640 1 -- 172.21.15.27:0/1911378859 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8004b50 con 0x7fccbc106fa0 2024-09-13T18:02:01.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.459+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc1a1ee0 con 0x7fccbc106fa0 2024-09-13T18:02:01.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.459+0000 7fccb8c00640 1 -- 172.21.15.27:0/1911378859 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcca8004cb0 con 0x7fccbc106fa0 2024-09-13T18:02:01.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.459+0000 7fccb8c00640 1 -- 172.21.15.27:0/1911378859 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca8031a00 con 0x7fccbc106fa0 2024-09-13T18:02:01.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.459+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc1a2180 con 0x7fccbc106fa0 2024-09-13T18:02:01.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.460+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccbc107ad0 con 0x7fccbc106fa0 2024-09-13T18:02:01.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:01 smithi122 ceph-mon[35310]: pgmap v298: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.9 KiB/s wr, 25 op/s 2024-09-13T18:02:01.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.462+0000 7fccb8c00640 1 -- 172.21.15.27:0/1911378859 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fcca8003c60 con 0x7fccbc106fa0 2024-09-13T18:02:01.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.463+0000 7fccb8c00640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcca00a1110 0x7fcca00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:01.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.464+0000 7fccb8c00640 1 -- 172.21.15.27:0/1911378859 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcca80edae0 con 0x7fccbc106fa0 2024-09-13T18:02:01.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.464+0000 7fccbbe00640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcca00a1110 0x7fcca00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:01.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.464+0000 7fccbbe00640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcca00a1110 0x7fcca00a35d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fccac005fd0 tx=0x7fccac00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:01.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.467+0000 7fccb8c00640 1 -- 172.21.15.27:0/1911378859 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fcca80b7390 con 0x7fccbc106fa0 2024-09-13T18:02:01.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:01 smithi143 ceph-mon[38210]: pgmap v298: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.9 KiB/s wr, 25 op/s 2024-09-13T18:02:01.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.694+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fccbc10e900 con 0x7fccbc106fa0 2024-09-13T18:02:01.703 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.701+0000 7fccb8c00640 1 -- 172.21.15.27:0/1911378859 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260282 (secure 0 0 0) 0x7fcca8035090 con 0x7fccbc106fa0 2024-09-13T18:02:01.707 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcca00a1110 msgr2=0x7fcca00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcca00a1110 0x7fcca00a35d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fccac005fd0 tx=0x7fccac00b4a0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccbc106fa0 msgr2=0x7fccbc19cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccbc106fa0 0x7fccbc19cf50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009230 tx=0x7fcca8005620 comp rx=0 tx=0).stop 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 shutdown_connections 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fcca00a1110 0x7fcca00a35d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fccbc10b720 0x7fccbc1a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fccbc106fa0 0x7fccbc19cf50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 --2- 172.21.15.27:0/1911378859 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fccbc1065f0 0x7fccbc19ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.705+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 >> 172.21.15.27:0/1911378859 conn(0x7fccbc075d10 msgr2=0x7fccbc0771d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.706+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 shutdown_connections 2024-09-13T18:02:01.709 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:01.706+0000 7fccc3200640 1 -- 172.21.15.27:0/1911378859 wait complete. 2024-09-13T18:02:02.466 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:02 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1911378859' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T18:02:02.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:02 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1911378859' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T18:02:02.539 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:02 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1911378859' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T18:02:02.573 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6800","nonce":3586663065},{"type":"v1","addr":"172.21.15.27:6801","nonce":3586663065}]},"active_addr":"172.21.15.27:6801/3586663065","active_change":"2024-09-13T17:54:35.275587+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.27:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":296181992}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":3892744305}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":1430092829}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":46997650}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.27:0","nonce":343943177}]}]} 2024-09-13T18:02:02.579 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T18:02:02.579 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T18:02:02.579 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T18:02:02.907 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:03.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:03 smithi027 ceph-mon[30611]: pgmap v299: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.0 KiB/s wr, 22 op/s 2024-09-13T18:02:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:03 smithi122 ceph-mon[35310]: pgmap v299: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.0 KiB/s wr, 22 op/s 2024-09-13T18:02:03.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:03 smithi143 ceph-mon[38210]: pgmap v299: 97 pgs: 97 active+clean; 626 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.0 KiB/s wr, 22 op/s 2024-09-13T18:02:04.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.946+0000 7f0ca1400640 1 -- 172.21.15.27:0/3725516336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9c1029c0 msgr2=0x7f0c9c106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:04.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.946+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3725516336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9c1029c0 0x7f0c9c106a10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0c88009930 tx=0x7f0c8802a420 comp rx=0 tx=0).stop 2024-09-13T18:02:04.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.946+0000 7f0ca1400640 1 -- 172.21.15.27:0/3725516336 shutdown_connections 2024-09-13T18:02:04.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.946+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3725516336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c9c107140 0x7f0c9c10ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:04.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.946+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3725516336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9c1029c0 0x7f0c9c106a10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:04.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.946+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3725516336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9c102010 0x7f0c9c1023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:04.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.946+0000 7f0ca1400640 1 -- 172.21.15.27:0/3725516336 >> 172.21.15.27:0/3725516336 conn(0x7f0c9c0fda70 msgr2=0x7f0c9c0ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:04.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.946+0000 7f0ca1400640 1 -- 172.21.15.27:0/3725516336 shutdown_connections 2024-09-13T18:02:04.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.946+0000 7f0ca1400640 1 -- 172.21.15.27:0/3725516336 wait complete. 2024-09-13T18:02:04.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.947+0000 7f0ca1400640 1 Processor -- start 2024-09-13T18:02:04.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0ca1400640 1 -- start start 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0ca1400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c9c102010 0x7f0c9c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0ca1400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9c1029c0 0x7f0c9c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0ca1400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9c107140 0x7f0c9c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0ca1400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c19d230 con 0x7f0c9c1029c0 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0ca1400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c19d3a0 con 0x7f0c9c102010 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0ca1400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9c19d510 con 0x7f0c9c107140 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0c9be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c9c102010 0x7f0c9c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0c9be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c9c102010 0x7f0c9c1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:39528/0 (socket says 172.21.15.27:39528) 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0c9be00640 1 -- 172.21.15.27:0/3015469019 learned_addr learned my addr 172.21.15.27:0/3015469019 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.948+0000 7f0c9b400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9c1029c0 0x7f0c9c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:04.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0ca0a00640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9c107140 0x7f0c9c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c9be00640 1 -- 172.21.15.27:0/3015469019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9c107140 msgr2=0x7f0c9c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c9be00640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9c107140 0x7f0c9c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c9be00640 1 -- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9c1029c0 msgr2=0x7f0c9c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c9be00640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9c1029c0 0x7f0c9c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c9be00640 1 -- 172.21.15.27:0/3015469019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c88009560 con 0x7f0c9c102010 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c9b400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9c1029c0 0x7f0c9c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c9be00640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c9c102010 0x7f0c9c1983b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00e9f0 tx=0x7f0c8c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c98c00640 1 -- 172.21.15.27:0/3015469019 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c009700 con 0x7f0c9c102010 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c98c00640 1 -- 172.21.15.27:0/3015469019 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0c8c00cd80 con 0x7f0c9c102010 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c9c19d7f0 con 0x7f0c9c102010 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.949+0000 7f0c98c00640 1 -- 172.21.15.27:0/3015469019 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c018920 con 0x7f0c9c102010 2024-09-13T18:02:04.953 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.950+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c9c1a50b0 con 0x7f0c9c102010 2024-09-13T18:02:04.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.951+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c9c1034f0 con 0x7f0c9c102010 2024-09-13T18:02:04.954 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.953+0000 7f0c98c00640 1 -- 172.21.15.27:0/3015469019 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0c8c018a80 con 0x7f0c9c102010 2024-09-13T18:02:04.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.954+0000 7f0c98c00640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0c800a1180 0x7f0c800a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:04.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.954+0000 7f0c98c00640 1 -- 172.21.15.27:0/3015469019 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0c8c014070 con 0x7f0c9c102010 2024-09-13T18:02:04.956 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.954+0000 7f0c9b400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0c800a1180 0x7f0c800a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:04.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.955+0000 7f0c9b400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0c800a1180 0x7f0c800a3640 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c88006010 tx=0x7f0c88031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:04.957 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:04.956+0000 7f0c98c00640 1 -- 172.21.15.27:0/3015469019 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0c8c096480 con 0x7f0c9c102010 2024-09-13T18:02:05.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.137+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c9c1023f0 con 0x7f0c9c102010 2024-09-13T18:02:05.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.139+0000 7f0c98c00640 1 -- 172.21.15.27:0/3015469019 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22095 (secure 0 0 0) 0x7f0c8c099aa0 con 0x7f0c9c102010 2024-09-13T18:02:05.142 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:02:05.142 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":86,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:01:47.322441+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0c800a1180 msgr2=0x7f0c800a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0c800a1180 0x7f0c800a3640 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0c88006010 tx=0x7f0c88031400 comp rx=0 tx=0).stop 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c9c102010 msgr2=0x7f0c9c1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c9c102010 0x7f0c9c1983b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00e9f0 tx=0x7f0c8c00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 shutdown_connections 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0c800a1180 0x7f0c800a3640 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0c9c107140 0x7f0c9c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0c9c1029c0 0x7f0c9c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 --2- 172.21.15.27:0/3015469019 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0c9c102010 0x7f0c9c1983b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:05.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 >> 172.21.15.27:0/3015469019 conn(0x7f0c9c0fda70 msgr2=0x7f0c9c0fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 shutdown_connections 2024-09-13T18:02:05.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:05.142+0000 7f0ca1400640 1 -- 172.21.15.27:0/3015469019 wait complete. 2024-09-13T18:02:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:05 smithi122 ceph-mon[35310]: pgmap v300: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 KiB/s wr, 26 op/s 2024-09-13T18:02:05.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:05 smithi143 ceph-mon[38210]: pgmap v300: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 KiB/s wr, 26 op/s 2024-09-13T18:02:05.529 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:05 smithi027 ceph-mon[30611]: pgmap v300: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 KiB/s wr, 26 op/s 2024-09-13T18:02:05.842 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T18:02:05.842 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T18:02:06.171 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:06.423 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:06 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3015469019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:02:06.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:06 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3015469019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:02:06.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:06 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3015469019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:02:07.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:07 smithi122 ceph-mon[35310]: pgmap v301: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 4.7 KiB/s wr, 15 op/s 2024-09-13T18:02:07.502 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:07 smithi027 ceph-mon[30611]: pgmap v301: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 4.7 KiB/s wr, 15 op/s 2024-09-13T18:02:07.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:07 smithi143 ceph-mon[38210]: pgmap v301: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 4.7 KiB/s wr, 15 op/s 2024-09-13T18:02:08.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.144+0000 7f5daca00640 1 -- 172.21.15.27:0/3236681768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da8110bc0 msgr2=0x7f5da8112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:08.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.144+0000 7f5daca00640 1 --2- 172.21.15.27:0/3236681768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da8110bc0 0x7f5da8112fb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5da0009ca0 tx=0x7f5da002a950 comp rx=0 tx=0).stop 2024-09-13T18:02:08.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.144+0000 7f5daca00640 1 -- 172.21.15.27:0/3236681768 shutdown_connections 2024-09-13T18:02:08.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.144+0000 7f5daca00640 1 --2- 172.21.15.27:0/3236681768 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da8110bc0 0x7f5da8112fb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.144+0000 7f5daca00640 1 --2- 172.21.15.27:0/3236681768 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5da8073170 0x7f5da8110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.144+0000 7f5daca00640 1 --2- 172.21.15.27:0/3236681768 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da8072850 0x7f5da8072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.144+0000 7f5daca00640 1 -- 172.21.15.27:0/3236681768 >> 172.21.15.27:0/3236681768 conn(0x7f5da80fb870 msgr2=0x7f5da80fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.144+0000 7f5daca00640 1 -- 172.21.15.27:0/3236681768 shutdown_connections 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.144+0000 7f5daca00640 1 -- 172.21.15.27:0/3236681768 wait complete. 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.145+0000 7f5daca00640 1 Processor -- start 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.145+0000 7f5daca00640 1 -- start start 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5daca00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5da8072850 0x7f5da81a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5daca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da8073170 0x7f5da81a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5daca00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da8110bc0 0x7f5da819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5daca00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da819cd40 con 0x7f5da8110bc0 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5daca00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da819ceb0 con 0x7f5da8073170 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5daca00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da819d070 con 0x7f5da8072850 2024-09-13T18:02:08.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da6800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5da8072850 0x7f5da81a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da7200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da8110bc0 0x7f5da819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da6800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5da8072850 0x7f5da81a25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:33096/0 (socket says 172.21.15.27:33096) 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da6800640 1 -- 172.21.15.27:0/2378525425 learned_addr learned my addr 172.21.15.27:0/2378525425 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5d9de00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da8073170 0x7f5da81a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da6800640 1 -- 172.21.15.27:0/2378525425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da8073170 msgr2=0x7f5da81a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da6800640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da8073170 0x7f5da81a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da6800640 1 -- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da8110bc0 msgr2=0x7f5da819c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da6800640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da8110bc0 0x7f5da819c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da6800640 1 -- 172.21.15.27:0/2378525425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da0009900 con 0x7f5da8072850 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.146+0000 7f5da7200640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da8110bc0 0x7f5da819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.147+0000 7f5da6800640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5da8072850 0x7f5da81a25a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800d950 tx=0x7f5d9800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.147+0000 7f5d9fe00640 1 -- 172.21.15.27:0/2378525425 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98009a30 con 0x7f5da8072850 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.147+0000 7f5d9fe00640 1 -- 172.21.15.27:0/2378525425 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5d98009b90 con 0x7f5da8072850 2024-09-13T18:02:08.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.147+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da819d350 con 0x7f5da8072850 2024-09-13T18:02:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.147+0000 7f5d9fe00640 1 -- 172.21.15.27:0/2378525425 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98004a00 con 0x7f5da8072850 2024-09-13T18:02:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.147+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da81a9520 con 0x7f5da8072850 2024-09-13T18:02:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.148+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5da8073f90 con 0x7f5da8072850 2024-09-13T18:02:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.150+0000 7f5d9fe00640 1 -- 172.21.15.27:0/2378525425 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5d98009d00 con 0x7f5da8072850 2024-09-13T18:02:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.151+0000 7f5d9fe00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5d8c0a1100 0x7f5d8c0a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.151+0000 7f5d9fe00640 1 -- 172.21.15.27:0/2378525425 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5d980cc320 con 0x7f5da8072850 2024-09-13T18:02:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.151+0000 7f5d9de00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5d8c0a1100 0x7f5d8c0a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.152+0000 7f5d9de00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5d8c0a1100 0x7f5d8c0a35c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5da819dec0 tx=0x7f5d90005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:08.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.155+0000 7f5d9fe00640 1 -- 172.21.15.27:0/2378525425 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5d98095a00 con 0x7f5da8072850 2024-09-13T18:02:08.340 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.338+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5da8103000 con 0x7f5da8072850 2024-09-13T18:02:08.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.340+0000 7f5d9fe00640 1 -- 172.21.15.27:0/2378525425 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22095 (secure 0 0 0) 0x7f5d98099020 con 0x7f5da8072850 2024-09-13T18:02:08.342 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:02:08.343 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":86,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:01:47.322441+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:02:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5d8c0a1100 msgr2=0x7f5d8c0a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5d8c0a1100 0x7f5d8c0a35c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5da819dec0 tx=0x7f5d90005f90 comp rx=0 tx=0).stop 2024-09-13T18:02:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5da8072850 msgr2=0x7f5da81a25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5da8072850 0x7f5da81a25a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5d9800d950 tx=0x7f5d9800de10 comp rx=0 tx=0).stop 2024-09-13T18:02:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 shutdown_connections 2024-09-13T18:02:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5d8c0a1100 0x7f5d8c0a35c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5da8110bc0 0x7f5da819c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5da8073170 0x7f5da81a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:08.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 --2- 172.21.15.27:0/2378525425 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5da8072850 0x7f5da81a25a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:08.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 >> 172.21.15.27:0/2378525425 conn(0x7f5da80fb870 msgr2=0x7f5da80fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:08.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 shutdown_connections 2024-09-13T18:02:08.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:08.343+0000 7f5daca00640 1 -- 172.21.15.27:0/2378525425 wait complete. 2024-09-13T18:02:09.150 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T18:02:09.150 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T18:02:09.151 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T18:02:09.151 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T18:02:09.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T18:02:09.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T18:02:09.152 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-13T18:02:09.153 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-13T18:02:09.153 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-13T18:02:09.154 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-13T18:02:09.154 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-13T18:02:09.155 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-13T18:02:09.383 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:09 smithi027 ceph-mon[30611]: pgmap v302: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-13T18:02:09.383 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:09 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2378525425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:02:09.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:09 smithi122 ceph-mon[35310]: pgmap v302: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-13T18:02:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:09 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2378525425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:02:09.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:09 smithi143 ceph-mon[38210]: pgmap v302: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.4 KiB/s wr, 13 op/s 2024-09-13T18:02:09.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:09 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2378525425' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:02:10.065 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:10.144 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:10.715 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:10.720 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:10.724 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:10.726 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:10.728 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:10.729 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:11.158 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:11.159 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:11.160 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:11.376 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:11 smithi027 ceph-mon[30611]: pgmap v303: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-13T18:02:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:11 smithi122 ceph-mon[35310]: pgmap v303: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-13T18:02:11.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:11 smithi143 ceph-mon[38210]: pgmap v303: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-13T18:02:11.600 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:13.200 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:13 smithi027 ceph-mon[30611]: pgmap v304: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-13T18:02:13.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:13 smithi122 ceph-mon[35310]: pgmap v304: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-13T18:02:13.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:13 smithi143 ceph-mon[38210]: pgmap v304: 97 pgs: 97 active+clean; 635 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-13T18:02:15.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:15 smithi027 ceph-mon[30611]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-13T18:02:15.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:15 smithi122 ceph-mon[35310]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-13T18:02:15.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:15 smithi143 ceph-mon[38210]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-13T18:02:17.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:17 smithi122 ceph-mon[35310]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-13T18:02:17.468 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:17 smithi027 ceph-mon[30611]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-13T18:02:17.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:17 smithi143 ceph-mon[38210]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-13T18:02:19.256 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:19 smithi027 ceph-mon[30611]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-13T18:02:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:19 smithi122 ceph-mon[35310]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-13T18:02:19.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:19 smithi143 ceph-mon[38210]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-13T18:02:20.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.052+0000 7f13fc000640 1 -- 172.21.15.27:0/1430251816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13f4102bb0 msgr2=0x7f13f4106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:20.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.052+0000 7f13fc000640 1 --2- 172.21.15.27:0/1430251816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13f4102bb0 0x7f13f4106c00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f13e0009930 tx=0x7f13e002a420 comp rx=0 tx=0).stop 2024-09-13T18:02:20.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.052+0000 7f13fc000640 1 -- 172.21.15.27:0/1430251816 shutdown_connections 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.052+0000 7f13fc000640 1 --2- 172.21.15.27:0/1430251816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13f4107330 0x7f13f410eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.052+0000 7f13fc000640 1 --2- 172.21.15.27:0/1430251816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13f4102bb0 0x7f13f4106c00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.052+0000 7f13fc000640 1 --2- 172.21.15.27:0/1430251816 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13f4102200 0x7f13f41025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.052+0000 7f13fc000640 1 -- 172.21.15.27:0/1430251816 >> 172.21.15.27:0/1430251816 conn(0x7f13f40fdc60 msgr2=0x7f13f4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.052+0000 7f13fc000640 1 -- 172.21.15.27:0/1430251816 shutdown_connections 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.052+0000 7f13fc000640 1 -- 172.21.15.27:0/1430251816 wait complete. 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.053+0000 7f13fc000640 1 Processor -- start 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.053+0000 7f13fc000640 1 -- start start 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13fc000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13f4102200 0x7f13f41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13fc000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13f4102bb0 0x7f13f4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:20.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13fc000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13f4107330 0x7f13f419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13fc000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f419d500 con 0x7f13f4102200 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13fc000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f419d670 con 0x7f13f4107330 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13fc000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f419d7e0 con 0x7f13f4102bb0 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13f9600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13f4102200 0x7f13f41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13f8c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13f4102bb0 0x7f13f4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13f9600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13f4102200 0x7f13f41985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60528/0 (socket says 172.21.15.27:60528) 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13f9600640 1 -- 172.21.15.27:0/4159789295 learned_addr learned my addr 172.21.15.27:0/4159789295 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13fa000640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13f4107330 0x7f13f419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13f9600640 1 -- 172.21.15.27:0/4159789295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13f4102bb0 msgr2=0x7f13f4198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13f9600640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f13f4102bb0 0x7f13f4198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13f9600640 1 -- 172.21.15.27:0/4159789295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13f4107330 msgr2=0x7f13f419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13f9600640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f13f4107330 0x7f13f419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:20.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.054+0000 7f13f9600640 1 -- 172.21.15.27:0/4159789295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ec009840 con 0x7f13f4102200 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.055+0000 7f13f9600640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13f4102200 0x7f13f41985c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13e800e9f0 tx=0x7f13e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.055+0000 7f13f2000640 1 -- 172.21.15.27:0/4159789295 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8009720 con 0x7f13f4102200 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.055+0000 7f13f2000640 1 -- 172.21.15.27:0/4159789295 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f13e800cd80 con 0x7f13f4102200 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.055+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e0009560 con 0x7f13f4102200 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.055+0000 7f13f2000640 1 -- 172.21.15.27:0/4159789295 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e8010690 con 0x7f13f4102200 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.055+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f41a51b0 con 0x7f13f4102200 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.056+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13f41036e0 con 0x7f13f4102200 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.058+0000 7f13f2000640 1 -- 172.21.15.27:0/4159789295 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f13e80046c0 con 0x7f13f4102200 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.059+0000 7f13f2000640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13dc0a1110 0x7f13dc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.060+0000 7f13f2000640 1 -- 172.21.15.27:0/4159789295 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f13e8014070 con 0x7f13f4102200 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.060+0000 7f13f8c00640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13dc0a1110 0x7f13dc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.060+0000 7f13f2000640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] conn(0x7f13dc0aa960 0x7f13dc0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.060+0000 7f13f2000640 1 -- 172.21.15.27:0/4159789295 --> [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13dc0ad430 con 0x7f13dc0aa960 2024-09-13T18:02:20.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.060+0000 7f13f2000640 1 -- 172.21.15.27:0/4159789295 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13e80cd3e0 con 0x7f13f4102200 2024-09-13T18:02:20.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.060+0000 7f13fa000640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] conn(0x7f13dc0aa960 0x7f13dc0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:20.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.061+0000 7f13f8c00640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13dc0a1110 0x7f13dc0a35d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f13e0005ab0 tx=0x7f13e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:20.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.061+0000 7f13fa000640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] conn(0x7f13dc0aa960 0x7f13dc0acd80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.062+0000 7f13f2000640 1 -- 172.21.15.27:0/4159789295 <== osd.0 v2:172.21.15.27:6802/3184758537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f13dc0ad430 con 0x7f13dc0aa960 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.076+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 --> [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f13f4112470 con 0x7f13dc0aa960 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.076+0000 7f13f2000640 1 -- 172.21.15.27:0/4159789295 <== osd.0 v2:172.21.15.27:6802/3184758537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f13ec009cd0 con 0x7f13dc0aa960 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.076+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] conn(0x7f13dc0aa960 msgr2=0x7f13dc0acd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.076+0000 7f13fc000640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] conn(0x7f13dc0aa960 0x7f13dc0acd80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.076+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13dc0a1110 msgr2=0x7f13dc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.076+0000 7f13fc000640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13dc0a1110 0x7f13dc0a35d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f13e0005ab0 tx=0x7f13e0005a20 comp rx=0 tx=0).stop 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.077+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13f4102200 msgr2=0x7f13f41985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.077+0000 7f13fc000640 1 --2- 172.21.15.27:0/4159789295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f13f4102200 0x7f13f41985c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f13e800e9f0 tx=0x7f13e800edf0 comp rx=0 tx=0).stop 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.077+0000 7f13fa000640 1 -- 172.21.15.27:0/4159789295 reap_dead start 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.077+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 shutdown_connections 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.077+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 >> 172.21.15.27:0/4159789295 conn(0x7f13f40fdc60 msgr2=0x7f13f40ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:20.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.077+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 shutdown_connections 2024-09-13T18:02:20.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:19.077+0000 7f13fc000640 1 -- 172.21.15.27:0/4159789295 wait complete. 2024-09-13T18:02:21.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:21 smithi122 ceph-mon[35310]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-13T18:02:21.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:21 smithi143 ceph-mon[38210]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-13T18:02:21.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:21 smithi027 ceph-mon[30611]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-13T18:02:23.442 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:23 smithi027 ceph-mon[30611]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T18:02:23.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:23 smithi122 ceph-mon[35310]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T18:02:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:23 smithi143 ceph-mon[38210]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T18:02:23.748 INFO:teuthology.orchestra.run.smithi027.stdout:34359738441 2024-09-13T18:02:23.749 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T18:02:25.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:25 smithi122 ceph-mon[35310]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:02:25.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:25 smithi143 ceph-mon[38210]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:02:25.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:25 smithi027 ceph-mon[30611]: pgmap v310: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:02:26.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.372+0000 7f8d41600640 1 -- 172.21.15.27:0/460580100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d3c0728e0 msgr2=0x7f8d3c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:26.607 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.372+0000 7f8d41600640 1 --2- 172.21.15.27:0/460580100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d3c0728e0 0x7f8d3c072cc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009900 tx=0x7f8d2c02a480 comp rx=0 tx=0).stop 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.372+0000 7f8d41600640 1 -- 172.21.15.27:0/460580100 shutdown_connections 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.372+0000 7f8d41600640 1 --2- 172.21.15.27:0/460580100 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d3c10c5c0 0x7f8d3c10ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.372+0000 7f8d41600640 1 --2- 172.21.15.27:0/460580100 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c073200 0x7f8d3c10c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.372+0000 7f8d41600640 1 --2- 172.21.15.27:0/460580100 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d3c0728e0 0x7f8d3c072cc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.372+0000 7f8d41600640 1 -- 172.21.15.27:0/460580100 >> 172.21.15.27:0/460580100 conn(0x7f8d3c0fba80 msgr2=0x7f8d3c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.372+0000 7f8d41600640 1 -- 172.21.15.27:0/460580100 shutdown_connections 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.372+0000 7f8d41600640 1 -- 172.21.15.27:0/460580100 wait complete. 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.373+0000 7f8d41600640 1 Processor -- start 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.373+0000 7f8d41600640 1 -- start start 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d41600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d3c0728e0 0x7f8d3c1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d41600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d3c073200 0x7f8d3c198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:26.608 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d41600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c10c5c0 0x7f8d3c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d41600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c19d510 con 0x7f8d3c10c5c0 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d41600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c19d680 con 0x7f8d3c073200 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d41600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c19d7f0 con 0x7f8d3c0728e0 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3b400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c10c5c0 0x7f8d3c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d3c073200 0x7f8d3c198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3aa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d3c0728e0 0x7f8d3c1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3b400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c10c5c0 0x7f8d3c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38760/0 (socket says 172.21.15.27:38760) 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3b400640 1 -- 172.21.15.27:0/2221038057 learned_addr learned my addr 172.21.15.27:0/2221038057 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3a000640 1 -- 172.21.15.27:0/2221038057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d3c0728e0 msgr2=0x7f8d3c1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3a000640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d3c0728e0 0x7f8d3c1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:26.609 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3a000640 1 -- 172.21.15.27:0/2221038057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c10c5c0 msgr2=0x7f8d3c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3a000640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8d3c10c5c0 0x7f8d3c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3a000640 1 -- 172.21.15.27:0/2221038057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c009560 con 0x7f8d3c073200 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.374+0000 7f8d3aa00640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8d3c0728e0 0x7f8d3c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.375+0000 7f8d3a000640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d3c073200 0x7f8d3c198b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e9f0 tx=0x7f8d2800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.375+0000 7f8d33400640 1 -- 172.21.15.27:0/2221038057 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2800ccc0 con 0x7f8d3c073200 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.375+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c19dad0 con 0x7f8d3c073200 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.375+0000 7f8d33400640 1 -- 172.21.15.27:0/2221038057 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8d2800ce20 con 0x7f8d3c073200 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.375+0000 7f8d33400640 1 -- 172.21.15.27:0/2221038057 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d28018920 con 0x7f8d3c073200 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.375+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c1a5390 con 0x7f8d3c073200 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.376+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d3c112440 con 0x7f8d3c073200 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.378+0000 7f8d33400640 1 -- 172.21.15.27:0/2221038057 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8d28018a80 con 0x7f8d3c073200 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.379+0000 7f8d33400640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8d200a1110 0x7f8d200a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:26.610 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.380+0000 7f8d33400640 1 -- 172.21.15.27:0/2221038057 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8d28014070 con 0x7f8d3c073200 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.380+0000 7f8d3aa00640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8d200a1110 0x7f8d200a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.380+0000 7f8d33400640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] conn(0x7f8d200aa960 0x7f8d200acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.380+0000 7f8d33400640 1 -- 172.21.15.27:0/2221038057 --> [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d200ad430 con 0x7f8d200aa960 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.380+0000 7f8d33400640 1 -- 172.21.15.27:0/2221038057 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d280cd300 con 0x7f8d3c073200 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.380+0000 7f8d3b400640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] conn(0x7f8d200aa960 0x7f8d200acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.380+0000 7f8d3aa00640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8d200a1110 0x7f8d200a35d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c005ec0 tx=0x7f8d2c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.381+0000 7f8d3b400640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] conn(0x7f8d200aa960 0x7f8d200acd80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.382+0000 7f8d33400640 1 -- 172.21.15.27:0/2221038057 <== osd.4 v2:172.21.15.122:6808/854453885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8d200ad430 con 0x7f8d200aa960 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.396+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 --> [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d3c060b70 con 0x7f8d200aa960 2024-09-13T18:02:26.611 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.396+0000 7f8d33400640 1 -- 172.21.15.27:0/2221038057 <== osd.4 v2:172.21.15.122:6808/854453885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8d3c060b70 con 0x7f8d200aa960 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 >> [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] conn(0x7f8d200aa960 msgr2=0x7f8d200acd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d41600640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] conn(0x7f8d200aa960 0x7f8d200acd80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8d200a1110 msgr2=0x7f8d200a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d41600640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f8d200a1110 0x7f8d200a35d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c005ec0 tx=0x7f8d2c005a20 comp rx=0 tx=0).stop 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d3c073200 msgr2=0x7f8d3c198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d41600640 1 --2- 172.21.15.27:0/2221038057 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8d3c073200 0x7f8d3c198b10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800e9f0 tx=0x7f8d2800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d3b400640 1 -- 172.21.15.27:0/2221038057 reap_dead start 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 shutdown_connections 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 >> 172.21.15.27:0/2221038057 conn(0x7f8d3c0fba80 msgr2=0x7f8d3c0fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:26.612 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.397+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 shutdown_connections 2024-09-13T18:02:26.613 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.398+0000 7f8d41600640 1 -- 172.21.15.27:0/2221038057 wait complete. 2024-09-13T18:02:27.169 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:27 smithi027 ceph-mon[30611]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T18:02:27.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:27 smithi122 ceph-mon[35310]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T18:02:27.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:27 smithi143 ceph-mon[38210]: pgmap v311: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T18:02:27.729 INFO:teuthology.orchestra.run.smithi027.stdout:146028888120 2024-09-13T18:02:27.729 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T18:02:28.544 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.322+0000 7f9358a00640 1 -- 172.21.15.27:0/4177944764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93540ffff0 msgr2=0x7f93541003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.322+0000 7f9358a00640 1 --2- 172.21.15.27:0/4177944764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93540ffff0 0x7f93541003d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9344009930 tx=0x7f934402a420 comp rx=0 tx=0).stop 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.323+0000 7f9358a00640 1 -- 172.21.15.27:0/4177944764 shutdown_connections 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.323+0000 7f9358a00640 1 --2- 172.21.15.27:0/4177944764 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9354105120 0x7f935410cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.323+0000 7f9358a00640 1 --2- 172.21.15.27:0/4177944764 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93541009a0 0x7f93541049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.323+0000 7f9358a00640 1 --2- 172.21.15.27:0/4177944764 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f93540ffff0 0x7f93541003d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.323+0000 7f9358a00640 1 -- 172.21.15.27:0/4177944764 >> 172.21.15.27:0/4177944764 conn(0x7f93540fba90 msgr2=0x7f93540fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.323+0000 7f9358a00640 1 -- 172.21.15.27:0/4177944764 shutdown_connections 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.323+0000 7f9358a00640 1 -- 172.21.15.27:0/4177944764 wait complete. 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9358a00640 1 Processor -- start 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9358a00640 1 -- start start 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9358a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93540ffff0 0x7f9354198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:28.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9358a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93541009a0 0x7f9354198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9358a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9354105120 0x7f935419cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9358a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935419d560 con 0x7f9354105120 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9358a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935419d6d0 con 0x7f93540ffff0 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9358a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935419d840 con 0x7f93541009a0 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9351e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93540ffff0 0x7f9354198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9351e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93540ffff0 0x7f9354198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:45378/0 (socket says 172.21.15.27:45378) 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9351e00640 1 -- 172.21.15.27:0/2397617591 learned_addr learned my addr 172.21.15.27:0/2397617591 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9352800640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9354105120 0x7f935419cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.324+0000 7f9351400640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93541009a0 0x7f9354198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f9351e00640 1 -- 172.21.15.27:0/2397617591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93541009a0 msgr2=0x7f9354198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f9351e00640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f93541009a0 0x7f9354198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f9351e00640 1 -- 172.21.15.27:0/2397617591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9354105120 msgr2=0x7f935419cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f9351e00640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9354105120 0x7f935419cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:28.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f9351e00640 1 -- 172.21.15.27:0/2397617591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344009560 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f9351e00640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93540ffff0 0x7f9354198620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9344005940 tx=0x7f93440042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f934aa00640 1 -- 172.21.15.27:0/2397617591 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93440044e0 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935419dac0 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f934aa00640 1 -- 172.21.15.27:0/2397617591 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f93440046c0 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.325+0000 7f934aa00640 1 -- 172.21.15.27:0/2397617591 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93440038e0 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.326+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93541a5210 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.326+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93541101d0 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.328+0000 7f934aa00640 1 -- 172.21.15.27:0/2397617591 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9344004830 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.330+0000 7f934aa00640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f93380a1110 0x7f93380a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.330+0000 7f934aa00640 1 -- 172.21.15.27:0/2397617591 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f93440ed5c0 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.330+0000 7f9351400640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f93380a1110 0x7f93380a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.330+0000 7f934aa00640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] conn(0x7f93380aa960 0x7f93380acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.330+0000 7f934aa00640 1 -- 172.21.15.27:0/2397617591 --> [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93380ad430 con 0x7f93380aa960 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.330+0000 7f934aa00640 1 -- 172.21.15.27:0/2397617591 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93440ed930 con 0x7f93540ffff0 2024-09-13T18:02:28.547 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.331+0000 7f9352800640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] conn(0x7f93380aa960 0x7f93380acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:28.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.331+0000 7f9351400640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f93380a1110 0x7f93380a35d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9354199bd0 tx=0x7f9340005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:28.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.331+0000 7f9352800640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] conn(0x7f93380aa960 0x7f93380acd80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:28.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.332+0000 7f934aa00640 1 -- 172.21.15.27:0/2397617591 <== osd.1 v2:172.21.15.122:6800/4170403737 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f93380ad430 con 0x7f93380aa960 2024-09-13T18:02:28.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.346+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 --> [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93541014d0 con 0x7f93380aa960 2024-09-13T18:02:28.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f934aa00640 1 -- 172.21.15.27:0/2397617591 <== osd.1 v2:172.21.15.122:6800/4170403737 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f93541014d0 con 0x7f93380aa960 2024-09-13T18:02:28.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 >> [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] conn(0x7f93380aa960 msgr2=0x7f93380acd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9358a00640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] conn(0x7f93380aa960 0x7f93380acd80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f93380a1110 msgr2=0x7f93380a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9358a00640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f93380a1110 0x7f93380a35d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9354199bd0 tx=0x7f9340005f90 comp rx=0 tx=0).stop 2024-09-13T18:02:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93540ffff0 msgr2=0x7f9354198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9358a00640 1 --2- 172.21.15.27:0/2397617591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f93540ffff0 0x7f9354198620 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9344005940 tx=0x7f93440042f0 comp rx=0 tx=0).stop 2024-09-13T18:02:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9352800640 1 -- 172.21.15.27:0/2397617591 reap_dead start 2024-09-13T18:02:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 shutdown_connections 2024-09-13T18:02:28.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 >> 172.21.15.27:0/2397617591 conn(0x7f93540fba90 msgr2=0x7f93540fbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:28.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.347+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 shutdown_connections 2024-09-13T18:02:28.550 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:28.348+0000 7f9358a00640 1 -- 172.21.15.27:0/2397617591 wait complete. 2024-09-13T18:02:29.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.373+0000 7f49d8400640 1 -- 172.21.15.27:0/2305081874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102bb0 msgr2=0x7f49d0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.373+0000 7f49d8400640 1 --2- 172.21.15.27:0/2305081874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102bb0 0x7f49d0106c00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f49bc009930 tx=0x7f49bc02a420 comp rx=0 tx=0).stop 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.373+0000 7f49d8400640 1 -- 172.21.15.27:0/2305081874 shutdown_connections 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.373+0000 7f49d8400640 1 --2- 172.21.15.27:0/2305081874 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49d0107330 0x7f49d010eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.373+0000 7f49d8400640 1 --2- 172.21.15.27:0/2305081874 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102bb0 0x7f49d0106c00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.373+0000 7f49d8400640 1 --2- 172.21.15.27:0/2305081874 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d0102200 0x7f49d01025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.373+0000 7f49d8400640 1 -- 172.21.15.27:0/2305081874 >> 172.21.15.27:0/2305081874 conn(0x7f49d00fdc60 msgr2=0x7f49d0100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.374+0000 7f49d8400640 1 -- 172.21.15.27:0/2305081874 shutdown_connections 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.374+0000 7f49d8400640 1 -- 172.21.15.27:0/2305081874 wait complete. 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.374+0000 7f49d8400640 1 Processor -- start 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d8400640 1 -- start start 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d8400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49d0102200 0x7f49d0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d8400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102bb0 0x7f49d0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d8400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d0107330 0x7f49d019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d8400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d019d4c0 con 0x7f49d0102bb0 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d8400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d019d630 con 0x7f49d0107330 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d8400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d019d7a0 con 0x7f49d0102200 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d5000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102bb0 0x7f49d0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d5000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102bb0 0x7f49d0198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38786/0 (socket says 172.21.15.27:38786) 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d6400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d0107330 0x7f49d019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d5000640 1 -- 172.21.15.27:0/1145999857 learned_addr learned my addr 172.21.15.27:0/1145999857 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.375+0000 7f49d5a00640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49d0102200 0x7f49d0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49d6400640 1 -- 172.21.15.27:0/1145999857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49d0102200 msgr2=0x7f49d0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49d6400640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f49d0102200 0x7f49d0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49d6400640 1 -- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102bb0 msgr2=0x7f49d0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49d6400640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f49d0102bb0 0x7f49d0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49d6400640 1 -- 172.21.15.27:0/1145999857 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc009560 con 0x7f49d0107330 2024-09-13T18:02:29.302 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49d6400640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d0107330 0x7f49d019cec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f49c800e970 tx=0x7f49c800ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:29.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49ce000640 1 -- 172.21.15.27:0/1145999857 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8009620 con 0x7f49d0107330 2024-09-13T18:02:29.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d019da80 con 0x7f49d0107330 2024-09-13T18:02:29.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49ce000640 1 -- 172.21.15.27:0/1145999857 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f49c800ccc0 con 0x7f49d0107330 2024-09-13T18:02:29.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49ce000640 1 -- 172.21.15.27:0/1145999857 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8004a00 con 0x7f49d0107330 2024-09-13T18:02:29.303 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.376+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d01a5340 con 0x7f49d0107330 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.377+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49d01036e0 con 0x7f49d0107330 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.379+0000 7f49ce000640 1 -- 172.21.15.27:0/1145999857 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f49c8005020 con 0x7f49d0107330 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.381+0000 7f49ce000640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f49b80a1110 0x7f49b80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.381+0000 7f49ce000640 1 -- 172.21.15.27:0/1145999857 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f49c8014070 con 0x7f49d0107330 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.381+0000 7f49d5a00640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f49b80a1110 0x7f49b80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.381+0000 7f49ce000640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] conn(0x7f49b80aa960 0x7f49b80acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.381+0000 7f49ce000640 1 -- 172.21.15.27:0/1145999857 --> [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49b80ad430 con 0x7f49b80aa960 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.381+0000 7f49ce000640 1 -- 172.21.15.27:0/1145999857 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49c80cccd0 con 0x7f49d0107330 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.381+0000 7f49d5000640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] conn(0x7f49b80aa960 0x7f49b80acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.382+0000 7f49d5a00640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f49b80a1110 0x7f49b80a35d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49c4005fd0 tx=0x7f49c4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.382+0000 7f49d5000640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] conn(0x7f49b80aa960 0x7f49b80acd80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:29.304 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.383+0000 7f49ce000640 1 -- 172.21.15.27:0/1145999857 <== osd.9 v2:172.21.15.27:6826/154819265 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f49b80ad430 con 0x7f49b80aa960 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.397+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 --> [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49d0112470 con 0x7f49b80aa960 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.397+0000 7f49ce000640 1 -- 172.21.15.27:0/1145999857 <== osd.9 v2:172.21.15.27:6826/154819265 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f49bc004160 con 0x7f49b80aa960 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] conn(0x7f49b80aa960 msgr2=0x7f49b80acd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] conn(0x7f49b80aa960 0x7f49b80acd80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f49b80a1110 msgr2=0x7f49b80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f49b80a1110 0x7f49b80a35d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f49c4005fd0 tx=0x7f49c4009500 comp rx=0 tx=0).stop 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d0107330 msgr2=0x7f49d019cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 --2- 172.21.15.27:0/1145999857 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f49d0107330 0x7f49d019cec0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f49c800e970 tx=0x7f49c800ee30 comp rx=0 tx=0).stop 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d6400640 1 -- 172.21.15.27:0/1145999857 reap_dead start 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 shutdown_connections 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 >> 172.21.15.27:0/1145999857 conn(0x7f49d00fdc60 msgr2=0x7f49d00ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 shutdown_connections 2024-09-13T18:02:29.305 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:27.398+0000 7f49d8400640 1 -- 172.21.15.27:0/1145999857 wait complete. 2024-09-13T18:02:29.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:29 smithi027 ceph-mon[30611]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:02:29.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:29 smithi122 ceph-mon[35310]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:02:29.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:29 smithi143 ceph-mon[38210]: pgmap v312: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.512+0000 7f59ba800640 1 -- 172.21.15.27:0/812678926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b4101690 msgr2=0x7f59b4109b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.512+0000 7f59ba800640 1 --2- 172.21.15.27:0/812678926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b4101690 0x7f59b4109b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f59a0009900 tx=0x7f59a002a480 comp rx=0 tx=0).stop 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.512+0000 7f59ba800640 1 -- 172.21.15.27:0/812678926 shutdown_connections 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.512+0000 7f59ba800640 1 --2- 172.21.15.27:0/812678926 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59b410a1a0 0x7f59b410c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.512+0000 7f59ba800640 1 --2- 172.21.15.27:0/812678926 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b4101690 0x7f59b4109b80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.512+0000 7f59ba800640 1 --2- 172.21.15.27:0/812678926 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59b4100d70 0x7f59b4101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.512+0000 7f59ba800640 1 -- 172.21.15.27:0/812678926 >> 172.21.15.27:0/812678926 conn(0x7f59b40fa830 msgr2=0x7f59b40fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.512+0000 7f59ba800640 1 -- 172.21.15.27:0/812678926 shutdown_connections 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.512+0000 7f59ba800640 1 -- 172.21.15.27:0/812678926 wait complete. 2024-09-13T18:02:29.619 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.513+0000 7f59ba800640 1 Processor -- start 2024-09-13T18:02:29.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.513+0000 7f59ba800640 1 -- start start 2024-09-13T18:02:29.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59ba800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59b4100d70 0x7f59b4198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59ba800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b4101690 0x7f59b4198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59ba800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59b410a1a0 0x7f59b419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59ba800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b419d270 con 0x7f59b4101690 2024-09-13T18:02:29.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59ba800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b419d3e0 con 0x7f59b410a1a0 2024-09-13T18:02:29.620 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59ba800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b419d550 con 0x7f59b4100d70 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b8a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b4101690 0x7f59b4198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b8a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b4101690 0x7f59b4198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:38778/0 (socket says 172.21.15.27:38778) 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b9400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59b4100d70 0x7f59b4198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b8a00640 1 -- 172.21.15.27:0/4125092034 learned_addr learned my addr 172.21.15.27:0/4125092034 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b9e00640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59b410a1a0 0x7f59b419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b9400640 1 -- 172.21.15.27:0/4125092034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59b410a1a0 msgr2=0x7f59b419cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b9400640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f59b410a1a0 0x7f59b419cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b9400640 1 -- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b4101690 msgr2=0x7f59b4198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b9400640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f59b4101690 0x7f59b4198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.514+0000 7f59b9400640 1 -- 172.21.15.27:0/4125092034 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a8009490 con 0x7f59b4100d70 2024-09-13T18:02:29.621 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.515+0000 7f59b9400640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59b4100d70 0x7f59b4198330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59a800e9f0 tx=0x7f59a800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.515+0000 7f59b2000640 1 -- 172.21.15.27:0/4125092034 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800cd80 con 0x7f59b4100d70 2024-09-13T18:02:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.515+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a0009560 con 0x7f59b4100d70 2024-09-13T18:02:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.515+0000 7f59b2000640 1 -- 172.21.15.27:0/4125092034 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f59a80035f0 con 0x7f59b4100d70 2024-09-13T18:02:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.515+0000 7f59b2000640 1 -- 172.21.15.27:0/4125092034 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8018690 con 0x7f59b4100d70 2024-09-13T18:02:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.515+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b41a4f20 con 0x7f59b4100d70 2024-09-13T18:02:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.516+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59b40687e0 con 0x7f59b4100d70 2024-09-13T18:02:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.518+0000 7f59b2000640 1 -- 172.21.15.27:0/4125092034 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f59a8003760 con 0x7f59b4100d70 2024-09-13T18:02:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.520+0000 7f59b2000640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f599c0a1180 0x7f599c0a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.622 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.520+0000 7f59b2000640 1 -- 172.21.15.27:0/4125092034 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f59a8014070 con 0x7f59b4100d70 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.520+0000 7f59b8a00640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f599c0a1180 0x7f599c0a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.520+0000 7f59b2000640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] conn(0x7f599c0aa9d0 0x7f599c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.520+0000 7f59b2000640 1 -- 172.21.15.27:0/4125092034 --> [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f599c0ad4a0 con 0x7f599c0aa9d0 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.520+0000 7f59b2000640 1 -- 172.21.15.27:0/4125092034 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59a80cd3b0 con 0x7f59b4100d70 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.520+0000 7f59b9e00640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] conn(0x7f599c0aa9d0 0x7f599c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.521+0000 7f59b8a00640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f599c0a1180 0x7f599c0a3640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f59a0005ec0 tx=0x7f59a00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.521+0000 7f59b9e00640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] conn(0x7f599c0aa9d0 0x7f599c0acdf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.522+0000 7f59b2000640 1 -- 172.21.15.27:0/4125092034 <== osd.3 v2:172.21.15.27:6810/3127939559 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f599c0ad4a0 con 0x7f599c0aa9d0 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.536+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 --> [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f59b4110020 con 0x7f599c0aa9d0 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.536+0000 7f59b2000640 1 -- 172.21.15.27:0/4125092034 <== osd.3 v2:172.21.15.27:6810/3127939559 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f59ac004b20 con 0x7f599c0aa9d0 2024-09-13T18:02:29.623 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] conn(0x7f599c0aa9d0 msgr2=0x7f599c0acdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] conn(0x7f599c0aa9d0 0x7f599c0acdf0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f599c0a1180 msgr2=0x7f599c0a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f599c0a1180 0x7f599c0a3640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f59a0005ec0 tx=0x7f59a00058d0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59b4100d70 msgr2=0x7f59b4198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 --2- 172.21.15.27:0/4125092034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f59b4100d70 0x7f59b4198330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f59a800e9f0 tx=0x7f59a800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59b9e00640 1 -- 172.21.15.27:0/4125092034 reap_dead start 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 shutdown_connections 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 >> 172.21.15.27:0/4125092034 conn(0x7f59b40fa830 msgr2=0x7f59b410b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 shutdown_connections 2024-09-13T18:02:29.624 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:26.537+0000 7f59ba800640 1 -- 172.21.15.27:0/4125092034 wait complete. 2024-09-13T18:02:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.087+0000 7f51fee00640 1 -- 172.21.15.27:0/3586723953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51f8107330 msgr2=0x7f51f810eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.087+0000 7f51fee00640 1 --2- 172.21.15.27:0/3586723953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51f8107330 0x7f51f810eeb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009cd0 tx=0x7f51f002a8e0 comp rx=0 tx=0).stop 2024-09-13T18:02:30.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.087+0000 7f51fee00640 1 -- 172.21.15.27:0/3586723953 shutdown_connections 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.087+0000 7f51fee00640 1 --2- 172.21.15.27:0/3586723953 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51f8107330 0x7f51f810eeb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.087+0000 7f51fee00640 1 --2- 172.21.15.27:0/3586723953 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51f8102bb0 0x7f51f8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.087+0000 7f51fee00640 1 --2- 172.21.15.27:0/3586723953 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f8102200 0x7f51f81025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.087+0000 7f51fee00640 1 -- 172.21.15.27:0/3586723953 >> 172.21.15.27:0/3586723953 conn(0x7f51f80fdc60 msgr2=0x7f51f8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.087+0000 7f51fee00640 1 -- 172.21.15.27:0/3586723953 shutdown_connections 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.087+0000 7f51fee00640 1 -- 172.21.15.27:0/3586723953 wait complete. 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.088+0000 7f51fee00640 1 Processor -- start 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.088+0000 7f51fee00640 1 -- start start 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51fee00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f8102200 0x7f51f81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51fee00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51f8102bb0 0x7f51f8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:30.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51fee00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51f8107330 0x7f51f819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51fee00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f819d430 con 0x7f51f8102bb0 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51fee00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f819d5a0 con 0x7f51f8102200 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51fee00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f819d710 con 0x7f51f8107330 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51fce00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51f8107330 0x7f51f819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51efe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51f8102bb0 0x7f51f8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51fce00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51f8107330 0x7f51f819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:43474/0 (socket says 172.21.15.27:43474) 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51fce00640 1 -- 172.21.15.27:0/2580337684 learned_addr learned my addr 172.21.15.27:0/2580337684 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51f7e00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f8102200 0x7f51f81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51f7e00640 1 -- 172.21.15.27:0/2580337684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51f8107330 msgr2=0x7f51f819ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51f7e00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51f8107330 0x7f51f819ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:30.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51f7e00640 1 -- 172.21.15.27:0/2580337684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51f8102bb0 msgr2=0x7f51f8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.089+0000 7f51f7e00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f51f8102bb0 0x7f51f8198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.090+0000 7f51f7e00640 1 -- 172.21.15.27:0/2580337684 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f0009900 con 0x7f51f8102200 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.090+0000 7f51fce00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f51f8107330 0x7f51f819ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.090+0000 7f51f7e00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f8102200 0x7f51f81984f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f51e800e9f0 tx=0x7f51e800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.090+0000 7f51f5600640 1 -- 172.21.15.27:0/2580337684 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800ccc0 con 0x7f51f8102200 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.090+0000 7f51f5600640 1 -- 172.21.15.27:0/2580337684 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f51e800ce20 con 0x7f51f8102200 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.090+0000 7f51f5600640 1 -- 172.21.15.27:0/2580337684 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e8018920 con 0x7f51f8102200 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.090+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f819d9f0 con 0x7f51f8102200 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.090+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f81a52b0 con 0x7f51f8102200 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.091+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51f81036e0 con 0x7f51f8102200 2024-09-13T18:02:30.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.093+0000 7f51f5600640 1 -- 172.21.15.27:0/2580337684 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f51e8018a80 con 0x7f51f8102200 2024-09-13T18:02:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.095+0000 7f51f5600640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f51dc0a1110 0x7f51dc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.095+0000 7f51f5600640 1 -- 172.21.15.27:0/2580337684 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f51e8014070 con 0x7f51f8102200 2024-09-13T18:02:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.095+0000 7f51efe00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f51dc0a1110 0x7f51dc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.095+0000 7f51f5600640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] conn(0x7f51dc0aa960 0x7f51dc0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.095+0000 7f51f5600640 1 -- 172.21.15.27:0/2580337684 --> [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51dc0ad430 con 0x7f51dc0aa960 2024-09-13T18:02:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.095+0000 7f51f5600640 1 -- 172.21.15.27:0/2580337684 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51e80cd300 con 0x7f51f8102200 2024-09-13T18:02:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.095+0000 7f51fce00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] conn(0x7f51dc0aa960 0x7f51dc0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:30.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.095+0000 7f51efe00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f51dc0a1110 0x7f51dc0a35d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f51f8199aa0 tx=0x7f51e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:30.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.096+0000 7f51fce00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] conn(0x7f51dc0aa960 0x7f51dc0acd80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:30.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.097+0000 7f51f5600640 1 -- 172.21.15.27:0/2580337684 <== osd.5 v2:172.21.15.143:6808/3812784407 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f51dc0ad430 con 0x7f51dc0aa960 2024-09-13T18:02:30.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.111+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 --> [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51f81123a0 con 0x7f51dc0aa960 2024-09-13T18:02:30.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.111+0000 7f51f5600640 1 -- 172.21.15.27:0/2580337684 <== osd.5 v2:172.21.15.143:6808/3812784407 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f51f81123a0 con 0x7f51dc0aa960 2024-09-13T18:02:30.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 >> [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] conn(0x7f51dc0aa960 msgr2=0x7f51dc0acd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:30.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] conn(0x7f51dc0aa960 0x7f51dc0acd80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:30.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f51dc0a1110 msgr2=0x7f51dc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:30.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f51dc0a1110 0x7f51dc0a35d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f51f8199aa0 tx=0x7f51e0005f90 comp rx=0 tx=0).stop 2024-09-13T18:02:30.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f8102200 msgr2=0x7f51f81984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:30.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 --2- 172.21.15.27:0/2580337684 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f51f8102200 0x7f51f81984f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f51e800e9f0 tx=0x7f51e800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:02:30.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fce00640 1 -- 172.21.15.27:0/2580337684 reap_dead start 2024-09-13T18:02:30.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 shutdown_connections 2024-09-13T18:02:30.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 >> 172.21.15.27:0/2580337684 conn(0x7f51f80fdc60 msgr2=0x7f51f80ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:30.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 shutdown_connections 2024-09-13T18:02:30.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:29.112+0000 7f51fee00640 1 -- 172.21.15.27:0/2580337684 wait complete. 2024-09-13T18:02:31.183 INFO:teuthology.orchestra.run.smithi027.stdout:167503724596 2024-09-13T18:02:31.184 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T18:02:31.436 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:31 smithi027 ceph-mon[30611]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:02:31.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:31 smithi122 ceph-mon[35310]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:02:31.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:31 smithi143 ceph-mon[38210]: pgmap v313: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-13T18:02:31.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.861+0000 7f46b6000640 1 -- 172.21.15.27:0/290715819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46b01029c0 msgr2=0x7f46b0106a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:31.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.861+0000 7f46b6000640 1 --2- 172.21.15.27:0/290715819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46b01029c0 0x7f46b0106a10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009930 tx=0x7f46a402a420 comp rx=0 tx=0).stop 2024-09-13T18:02:31.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.861+0000 7f46b6000640 1 -- 172.21.15.27:0/290715819 shutdown_connections 2024-09-13T18:02:31.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.861+0000 7f46b6000640 1 --2- 172.21.15.27:0/290715819 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46b0107140 0x7f46b010ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:31.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.861+0000 7f46b6000640 1 --2- 172.21.15.27:0/290715819 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46b01029c0 0x7f46b0106a10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:31.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.861+0000 7f46b6000640 1 --2- 172.21.15.27:0/290715819 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b0102010 0x7f46b01023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:31.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.861+0000 7f46b6000640 1 -- 172.21.15.27:0/290715819 >> 172.21.15.27:0/290715819 conn(0x7f46b00fda70 msgr2=0x7f46b00ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:31.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.861+0000 7f46b6000640 1 -- 172.21.15.27:0/290715819 shutdown_connections 2024-09-13T18:02:31.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.861+0000 7f46b6000640 1 -- 172.21.15.27:0/290715819 wait complete. 2024-09-13T18:02:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.862+0000 7f46b6000640 1 Processor -- start 2024-09-13T18:02:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.862+0000 7f46b6000640 1 -- start start 2024-09-13T18:02:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46b6000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46b0102010 0x7f46b0198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46b6000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46b01029c0 0x7f46b01988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46b6000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b0107140 0x7f46b019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46b6000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b019d2c0 con 0x7f46b01029c0 2024-09-13T18:02:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46b6000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b019d430 con 0x7f46b0102010 2024-09-13T18:02:31.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46b6000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b019d5a0 con 0x7f46b0107140 2024-09-13T18:02:31.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46afe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46b01029c0 0x7f46b01988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:31.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46afe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46b01029c0 0x7f46b01988c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35710/0 (socket says 172.21.15.27:35710) 2024-09-13T18:02:31.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46afe00640 1 -- 172.21.15.27:0/2705440230 learned_addr learned my addr 172.21.15.27:0/2705440230 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:31.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46b5600640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b0107140 0x7f46b019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:31.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.863+0000 7f46b4c00640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46b0102010 0x7f46b0198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46afe00640 1 -- 172.21.15.27:0/2705440230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b0107140 msgr2=0x7f46b019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46afe00640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f46b0107140 0x7f46b019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46afe00640 1 -- 172.21.15.27:0/2705440230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46b0102010 msgr2=0x7f46b0198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46afe00640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46b0102010 0x7f46b0198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46afe00640 1 -- 172.21.15.27:0/2705440230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8009840 con 0x7f46b01029c0 2024-09-13T18:02:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46b4c00640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46b0102010 0x7f46b0198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:31.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46afe00640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46b01029c0 0x7f46b01988c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f46a4005940 tx=0x7f46a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46ad600640 1 -- 172.21.15.27:0/2705440230 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a40044e0 con 0x7f46b01029c0 2024-09-13T18:02:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46ad600640 1 -- 172.21.15.27:0/2705440230 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f46a40318b0 con 0x7f46b01029c0 2024-09-13T18:02:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46ad600640 1 -- 172.21.15.27:0/2705440230 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4003850 con 0x7f46b01029c0 2024-09-13T18:02:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a4009560 con 0x7f46b01029c0 2024-09-13T18:02:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.864+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b019dae0 con 0x7f46b01029c0 2024-09-13T18:02:31.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.865+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46b01034f0 con 0x7f46b01029c0 2024-09-13T18:02:31.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.868+0000 7f46ad600640 1 -- 172.21.15.27:0/2705440230 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f46a40047c0 con 0x7f46b01029c0 2024-09-13T18:02:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.869+0000 7f46ad600640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46980a1100 0x7f46980a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:31.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.869+0000 7f46ad600640 1 -- 172.21.15.27:0/2705440230 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f46a40ed7e0 con 0x7f46b01029c0 2024-09-13T18:02:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.869+0000 7f46b4c00640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46980a1100 0x7f46980a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.869+0000 7f46ad600640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] conn(0x7f46980aa950 0x7f46980acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.869+0000 7f46ad600640 1 -- 172.21.15.27:0/2705440230 --> [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46980ad420 con 0x7f46980aa950 2024-09-13T18:02:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.869+0000 7f46ad600640 1 -- 172.21.15.27:0/2705440230 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46a40edb50 con 0x7f46b01029c0 2024-09-13T18:02:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.870+0000 7f46b5600640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] conn(0x7f46980aa950 0x7f46980acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.870+0000 7f46b4c00640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46980a1100 0x7f46980a35c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f469c009fc0 tx=0x7f469c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:31.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.870+0000 7f46b5600640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] conn(0x7f46980aa950 0x7f46980acd70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:31.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.871+0000 7f46ad600640 1 -- 172.21.15.27:0/2705440230 <== osd.8 v2:172.21.15.143:6816/2661911433 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f46980ad420 con 0x7f46980aa950 2024-09-13T18:02:31.887 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.885+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 --> [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46b0060b30 con 0x7f46980aa950 2024-09-13T18:02:31.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.886+0000 7f46ad600640 1 -- 172.21.15.27:0/2705440230 <== osd.8 v2:172.21.15.143:6816/2661911433 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f46b0060b30 con 0x7f46980aa950 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.886+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 >> [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] conn(0x7f46980aa950 msgr2=0x7f46980acd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.886+0000 7f46b6000640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] conn(0x7f46980aa950 0x7f46980acd70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.887+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46980a1100 msgr2=0x7f46980a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.887+0000 7f46b6000640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46980a1100 0x7f46980a35c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f469c009fc0 tx=0x7f469c005f90 comp rx=0 tx=0).stop 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.887+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46b01029c0 msgr2=0x7f46b01988c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.887+0000 7f46b6000640 1 --2- 172.21.15.27:0/2705440230 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46b01029c0 0x7f46b01988c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f46a4005940 tx=0x7f46a40042f0 comp rx=0 tx=0).stop 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.887+0000 7f46b5600640 1 -- 172.21.15.27:0/2705440230 reap_dead start 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.887+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 shutdown_connections 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.887+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 >> 172.21.15.27:0/2705440230 conn(0x7f46b00fda70 msgr2=0x7f46b00fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.887+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 shutdown_connections 2024-09-13T18:02:31.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.887+0000 7f46b6000640 1 -- 172.21.15.27:0/2705440230 wait complete. 2024-09-13T18:02:32.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.454+0000 7f66c4a00640 1 -- 172.21.15.27:0/3313217154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66c010c570 msgr2=0x7f66c010e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:32.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.454+0000 7f66c4a00640 1 --2- 172.21.15.27:0/3313217154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66c010c570 0x7f66c010e9c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009ca0 tx=0x7f66b802a950 comp rx=0 tx=0).stop 2024-09-13T18:02:32.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.454+0000 7f66c4a00640 1 -- 172.21.15.27:0/3313217154 shutdown_connections 2024-09-13T18:02:32.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.454+0000 7f66c4a00640 1 --2- 172.21.15.27:0/3313217154 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66c010c570 0x7f66c010e9c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:32.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.454+0000 7f66c4a00640 1 --2- 172.21.15.27:0/3313217154 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66c0073200 0x7f66c010c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:32.363 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.454+0000 7f66c4a00640 1 --2- 172.21.15.27:0/3313217154 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c00728e0 0x7f66c0072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.454+0000 7f66c4a00640 1 -- 172.21.15.27:0/3313217154 >> 172.21.15.27:0/3313217154 conn(0x7f66c00fba30 msgr2=0x7f66c00fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.454+0000 7f66c4a00640 1 -- 172.21.15.27:0/3313217154 shutdown_connections 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.454+0000 7f66c4a00640 1 -- 172.21.15.27:0/3313217154 wait complete. 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.455+0000 7f66c4a00640 1 Processor -- start 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.455+0000 7f66c4a00640 1 -- start start 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.455+0000 7f66c4a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66c00728e0 0x7f66c0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.455+0000 7f66c4a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c0073200 0x7f66c0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.455+0000 7f66c4a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66c010c570 0x7f66c019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.455+0000 7f66c4a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c019d450 con 0x7f66c00728e0 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.455+0000 7f66c4a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c019d5c0 con 0x7f66c0073200 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.455+0000 7f66c4a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c019d730 con 0x7f66c010c570 2024-09-13T18:02:32.364 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bde00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66c00728e0 0x7f66c0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bde00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66c00728e0 0x7f66c0198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35680/0 (socket says 172.21.15.27:35680) 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bde00640 1 -- 172.21.15.27:0/1800928063 learned_addr learned my addr 172.21.15.27:0/1800928063 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bd400640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c0073200 0x7f66c0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66be800640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66c010c570 0x7f66c019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bde00640 1 -- 172.21.15.27:0/1800928063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66c010c570 msgr2=0x7f66c019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bde00640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66c010c570 0x7f66c019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bde00640 1 -- 172.21.15.27:0/1800928063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c0073200 msgr2=0x7f66c0198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bde00640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f66c0073200 0x7f66c0198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bde00640 1 -- 172.21.15.27:0/1800928063 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b8009900 con 0x7f66c00728e0 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66be800640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f66c010c570 0x7f66c019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.456+0000 7f66bde00640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66c00728e0 0x7f66c0198560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f66b000e9f0 tx=0x7f66b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.457+0000 7f66b6a00640 1 -- 172.21.15.27:0/1800928063 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0009700 con 0x7f66c00728e0 2024-09-13T18:02:32.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.457+0000 7f66b6a00640 1 -- 172.21.15.27:0/1800928063 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f66b000cd80 con 0x7f66c00728e0 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.457+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c019da10 con 0x7f66c00728e0 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.457+0000 7f66b6a00640 1 -- 172.21.15.27:0/1800928063 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b0018920 con 0x7f66c00728e0 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.457+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c01a52d0 con 0x7f66c00728e0 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.458+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f66c0073f90 con 0x7f66c00728e0 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.460+0000 7f66b6a00640 1 -- 172.21.15.27:0/1800928063 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f66b0018a80 con 0x7f66c00728e0 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.461+0000 7f66b6a00640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f66a40a1110 0x7f66a40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.461+0000 7f66b6a00640 1 -- 172.21.15.27:0/1800928063 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f66b0014070 con 0x7f66c00728e0 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.461+0000 7f66bd400640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f66a40a1110 0x7f66a40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.462+0000 7f66b6a00640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] conn(0x7f66a40aa960 0x7f66a40acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.462+0000 7f66b6a00640 1 -- 172.21.15.27:0/1800928063 --> [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66a40ad430 con 0x7f66a40aa960 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.462+0000 7f66b6a00640 1 -- 172.21.15.27:0/1800928063 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66b00cd750 con 0x7f66c00728e0 2024-09-13T18:02:32.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.462+0000 7f66be800640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] conn(0x7f66a40aa960 0x7f66a40acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:32.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.462+0000 7f66bd400640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f66a40a1110 0x7f66a40a35d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f66c0199ac0 tx=0x7f66ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:32.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.462+0000 7f66be800640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] conn(0x7f66a40aa960 0x7f66a40acd80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:32.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.463+0000 7f66b6a00640 1 -- 172.21.15.27:0/1800928063 <== osd.10 v2:172.21.15.122:6824/465237167 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f66a40ad430 con 0x7f66a40aa960 2024-09-13T18:02:32.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.478+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 --> [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f66c01123f0 con 0x7f66a40aa960 2024-09-13T18:02:32.367 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.479+0000 7f66b6a00640 1 -- 172.21.15.27:0/1800928063 <== osd.10 v2:172.21.15.122:6824/465237167 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f66b802fdb0 con 0x7f66a40aa960 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 >> [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] conn(0x7f66a40aa960 msgr2=0x7f66a40acd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] conn(0x7f66a40aa960 0x7f66a40acd80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f66a40a1110 msgr2=0x7f66a40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f66a40a1110 0x7f66a40a35d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f66c0199ac0 tx=0x7f66ac005f90 comp rx=0 tx=0).stop 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66c00728e0 msgr2=0x7f66c0198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 --2- 172.21.15.27:0/1800928063 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f66c00728e0 0x7f66c0198560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f66b000e9f0 tx=0x7f66b000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66be800640 1 -- 172.21.15.27:0/1800928063 reap_dead start 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 shutdown_connections 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 >> 172.21.15.27:0/1800928063 conn(0x7f66c00fba30 msgr2=0x7f66c00fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 shutdown_connections 2024-09-13T18:02:32.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.480+0000 7f66c4a00640 1 -- 172.21.15.27:0/1800928063 wait complete. 2024-09-13T18:02:33.138 INFO:teuthology.orchestra.run.smithi027.stdout:313532612633 2024-09-13T18:02:33.138 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-13T18:02:33.139 INFO:teuthology.orchestra.run.smithi027.stdout:111669149756 2024-09-13T18:02:33.140 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T18:02:33.164 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:33 smithi027 ceph-mon[30611]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-13T18:02:33.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:33 smithi122 ceph-mon[35310]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-13T18:02:33.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:33 smithi143 ceph-mon[38210]: pgmap v314: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-13T18:02:33.661 INFO:teuthology.orchestra.run.smithi027.stdout:55834574919 2024-09-13T18:02:33.661 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T18:02:34.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.185+0000 7f286a200640 1 -- 172.21.15.27:0/1566179491 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f286410a370 msgr2=0x7f286410c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:34.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.185+0000 7f286a200640 1 --2- 172.21.15.27:0/1566179491 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f286410a370 0x7f286410c810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f285c009ca0 tx=0x7f285c02a950 comp rx=0 tx=0).stop 2024-09-13T18:02:34.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.185+0000 7f286a200640 1 -- 172.21.15.27:0/1566179491 shutdown_connections 2024-09-13T18:02:34.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.185+0000 7f286a200640 1 --2- 172.21.15.27:0/1566179491 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f286410a370 0x7f286410c810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:34.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.185+0000 7f286a200640 1 --2- 172.21.15.27:0/1566179491 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2864101860 0x7f2864109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:34.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.185+0000 7f286a200640 1 --2- 172.21.15.27:0/1566179491 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2864100f40 0x7f2864101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.185+0000 7f286a200640 1 -- 172.21.15.27:0/1566179491 >> 172.21.15.27:0/1566179491 conn(0x7f28640fa980 msgr2=0x7f28640fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.185+0000 7f286a200640 1 -- 172.21.15.27:0/1566179491 shutdown_connections 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.185+0000 7f286a200640 1 -- 172.21.15.27:0/1566179491 wait complete. 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.186+0000 7f286a200640 1 Processor -- start 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f286a200640 1 -- start start 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f286a200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2864100f40 0x7f2864198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f286a200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2864101860 0x7f2864198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f286a200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f286410a370 0x7f286419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f286a200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286419d490 con 0x7f2864100f40 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f286a200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286419d600 con 0x7f2864101860 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f286a200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286419d770 con 0x7f286410a370 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f2863400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2864100f40 0x7f2864198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:34.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f2863400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2864100f40 0x7f2864198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35730/0 (socket says 172.21.15.27:35730) 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f2863400640 1 -- 172.21.15.27:0/240218047 learned_addr learned my addr 172.21.15.27:0/240218047 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f285aa00640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2864101860 0x7f2864198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.187+0000 7f2863e00640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f286410a370 0x7f286419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f2863400640 1 -- 172.21.15.27:0/240218047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f286410a370 msgr2=0x7f286419ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f2863400640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f286410a370 0x7f286419ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f2863400640 1 -- 172.21.15.27:0/240218047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2864101860 msgr2=0x7f2864198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f2863400640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2864101860 0x7f2864198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f2863400640 1 -- 172.21.15.27:0/240218047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c009900 con 0x7f2864100f40 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f285aa00640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2864101860 0x7f2864198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f2863400640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2864100f40 0x7f2864198550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f285400e9f0 tx=0x7f285400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f2860c00640 1 -- 172.21.15.27:0/240218047 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854009720 con 0x7f2864100f40 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f2860c00640 1 -- 172.21.15.27:0/240218047 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f285400cd80 con 0x7f2864100f40 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f2860c00640 1 -- 172.21.15.27:0/240218047 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854010690 con 0x7f2864100f40 2024-09-13T18:02:34.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286419da50 con 0x7f2864100f40 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.188+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28641a5310 con 0x7f2864100f40 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.189+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2864110200 con 0x7f2864100f40 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.191+0000 7f2860c00640 1 -- 172.21.15.27:0/240218047 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f28540046c0 con 0x7f2864100f40 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.193+0000 7f2860c00640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f28480a1190 0x7f28480a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.193+0000 7f2860c00640 1 -- 172.21.15.27:0/240218047 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2854014070 con 0x7f2864100f40 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.193+0000 7f285aa00640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f28480a1190 0x7f28480a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.193+0000 7f2860c00640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] conn(0x7f28480aa9e0 0x7f28480ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.193+0000 7f2860c00640 1 -- 172.21.15.27:0/240218047 --> [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28480ad4b0 con 0x7f28480aa9e0 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.193+0000 7f2860c00640 1 -- 172.21.15.27:0/240218047 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28540cd2f0 con 0x7f2864100f40 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.193+0000 7f2863e00640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] conn(0x7f28480aa9e0 0x7f28480ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.193+0000 7f285aa00640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f28480a1190 0x7f28480a3650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2864199b00 tx=0x7f284c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.194+0000 7f2863e00640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] conn(0x7f28480aa9e0 0x7f28480ace00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.195+0000 7f2860c00640 1 -- 172.21.15.27:0/240218047 <== osd.11 v2:172.21.15.143:6824/378792736 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f28480ad4b0 con 0x7f28480aa9e0 2024-09-13T18:02:34.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.211+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 --> [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2864069000 con 0x7f28480aa9e0 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.212+0000 7f2860c00640 1 -- 172.21.15.27:0/240218047 <== osd.11 v2:172.21.15.143:6824/378792736 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2864069000 con 0x7f28480aa9e0 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.212+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 >> [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] conn(0x7f28480aa9e0 msgr2=0x7f28480ace00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.212+0000 7f286a200640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] conn(0x7f28480aa9e0 0x7f28480ace00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.212+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f28480a1190 msgr2=0x7f28480a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.212+0000 7f286a200640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f28480a1190 0x7f28480a3650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2864199b00 tx=0x7f284c005f90 comp rx=0 tx=0).stop 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.212+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2864100f40 msgr2=0x7f2864198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.212+0000 7f286a200640 1 --2- 172.21.15.27:0/240218047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2864100f40 0x7f2864198550 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f285400e9f0 tx=0x7f285400edf0 comp rx=0 tx=0).stop 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.212+0000 7f2863e00640 1 -- 172.21.15.27:0/240218047 reap_dead start 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.213+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 shutdown_connections 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.213+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 >> 172.21.15.27:0/240218047 conn(0x7f28640fa980 msgr2=0x7f28640fad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.213+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 shutdown_connections 2024-09-13T18:02:34.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.213+0000 7f286a200640 1 -- 172.21.15.27:0/240218047 wait complete. 2024-09-13T18:02:35.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.696+0000 7fc5bf000640 1 -- 172.21.15.27:0/2496489177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5b8102200 msgr2=0x7fc5b81025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.030 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.696+0000 7fc5bf000640 1 --2- 172.21.15.27:0/2496489177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5b8102200 0x7fc5b81025e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009ca0 tx=0x7fc5a802a8c0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.696+0000 7fc5bf000640 1 -- 172.21.15.27:0/2496489177 shutdown_connections 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.696+0000 7fc5bf000640 1 --2- 172.21.15.27:0/2496489177 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8107330 0x7fc5b810eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.696+0000 7fc5bf000640 1 --2- 172.21.15.27:0/2496489177 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5b8102bb0 0x7fc5b8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.696+0000 7fc5bf000640 1 --2- 172.21.15.27:0/2496489177 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5b8102200 0x7fc5b81025e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.696+0000 7fc5bf000640 1 -- 172.21.15.27:0/2496489177 >> 172.21.15.27:0/2496489177 conn(0x7fc5b80fdc60 msgr2=0x7fc5b8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.696+0000 7fc5bf000640 1 -- 172.21.15.27:0/2496489177 shutdown_connections 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.697+0000 7fc5bf000640 1 -- 172.21.15.27:0/2496489177 wait complete. 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.698+0000 7fc5bf000640 1 Processor -- start 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.698+0000 7fc5bf000640 1 -- start start 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.698+0000 7fc5bf000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5b8102200 0x7fc5b8198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.698+0000 7fc5bf000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8102bb0 0x7fc5b8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.698+0000 7fc5bf000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5b8107330 0x7fc5b819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.698+0000 7fc5bf000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b819d450 con 0x7fc5b8107330 2024-09-13T18:02:35.031 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.698+0000 7fc5bf000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b819d5c0 con 0x7fc5b8102bb0 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.698+0000 7fc5bf000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b819d730 con 0x7fc5b8102200 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5bd000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5b8107330 0x7fc5b819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5bd000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5b8107330 0x7fc5b819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35698/0 (socket says 172.21.15.27:35698) 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5bd000640 1 -- 172.21.15.27:0/880181396 learned_addr learned my addr 172.21.15.27:0/880181396 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5af400640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8102bb0 0x7fc5b8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5b7e00640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5b8102200 0x7fc5b8198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5bd000640 1 -- 172.21.15.27:0/880181396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5b8102200 msgr2=0x7fc5b8198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5bd000640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5b8102200 0x7fc5b8198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5bd000640 1 -- 172.21.15.27:0/880181396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8102bb0 msgr2=0x7fc5b8198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5bd000640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8102bb0 0x7fc5b8198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5bd000640 1 -- 172.21.15.27:0/880181396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a8009900 con 0x7fc5b8107330 2024-09-13T18:02:35.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5af400640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc5b8102bb0 0x7fc5b8198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5b7e00640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc5b8102200 0x7fc5b8198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.699+0000 7fc5bd000640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5b8107330 0x7fc5b819ce50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000e970 tx=0x7fc5b000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.700+0000 7fc5b5600640 1 -- 172.21.15.27:0/880181396 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0009720 con 0x7fc5b8107330 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.700+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b819da10 con 0x7fc5b8107330 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.700+0000 7fc5b5600640 1 -- 172.21.15.27:0/880181396 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc5b0005500 con 0x7fc5b8107330 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.700+0000 7fc5b5600640 1 -- 172.21.15.27:0/880181396 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0010430 con 0x7fc5b8107330 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.700+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b81a52d0 con 0x7fc5b8107330 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.701+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5b81036e0 con 0x7fc5b8107330 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.703+0000 7fc5b5600640 1 -- 172.21.15.27:0/880181396 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc5b0004f90 con 0x7fc5b8107330 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.704+0000 7fc5b5600640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc59c0a1110 0x7fc59c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.704+0000 7fc5b5600640 1 -- 172.21.15.27:0/880181396 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc5b0014070 con 0x7fc5b8107330 2024-09-13T18:02:35.033 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.704+0000 7fc5b7e00640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc59c0a1110 0x7fc59c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.704+0000 7fc5b5600640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] conn(0x7fc59c0aa960 0x7fc59c0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.704+0000 7fc5b5600640 1 -- 172.21.15.27:0/880181396 --> [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc59c0ad430 con 0x7fc59c0aa960 2024-09-13T18:02:35.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.704+0000 7fc5b5600640 1 -- 172.21.15.27:0/880181396 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5b00cd3e0 con 0x7fc5b8107330 2024-09-13T18:02:35.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.705+0000 7fc5af400640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] conn(0x7fc59c0aa960 0x7fc59c0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.705+0000 7fc5b7e00640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc59c0a1110 0x7fc59c0a35d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8005fa0 tx=0x7fc5a8030f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:35.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.705+0000 7fc5af400640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] conn(0x7fc59c0aa960 0x7fc59c0acd80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:35.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.707+0000 7fc5b5600640 1 -- 172.21.15.27:0/880181396 <== osd.2 v2:172.21.15.143:6800/134202082 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc59c0ad430 con 0x7fc59c0aa960 2024-09-13T18:02:35.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.720+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 --> [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5b8112420 con 0x7fc59c0aa960 2024-09-13T18:02:35.034 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.721+0000 7fc5b5600640 1 -- 172.21.15.27:0/880181396 <== osd.2 v2:172.21.15.143:6800/134202082 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc5a0009950 con 0x7fc59c0aa960 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 >> [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] conn(0x7fc59c0aa960 msgr2=0x7fc59c0acd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] conn(0x7fc59c0aa960 0x7fc59c0acd80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc59c0a1110 msgr2=0x7fc59c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc59c0a1110 0x7fc59c0a35d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8005fa0 tx=0x7fc5a8030f70 comp rx=0 tx=0).stop 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5b8107330 msgr2=0x7fc5b819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 --2- 172.21.15.27:0/880181396 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc5b8107330 0x7fc5b819ce50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000e970 tx=0x7fc5b000ed70 comp rx=0 tx=0).stop 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bd000640 1 -- 172.21.15.27:0/880181396 reap_dead start 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 shutdown_connections 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 >> 172.21.15.27:0/880181396 conn(0x7fc5b80fdc60 msgr2=0x7fc5b80ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 shutdown_connections 2024-09-13T18:02:35.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:31.722+0000 7fc5bf000640 1 -- 172.21.15.27:0/880181396 wait complete. 2024-09-13T18:02:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:35 smithi027 ceph-mon[30611]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.319+0000 7f271dc00640 1 -- 172.21.15.27:0/591907278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180fffe0 msgr2=0x7f27181003c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.319+0000 7f271dc00640 1 --2- 172.21.15.27:0/591907278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180fffe0 0x7f27181003c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2708009930 tx=0x7f270802a420 comp rx=0 tx=0).stop 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.319+0000 7f271dc00640 1 -- 172.21.15.27:0/591907278 shutdown_connections 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.319+0000 7f271dc00640 1 --2- 172.21.15.27:0/591907278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2718105110 0x7f271810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.319+0000 7f271dc00640 1 --2- 172.21.15.27:0/591907278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2718100990 0x7f27181049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.319+0000 7f271dc00640 1 --2- 172.21.15.27:0/591907278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180fffe0 0x7f27181003c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.319+0000 7f271dc00640 1 -- 172.21.15.27:0/591907278 >> 172.21.15.27:0/591907278 conn(0x7f27180fba80 msgr2=0x7f27180fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.319+0000 7f271dc00640 1 -- 172.21.15.27:0/591907278 shutdown_connections 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.319+0000 7f271dc00640 1 -- 172.21.15.27:0/591907278 wait complete. 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.320+0000 7f271dc00640 1 Processor -- start 2024-09-13T18:02:35.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.320+0000 7f271dc00640 1 -- start start 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f271dc00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180fffe0 0x7f2718198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f271dc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2718100990 0x7f2718198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f271dc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2718105110 0x7f271819ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f271dc00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271819d4d0 con 0x7f27180fffe0 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f271dc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271819d640 con 0x7f2718105110 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f271dc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271819d7b0 con 0x7f2718100990 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f2716a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180fffe0 0x7f2718198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f2716a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180fffe0 0x7f2718198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:35738/0 (socket says 172.21.15.27:35738) 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f2716a00640 1 -- 172.21.15.27:0/512566497 learned_addr learned my addr 172.21.15.27:0/512566497 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f2716000640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2718100990 0x7f2718198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.321+0000 7f2717400640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2718105110 0x7f271819ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f2716a00640 1 -- 172.21.15.27:0/512566497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2718100990 msgr2=0x7f2718198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f2716a00640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2718100990 0x7f2718198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f2716a00640 1 -- 172.21.15.27:0/512566497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2718105110 msgr2=0x7f271819ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f2716a00640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2718105110 0x7f271819ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f2716a00640 1 -- 172.21.15.27:0/512566497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009560 con 0x7f27180fffe0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f2716a00640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180fffe0 0x7f2718198590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2708005940 tx=0x7f27080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f270f400640 1 -- 172.21.15.27:0/512566497 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080044e0 con 0x7f27180fffe0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f270f400640 1 -- 172.21.15.27:0/512566497 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f27080046c0 con 0x7f27180fffe0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f270f400640 1 -- 172.21.15.27:0/512566497 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080038e0 con 0x7f27180fffe0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271819da30 con 0x7f27180fffe0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.322+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27181a5180 con 0x7f27180fffe0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.323+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27181014c0 con 0x7f27180fffe0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.325+0000 7f270f400640 1 -- 172.21.15.27:0/512566497 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2708004830 con 0x7f27180fffe0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.326+0000 7f270f400640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f26fc0a1110 0x7f26fc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.327+0000 7f270f400640 1 -- 172.21.15.27:0/512566497 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f27080ed4a0 con 0x7f27180fffe0 2024-09-13T18:02:35.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.327+0000 7f2716000640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f26fc0a1110 0x7f26fc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.327+0000 7f270f400640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] conn(0x7f26fc0aa960 0x7f26fc0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.327+0000 7f270f400640 1 -- 172.21.15.27:0/512566497 --> [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f26fc0ad430 con 0x7f26fc0aa960 2024-09-13T18:02:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.327+0000 7f270f400640 1 -- 172.21.15.27:0/512566497 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27080efa80 con 0x7f27180fffe0 2024-09-13T18:02:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.328+0000 7f2717400640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] conn(0x7f26fc0aa960 0x7f26fc0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.328+0000 7f2716000640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f26fc0a1110 0x7f26fc0a35d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2718199b40 tx=0x7f2704005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.328+0000 7f2717400640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] conn(0x7f26fc0aa960 0x7f26fc0acd80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.330+0000 7f270f400640 1 -- 172.21.15.27:0/512566497 <== osd.6 v2:172.21.15.27:6818/1338968311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f26fc0ad430 con 0x7f26fc0aa960 2024-09-13T18:02:35.344 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.345+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 --> [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2718110200 con 0x7f26fc0aa960 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.346+0000 7f270f400640 1 -- 172.21.15.27:0/512566497 <== osd.6 v2:172.21.15.27:6818/1338968311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2710009b20 con 0x7f26fc0aa960 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.346+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] conn(0x7f26fc0aa960 msgr2=0x7f26fc0acd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.346+0000 7f271dc00640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] conn(0x7f26fc0aa960 0x7f26fc0acd80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.346+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f26fc0a1110 msgr2=0x7f26fc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.346+0000 7f271dc00640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f26fc0a1110 0x7f26fc0a35d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2718199b40 tx=0x7f2704005f90 comp rx=0 tx=0).stop 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.347+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180fffe0 msgr2=0x7f2718198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.347+0000 7f271dc00640 1 --2- 172.21.15.27:0/512566497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f27180fffe0 0x7f2718198590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2708005940 tx=0x7f27080042f0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.347+0000 7f2717400640 1 -- 172.21.15.27:0/512566497 reap_dead start 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.347+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 shutdown_connections 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.347+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 >> 172.21.15.27:0/512566497 conn(0x7f27180fba80 msgr2=0x7f27180fbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.347+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 shutdown_connections 2024-09-13T18:02:35.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:34.347+0000 7f271dc00640 1 -- 172.21.15.27:0/512566497 wait complete. 2024-09-13T18:02:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:35 smithi122 ceph-mon[35310]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-13T18:02:35.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:35 smithi143 ceph-mon[38210]: pgmap v315: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-13T18:02:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.832+0000 7fdfddc00640 1 -- 172.21.15.27:0/2745650079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfd8102bb0 msgr2=0x7fdfd8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.832+0000 7fdfddc00640 1 --2- 172.21.15.27:0/2745650079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfd8102bb0 0x7fdfd8106c00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009930 tx=0x7fdfc002a420 comp rx=0 tx=0).stop 2024-09-13T18:02:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.833+0000 7fdfddc00640 1 -- 172.21.15.27:0/2745650079 shutdown_connections 2024-09-13T18:02:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.833+0000 7fdfddc00640 1 --2- 172.21.15.27:0/2745650079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd8107330 0x7fdfd810eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.833+0000 7fdfddc00640 1 --2- 172.21.15.27:0/2745650079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfd8102bb0 0x7fdfd8106c00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.833+0000 7fdfddc00640 1 --2- 172.21.15.27:0/2745650079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfd8102200 0x7fdfd81025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.833+0000 7fdfddc00640 1 -- 172.21.15.27:0/2745650079 >> 172.21.15.27:0/2745650079 conn(0x7fdfd80fdc60 msgr2=0x7fdfd8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.833+0000 7fdfddc00640 1 -- 172.21.15.27:0/2745650079 shutdown_connections 2024-09-13T18:02:35.835 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.833+0000 7fdfddc00640 1 -- 172.21.15.27:0/2745650079 wait complete. 2024-09-13T18:02:35.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.834+0000 7fdfddc00640 1 Processor -- start 2024-09-13T18:02:35.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.834+0000 7fdfddc00640 1 -- start start 2024-09-13T18:02:35.836 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfddc00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfd8102200 0x7fdfd8198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfddc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfd8102bb0 0x7fdfd8198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfddc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd8107330 0x7fdfd819cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfddc00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd819d580 con 0x7fdfd8102200 2024-09-13T18:02:35.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfddc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd819d6f0 con 0x7fdfd8107330 2024-09-13T18:02:35.837 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfddc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd819d860 con 0x7fdfd8102bb0 2024-09-13T18:02:35.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfd6a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfd8102200 0x7fdfd8198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfcfe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfd8102bb0 0x7fdfd8198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfd7400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd8107330 0x7fdfd819cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfcfe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfd8102bb0 0x7fdfd8198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:50880/0 (socket says 172.21.15.27:50880) 2024-09-13T18:02:35.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfd7400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd8107330 0x7fdfd819cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:44918/0 (socket says 172.21.15.27:44918) 2024-09-13T18:02:35.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.835+0000 7fdfcfe00640 1 -- 172.21.15.27:0/94449555 learned_addr learned my addr 172.21.15.27:0/94449555 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:35.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfd7400640 1 -- 172.21.15.27:0/94449555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfd8102bb0 msgr2=0x7fdfd8198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfd7400640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdfd8102bb0 0x7fdfd8198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfd7400640 1 -- 172.21.15.27:0/94449555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfd8102200 msgr2=0x7fdfd8198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfd7400640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdfd8102200 0x7fdfd8198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfd7400640 1 -- 172.21.15.27:0/94449555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc8009490 con 0x7fdfd8107330 2024-09-13T18:02:35.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfd7400640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd8107330 0x7fdfd819cf80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009fd0 tx=0x7fdfd000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfcf400640 1 -- 172.21.15.27:0/94449555 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000ce20 con 0x7fdfd8107330 2024-09-13T18:02:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfcf400640 1 -- 172.21.15.27:0/94449555 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdfd0005020 con 0x7fdfd8107330 2024-09-13T18:02:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc0009560 con 0x7fdfd8107330 2024-09-13T18:02:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.836+0000 7fdfcf400640 1 -- 172.21.15.27:0/94449555 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0010690 con 0x7fdfd8107330 2024-09-13T18:02:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.837+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd81a5230 con 0x7fdfd8107330 2024-09-13T18:02:35.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.838+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdfd81123b0 con 0x7fdfd8107330 2024-09-13T18:02:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.840+0000 7fdfcf400640 1 -- 172.21.15.27:0/94449555 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fdfd0005500 con 0x7fdfd8107330 2024-09-13T18:02:35.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.842+0000 7fdfcf400640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfbc0a1190 0x7fdfbc0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.842+0000 7fdfcf400640 1 -- 172.21.15.27:0/94449555 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdfd0014070 con 0x7fdfd8107330 2024-09-13T18:02:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.843+0000 7fdfd6a00640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfbc0a1190 0x7fdfbc0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.843+0000 7fdfcf400640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] conn(0x7fdfbc0aa9e0 0x7fdfbc0ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.843+0000 7fdfcf400640 1 -- 172.21.15.27:0/94449555 --> [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfbc0ad4b0 con 0x7fdfbc0aa9e0 2024-09-13T18:02:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.843+0000 7fdfcf400640 1 -- 172.21.15.27:0/94449555 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfd00cd320 con 0x7fdfd8107330 2024-09-13T18:02:35.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.843+0000 7fdfcfe00640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] conn(0x7fdfbc0aa9e0 0x7fdfbc0ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.843+0000 7fdfd6a00640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfbc0a1190 0x7fdfbc0a3650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009d60 tx=0x7fdfc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.844+0000 7fdfcfe00640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] conn(0x7fdfbc0aa9e0 0x7fdfbc0ace00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:35.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.845+0000 7fdfcf400640 1 -- 172.21.15.27:0/94449555 <== osd.7 v2:172.21.15.122:6816/4046950984 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fdfbc0ad4b0 con 0x7fdfbc0aa9e0 2024-09-13T18:02:35.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.860+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 --> [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdfd81036e0 con 0x7fdfbc0aa9e0 2024-09-13T18:02:35.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.860+0000 7fdfcf400640 1 -- 172.21.15.27:0/94449555 <== osd.7 v2:172.21.15.122:6816/4046950984 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fdfd81036e0 con 0x7fdfbc0aa9e0 2024-09-13T18:02:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 >> [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] conn(0x7fdfbc0aa9e0 msgr2=0x7fdfbc0ace00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] conn(0x7fdfbc0aa9e0 0x7fdfbc0ace00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfbc0a1190 msgr2=0x7fdfbc0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdfbc0a1190 0x7fdfbc0a3650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009d60 tx=0x7fdfc8005f90 comp rx=0 tx=0).stop 2024-09-13T18:02:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd8107330 msgr2=0x7fdfd819cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 --2- 172.21.15.27:0/94449555 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdfd8107330 0x7fdfd819cf80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0009fd0 tx=0x7fdfd000ef10 comp rx=0 tx=0).stop 2024-09-13T18:02:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfd7400640 1 -- 172.21.15.27:0/94449555 reap_dead start 2024-09-13T18:02:35.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 shutdown_connections 2024-09-13T18:02:35.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 >> 172.21.15.27:0/94449555 conn(0x7fdfd80fdc60 msgr2=0x7fdfd80ff090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:35.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 shutdown_connections 2024-09-13T18:02:35.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:35.861+0000 7fdfddc00640 1 -- 172.21.15.27:0/94449555 wait complete. 2024-09-13T18:02:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-13T18:02:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-13T18:02:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-13T18:02:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-13T18:02:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-13T18:02:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-13T18:02:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-09-13T18:02:36.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:36 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-13T18:02:36.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-13T18:02:36.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-13T18:02:36.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-13T18:02:36.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-13T18:02:36.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-13T18:02:36.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-13T18:02:36.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-09-13T18:02:36.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:36 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-13T18:02:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-13T18:02:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-13T18:02:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]: dispatch 2024-09-13T18:02:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]: dispatch 2024-09-13T18:02:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-13T18:02:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-09-13T18:02:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2024-09-13T18:02:36.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:36 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-09-13T18:02:36.652 INFO:teuthology.orchestra.run.smithi027.stdout:347892350998 2024-09-13T18:02:36.653 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-13T18:02:37.185 INFO:teuthology.orchestra.run.smithi027.stdout:292057776158 2024-09-13T18:02:37.185 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-13T18:02:37.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-13T18:02:37.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-13T18:02:37.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-13T18:02:37.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-13T18:02:37.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-13T18:02:37.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-13T18:02:37.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-13T18:02:37.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-09-13T18:02:37.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-13T18:02:37.465 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:37 smithi122 ceph-mon[35310]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T18:02:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-13T18:02:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-13T18:02:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-13T18:02:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-13T18:02:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-13T18:02:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-13T18:02:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-13T18:02:37.481 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-09-13T18:02:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-13T18:02:37.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:37 smithi027 ceph-mon[30611]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T18:02:37.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: pgmap v316: 97 pgs: 97 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-09-13T18:02:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-13T18:02:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-13T18:02:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2024-09-13T18:02:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [8, 1]}]': finished 2024-09-13T18:02:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-13T18:02:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-13T18:02:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2024-09-13T18:02:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-13T18:02:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:37 smithi143 ceph-mon[38210]: osdmap e87: 12 total, 12 up, 12 in 2024-09-13T18:02:37.835 INFO:teuthology.orchestra.run.smithi027.stdout:257698037797 2024-09-13T18:02:37.835 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-13T18:02:38.225 INFO:teuthology.orchestra.run.smithi027.stdout:77309411395 2024-09-13T18:02:38.225 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T18:02:38.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:38 smithi122 ceph-mon[35310]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T18:02:38.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:38 smithi143 ceph-mon[38210]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T18:02:38.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:38 smithi027 ceph-mon[30611]: osdmap e88: 12 total, 12 up, 12 in 2024-09-13T18:02:38.831 INFO:teuthology.orchestra.run.smithi027.stdout:223338299434 2024-09-13T18:02:38.831 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-13T18:02:39.387 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:39 smithi027 ceph-mon[30611]: pgmap v319: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3 op/s 2024-09-13T18:02:39.406 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:39.434 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:39.449 INFO:teuthology.orchestra.run.smithi027.stdout:201863462959 2024-09-13T18:02:39.450 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-13T18:02:39.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:39 smithi122 ceph-mon[35310]: pgmap v319: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3 op/s 2024-09-13T18:02:39.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:39 smithi143 ceph-mon[38210]: pgmap v319: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 3 op/s 2024-09-13T18:02:41.173 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:41.177 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:41.183 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:41.334 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:41.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:41 smithi122 ceph-mon[35310]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5 op/s; 83 B/s, 0 objects/s recovering 2024-09-13T18:02:41.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:41 smithi143 ceph-mon[38210]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5 op/s; 83 B/s, 0 objects/s recovering 2024-09-13T18:02:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:41 smithi027 ceph-mon[30611]: pgmap v320: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 5 op/s; 83 B/s, 0 objects/s recovering 2024-09-13T18:02:43.399 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:43 smithi027 ceph-mon[30611]: pgmap v321: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 op/s; 83 B/s, 0 objects/s recovering 2024-09-13T18:02:43.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:43 smithi122 ceph-mon[35310]: pgmap v321: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 op/s; 83 B/s, 0 objects/s recovering 2024-09-13T18:02:43.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:43 smithi143 ceph-mon[38210]: pgmap v321: 97 pgs: 3 peering, 94 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 op/s; 83 B/s, 0 objects/s recovering 2024-09-13T18:02:44.048 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:44.051 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:44.055 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:45.356 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:45 smithi027 ceph-mon[30611]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4 op/s; 224 B/s, 1 objects/s recovering 2024-09-13T18:02:45.356 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:45 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/920880626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T18:02:45.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:45 smithi122 ceph-mon[35310]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4 op/s; 224 B/s, 1 objects/s recovering 2024-09-13T18:02:45.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:45 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/920880626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T18:02:45.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:45 smithi143 ceph-mon[38210]: pgmap v322: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4 op/s; 224 B/s, 1 objects/s recovering 2024-09-13T18:02:45.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:45 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/920880626' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T18:02:46.427 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:46 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:02:46.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:46 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:02:46.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:46 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:02:47.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:47 smithi122 ceph-mon[35310]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4 op/s; 194 B/s, 1 objects/s recovering 2024-09-13T18:02:47.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:47 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3318838591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T18:02:47.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:47 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1793373450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T18:02:47.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:47 smithi027 ceph-mon[30611]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4 op/s; 194 B/s, 1 objects/s recovering 2024-09-13T18:02:47.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:47 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3318838591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T18:02:47.506 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:47 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1793373450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T18:02:47.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:47 smithi143 ceph-mon[38210]: pgmap v323: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4 op/s; 194 B/s, 1 objects/s recovering 2024-09-13T18:02:47.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:47 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3318838591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T18:02:47.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:47 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1793373450' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-13T18:02:48.602 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:48 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.602 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:48 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.602 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:48 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.602 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:48 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:48 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:48 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:48 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:48 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:48 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:48 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:48 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:48.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:48 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:02:49.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.897+0000 7f1d63e00640 1 -- 172.21.15.27:0/1223213140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 msgr2=0x7f1d5c106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:49.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.897+0000 7f1d63e00640 1 --2- 172.21.15.27:0/1223213140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 0x7f1d5c106bf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1d48009930 tx=0x7f1d4802a420 comp rx=0 tx=0).stop 2024-09-13T18:02:49.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.898+0000 7f1d63e00640 1 -- 172.21.15.27:0/1223213140 shutdown_connections 2024-09-13T18:02:49.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.898+0000 7f1d63e00640 1 --2- 172.21.15.27:0/1223213140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d5c107320 0x7f1d5c10eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:49.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.898+0000 7f1d63e00640 1 --2- 172.21.15.27:0/1223213140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 0x7f1d5c106bf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.898+0000 7f1d63e00640 1 --2- 172.21.15.27:0/1223213140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d5c1021f0 0x7f1d5c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.898+0000 7f1d63e00640 1 -- 172.21.15.27:0/1223213140 >> 172.21.15.27:0/1223213140 conn(0x7f1d5c0fdc70 msgr2=0x7f1d5c100090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.898+0000 7f1d63e00640 1 -- 172.21.15.27:0/1223213140 shutdown_connections 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.898+0000 7f1d63e00640 1 -- 172.21.15.27:0/1223213140 wait complete. 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.899+0000 7f1d63e00640 1 Processor -- start 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.899+0000 7f1d63e00640 1 -- start start 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.899+0000 7f1d63e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d5c1021f0 0x7f1d5c198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.899+0000 7f1d63e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 0x7f1d5c198b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.899+0000 7f1d63e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d5c107320 0x7f1d5c19cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.899+0000 7f1d63e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c19d570 con 0x7f1d5c102ba0 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.899+0000 7f1d63e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c19d6e0 con 0x7f1d5c107320 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.899+0000 7f1d63e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5c19d850 con 0x7f1d5c1021f0 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.899+0000 7f1d60a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 0x7f1d5c198b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d60a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 0x7f1d5c198b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:59992/0 (socket says 172.21.15.27:59992) 2024-09-13T18:02:49.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d60a00640 1 -- 172.21.15.27:0/920880626 learned_addr learned my addr 172.21.15.27:0/920880626 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d61400640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d5c1021f0 0x7f1d5c198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d61e00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d5c107320 0x7f1d5c19cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d60a00640 1 -- 172.21.15.27:0/920880626 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d5c1021f0 msgr2=0x7f1d5c198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d60a00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d5c1021f0 0x7f1d5c198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d60a00640 1 -- 172.21.15.27:0/920880626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d5c107320 msgr2=0x7f1d5c19cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d60a00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d5c107320 0x7f1d5c19cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d60a00640 1 -- 172.21.15.27:0/920880626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d48009560 con 0x7f1d5c102ba0 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d61e00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d5c107320 0x7f1d5c19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.900+0000 7f1d60a00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 0x7f1d5c198b70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1d48005ab0 tx=0x7f1d48005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:49.116 INFO:teuthology.orchestra.run.smithi027.stdout:146028888124 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.901+0000 7f1d5a000640 1 -- 172.21.15.27:0/920880626 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48004b50 con 0x7f1d5c102ba0 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.901+0000 7f1d5a000640 1 -- 172.21.15.27:0/920880626 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1d48004cb0 con 0x7f1d5c102ba0 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.901+0000 7f1d5a000640 1 -- 172.21.15.27:0/920880626 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48031a30 con 0x7f1d5c102ba0 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.901+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5c19dad0 con 0x7f1d5c102ba0 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.901+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5c1a5220 con 0x7f1d5c102ba0 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.902+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5c1036d0 con 0x7f1d5c102ba0 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.904+0000 7f1d5a000640 1 -- 172.21.15.27:0/920880626 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1d48003c40 con 0x7f1d5c102ba0 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.906+0000 7f1d5a000640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d440a1110 0x7f1d440a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.906+0000 7f1d5a000640 1 -- 172.21.15.27:0/920880626 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1d480ed920 con 0x7f1d5c102ba0 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.906+0000 7f1d61400640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d440a1110 0x7f1d440a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:49.117 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.907+0000 7f1d61400640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d440a1110 0x7f1d440a35d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1d50005d00 tx=0x7f1d5000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:44.910+0000 7f1d5a000640 1 -- 172.21.15.27:0/920880626 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1d480b6fb0 con 0x7f1d5c102ba0 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.092+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1d5c10a500 con 0x7f1d5c102ba0 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.093+0000 7f1d5a000640 1 -- 172.21.15.27:0/920880626 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d48040090 con 0x7f1d5c102ba0 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d440a1110 msgr2=0x7f1d440a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d440a1110 0x7f1d440a35d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1d50005d00 tx=0x7f1d5000b410 comp rx=0 tx=0).stop 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 msgr2=0x7f1d5c198b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 0x7f1d5c198b70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1d48005ab0 tx=0x7f1d48005620 comp rx=0 tx=0).stop 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 shutdown_connections 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d440a1110 0x7f1d440a35d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1d5c107320 0x7f1d5c19cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1d5c102ba0 0x7f1d5c198b70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 --2- 172.21.15.27:0/920880626 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1d5c1021f0 0x7f1d5c198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 >> 172.21.15.27:0/920880626 conn(0x7f1d5c0fdc70 msgr2=0x7f1d5c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:49.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 shutdown_connections 2024-09-13T18:02:49.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:45.095+0000 7f1d63e00640 1 -- 172.21.15.27:0/920880626 wait complete. 2024-09-13T18:02:49.677 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:49 smithi143 ceph-mon[38210]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s; 175 B/s, 1 objects/s recovering 2024-09-13T18:02:49.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:49 smithi122 ceph-mon[35310]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s; 175 B/s, 1 objects/s recovering 2024-09-13T18:02:49.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:49 smithi027 ceph-mon[30611]: pgmap v324: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s; 175 B/s, 1 objects/s recovering 2024-09-13T18:02:49.937 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888120 got 146028888124 for osd.4 2024-09-13T18:02:49.938 DEBUG:teuthology.parallel:result is None 2024-09-13T18:02:50.516 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:50 smithi027 ceph-mon[30611]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 149 B/s, 1 objects/s recovering 2024-09-13T18:02:50.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:50 smithi122 ceph-mon[35310]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 149 B/s, 1 objects/s recovering 2024-09-13T18:02:50.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:50 smithi143 ceph-mon[38210]: pgmap v325: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s; 149 B/s, 1 objects/s recovering 2024-09-13T18:02:50.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.013+0000 7fddad600640 1 -- 172.21.15.27:0/2096296554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8110c40 msgr2=0x7fdda8113030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:50.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.013+0000 7fddad600640 1 --2- 172.21.15.27:0/2096296554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8110c40 0x7fdda8113030 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009ca0 tx=0x7fdda002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.933 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.014+0000 7fddad600640 1 -- 172.21.15.27:0/2096296554 shutdown_connections 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.014+0000 7fddad600640 1 --2- 172.21.15.27:0/2096296554 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8110c40 0x7fdda8113030 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.014+0000 7fddad600640 1 --2- 172.21.15.27:0/2096296554 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdda8075300 0x7fdda8110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.014+0000 7fddad600640 1 --2- 172.21.15.27:0/2096296554 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdda80749e0 0x7fdda8074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.014+0000 7fddad600640 1 -- 172.21.15.27:0/2096296554 >> 172.21.15.27:0/2096296554 conn(0x7fdda80fdc60 msgr2=0x7fdda8100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.014+0000 7fddad600640 1 -- 172.21.15.27:0/2096296554 shutdown_connections 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.014+0000 7fddad600640 1 -- 172.21.15.27:0/2096296554 wait complete. 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fddad600640 1 Processor -- start 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fddad600640 1 -- start start 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fddad600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdda80749e0 0x7fdda81a26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fddad600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8075300 0x7fdda81a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fddad600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdda8110c40 0x7fdda819c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:50.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fddad600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda819cea0 con 0x7fdda8075300 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fddad600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda819d010 con 0x7fdda8110c40 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fddad600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda819d1d0 con 0x7fdda80749e0 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fdda6000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8075300 0x7fdda81a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fdda6000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8075300 0x7fdda81a2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60008/0 (socket says 172.21.15.27:60008) 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fdda6000640 1 -- 172.21.15.27:0/3318838591 learned_addr learned my addr 172.21.15.27:0/3318838591 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fdda6a00640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdda80749e0 0x7fdda81a26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.015+0000 7fdda7400640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdda8110c40 0x7fdda819c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fdda6000640 1 -- 172.21.15.27:0/3318838591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdda80749e0 msgr2=0x7fdda81a26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fdda6000640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdda80749e0 0x7fdda81a26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fdda6000640 1 -- 172.21.15.27:0/3318838591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdda8110c40 msgr2=0x7fdda819c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fdda6000640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdda8110c40 0x7fdda819c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fdda6000640 1 -- 172.21.15.27:0/3318838591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0009900 con 0x7fdda8075300 2024-09-13T18:02:50.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fdda6000640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8075300 0x7fdda81a2bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400d950 tx=0x7fdd9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fdd9f400640 1 -- 172.21.15.27:0/3318838591 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94009a30 con 0x7fdda8075300 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda819d4b0 con 0x7fdda8075300 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fdd9f400640 1 -- 172.21.15.27:0/3318838591 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdd94009b90 con 0x7fdda8075300 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.016+0000 7fdd9f400640 1 -- 172.21.15.27:0/3318838591 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94004a00 con 0x7fdda8075300 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.017+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda81a96a0 con 0x7fdda8075300 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.018+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda8076120 con 0x7fdda8075300 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.019+0000 7fdd9f400640 1 -- 172.21.15.27:0/3318838591 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fdd94009d00 con 0x7fdda8075300 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.022+0000 7fdd9f400640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdd8c0a1110 0x7fdd8c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.022+0000 7fdd9f400640 1 -- 172.21.15.27:0/3318838591 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdd940cc3c0 con 0x7fdda8075300 2024-09-13T18:02:50.936 INFO:teuthology.orchestra.run.smithi027.stdout:34359738447 2024-09-13T18:02:50.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.022+0000 7fdda6a00640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdd8c0a1110 0x7fdd8c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:50.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.022+0000 7fdda6a00640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdd8c0a1110 0x7fdd8c0a35d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005fd0 tx=0x7fdd9800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:50.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.026+0000 7fdd9f400640 1 -- 172.21.15.27:0/3318838591 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdd940959a0 con 0x7fdda8075300 2024-09-13T18:02:50.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.258+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdda8074dc0 con 0x7fdda8075300 2024-09-13T18:02:50.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.259+0000 7fdd9f400640 1 -- 172.21.15.27:0/3318838591 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd94098fc0 con 0x7fdda8075300 2024-09-13T18:02:50.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdd8c0a1110 msgr2=0x7fdd8c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:50.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdd8c0a1110 0x7fdd8c0a35d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005fd0 tx=0x7fdd9800b390 comp rx=0 tx=0).stop 2024-09-13T18:02:50.937 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8075300 msgr2=0x7fdda81a2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:50.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8075300 0x7fdda81a2bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400d950 tx=0x7fdd9400de10 comp rx=0 tx=0).stop 2024-09-13T18:02:50.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 shutdown_connections 2024-09-13T18:02:50.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdd8c0a1110 0x7fdd8c0a35d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdda8110c40 0x7fdda819c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdda8075300 0x7fdda81a2bf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 --2- 172.21.15.27:0/3318838591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdda80749e0 0x7fdda81a26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:50.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 >> 172.21.15.27:0/3318838591 conn(0x7fdda80fdc60 msgr2=0x7fdda8100050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:50.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.261+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 shutdown_connections 2024-09-13T18:02:50.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.262+0000 7fddad600640 1 -- 172.21.15.27:0/3318838591 wait complete. 2024-09-13T18:02:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:51.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.153+0000 7f1cf4a00640 1 -- 172.21.15.27:0/9665326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cf0072850 msgr2=0x7f1cf0072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:51.376 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.153+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/9665326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cf0072850 0x7f1cf0072c30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009900 tx=0x7f1ce002a480 comp rx=0 tx=0).stop 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.153+0000 7f1cf4a00640 1 -- 172.21.15.27:0/9665326 shutdown_connections 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.153+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/9665326 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf0110bc0 0x7f1cf0112fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.153+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/9665326 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cf0073170 0x7f1cf0110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.153+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/9665326 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cf0072850 0x7f1cf0072c30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.153+0000 7f1cf4a00640 1 -- 172.21.15.27:0/9665326 >> 172.21.15.27:0/9665326 conn(0x7f1cf00fb870 msgr2=0x7f1cf00fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.153+0000 7f1cf4a00640 1 -- 172.21.15.27:0/9665326 shutdown_connections 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.154+0000 7f1cf4a00640 1 -- 172.21.15.27:0/9665326 wait complete. 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.155+0000 7f1cf4a00640 1 Processor -- start 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.155+0000 7f1cf4a00640 1 -- start start 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.156+0000 7f1cf4a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf0072850 0x7f1cf01a2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cf4a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cf0073170 0x7f1cf01a2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:51.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cf4a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cf0110bc0 0x7f1cf019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cef400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf0072850 0x7f1cf01a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cf4a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf019cca0 con 0x7f1cf0110bc0 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cf4a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf019ce10 con 0x7f1cf0072850 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cf4a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf019cfd0 con 0x7f1cf0073170 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cef400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf0072850 0x7f1cf01a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:45782/0 (socket says 172.21.15.27:45782) 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cef400640 1 -- 172.21.15.27:0/1793373450 learned_addr learned my addr 172.21.15.27:0/1793373450 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1ceea00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cf0073170 0x7f1cf01a2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cef400640 1 -- 172.21.15.27:0/1793373450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cf0073170 msgr2=0x7f1cf01a2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.157+0000 7f1cef400640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cf0073170 0x7f1cf01a2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.158+0000 7f1cef400640 1 -- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cf0110bc0 msgr2=0x7f1cf019c650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.159+0000 7f1cefe00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cf0110bc0 0x7f1cf019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.159+0000 7f1cef400640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cf0110bc0 0x7f1cf019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:51.378 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.159+0000 7f1cef400640 1 -- 172.21.15.27:0/1793373450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0009560 con 0x7f1cf0072850 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.159+0000 7f1cefe00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cf0110bc0 0x7f1cf019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.159+0000 7f1cef400640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf0072850 0x7f1cf01a2560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005ab0 tx=0x7f1ce0005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.160+0000 7f1ce7e00640 1 -- 172.21.15.27:0/1793373450 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0004ad0 con 0x7f1cf0072850 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.160+0000 7f1ce7e00640 1 -- 172.21.15.27:0/1793373450 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ce0004c30 con 0x7f1cf0072850 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.160+0000 7f1ce7e00640 1 -- 172.21.15.27:0/1793373450 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0031970 con 0x7f1cf0072850 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.160+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf019d250 con 0x7f1cf0072850 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.161+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf019d4d0 con 0x7f1cf0072850 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.162+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf0073f90 con 0x7f1cf0072850 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.165+0000 7f1ce7e00640 1 -- 172.21.15.27:0/1793373450 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1ce0031ad0 con 0x7f1cf0072850 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.166+0000 7f1ce7e00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1cd40a1250 0x7f1cd40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:51.379 INFO:teuthology.orchestra.run.smithi027.stdout:223338299436 2024-09-13T18:02:51.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.167+0000 7f1ce7e00640 1 -- 172.21.15.27:0/1793373450 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1ce00ed6a0 con 0x7f1cf0072850 2024-09-13T18:02:51.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.167+0000 7f1ceea00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1cd40a1250 0x7f1cd40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:51.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.167+0000 7f1ceea00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1cd40a1250 0x7f1cd40a3710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1cf019dac0 tx=0x7f1cdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:51.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.168+0000 7f1ce7e00640 1 -- 172.21.15.27:0/1793373450 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1ce00b6d00 con 0x7f1cf0072850 2024-09-13T18:02:51.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.370+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1cf0072c30 con 0x7f1cf0072850 2024-09-13T18:02:51.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.371+0000 7f1ce7e00640 1 -- 172.21.15.27:0/1793373450 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ce004a090 con 0x7f1cf0072850 2024-09-13T18:02:51.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1cd40a1250 msgr2=0x7f1cd40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1cd40a1250 0x7f1cd40a3710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1cf019dac0 tx=0x7f1cdc005f90 comp rx=0 tx=0).stop 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf0072850 msgr2=0x7f1cf01a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf0072850 0x7f1cf01a2560 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0005ab0 tx=0x7f1ce0005620 comp rx=0 tx=0).stop 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 shutdown_connections 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1cd40a1250 0x7f1cd40a3710 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1cf0110bc0 0x7f1cf019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1cf0073170 0x7f1cf01a2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 --2- 172.21.15.27:0/1793373450 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1cf0072850 0x7f1cf01a2560 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 >> 172.21.15.27:0/1793373450 conn(0x7f1cf00fb870 msgr2=0x7f1cf00fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 shutdown_connections 2024-09-13T18:02:51.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:46.373+0000 7f1cf4a00640 1 -- 172.21.15.27:0/1793373450 wait complete. 2024-09-13T18:02:51.818 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:02:52.172 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299434 got 223338299436 for osd.7 2024-09-13T18:02:52.172 DEBUG:teuthology.parallel:result is None 2024-09-13T18:02:52.654 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:52 smithi027 ceph-mon[30611]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 93 B/s, 0 objects/s recovering 2024-09-13T18:02:52.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:52 smithi122 ceph-mon[35310]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 93 B/s, 0 objects/s recovering 2024-09-13T18:02:52.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:52 smithi143 ceph-mon[38210]: pgmap v326: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 93 B/s, 0 objects/s recovering 2024-09-13T18:02:53.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.490+0000 7fde5fc00640 1 -- 172.21.15.27:0/903430279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58106fa0 msgr2=0x7fde5810aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:53.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.490+0000 7fde5fc00640 1 --2- 172.21.15.27:0/903430279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58106fa0 0x7fde5810aff0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fde40009930 tx=0x7fde4002a440 comp rx=0 tx=0).stop 2024-09-13T18:02:53.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.491+0000 7fde5fc00640 1 -- 172.21.15.27:0/903430279 shutdown_connections 2024-09-13T18:02:53.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.491+0000 7fde5fc00640 1 --2- 172.21.15.27:0/903430279 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde5810b720 0x7fde581132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.491+0000 7fde5fc00640 1 --2- 172.21.15.27:0/903430279 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58106fa0 0x7fde5810aff0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.491+0000 7fde5fc00640 1 --2- 172.21.15.27:0/903430279 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde581065f0 0x7fde581069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.491+0000 7fde5fc00640 1 -- 172.21.15.27:0/903430279 >> 172.21.15.27:0/903430279 conn(0x7fde58075d10 msgr2=0x7fde58078130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.491+0000 7fde5fc00640 1 -- 172.21.15.27:0/903430279 shutdown_connections 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.491+0000 7fde5fc00640 1 -- 172.21.15.27:0/903430279 wait complete. 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.492+0000 7fde5fc00640 1 Processor -- start 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.492+0000 7fde5fc00640 1 -- start start 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5fc00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde581065f0 0x7fde5819c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5fc00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde58106fa0 0x7fde5819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5fc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde5810b720 0x7fde581a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5fc00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581a1960 con 0x7fde581065f0 2024-09-13T18:02:53.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5fc00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581a1ad0 con 0x7fde5810b720 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5fc00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581a1c90 con 0x7fde58106fa0 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5d200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde581065f0 0x7fde5819c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5d200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde581065f0 0x7fde5819c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46614/0 (socket says 172.21.15.27:46614) 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5d200640 1 -- 172.21.15.27:0/1049025459 learned_addr learned my addr 172.21.15.27:0/1049025459 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde4fe00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde58106fa0 0x7fde5819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5dc00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde5810b720 0x7fde581a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5d200640 1 -- 172.21.15.27:0/1049025459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde58106fa0 msgr2=0x7fde5819cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5d200640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde58106fa0 0x7fde5819cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5d200640 1 -- 172.21.15.27:0/1049025459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde5810b720 msgr2=0x7fde581a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5d200640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde5810b720 0x7fde581a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.493+0000 7fde5d200640 1 -- 172.21.15.27:0/1049025459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40009560 con 0x7fde581065f0 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.494+0000 7fde5d200640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde581065f0 0x7fde5819c9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d950 tx=0x7fde4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:53.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.494+0000 7fde56000640 1 -- 172.21.15.27:0/1049025459 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48009a30 con 0x7fde581065f0 2024-09-13T18:02:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.494+0000 7fde56000640 1 -- 172.21.15.27:0/1049025459 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fde48009b90 con 0x7fde581065f0 2024-09-13T18:02:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.494+0000 7fde56000640 1 -- 172.21.15.27:0/1049025459 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48004a00 con 0x7fde581065f0 2024-09-13T18:02:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.494+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde581a1f70 con 0x7fde581065f0 2024-09-13T18:02:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.494+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde581a97e0 con 0x7fde581065f0 2024-09-13T18:02:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.495+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde58107ad0 con 0x7fde581065f0 2024-09-13T18:02:53.503 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.497+0000 7fde56000640 1 -- 172.21.15.27:0/1049025459 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fde48009d00 con 0x7fde581065f0 2024-09-13T18:02:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.499+0000 7fde56000640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1190 0x7fde3c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.499+0000 7fde56000640 1 -- 172.21.15.27:0/1049025459 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fde480cc390 con 0x7fde581065f0 2024-09-13T18:02:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.499+0000 7fde4fe00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1190 0x7fde3c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:53.504 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.500+0000 7fde4fe00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1190 0x7fde3c0a3650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde40009900 tx=0x7fde40005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:53.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.503+0000 7fde56000640 1 -- 172.21.15.27:0/1049025459 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fde48095970 con 0x7fde581065f0 2024-09-13T18:02:53.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.688+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fde581069d0 con 0x7fde581065f0 2024-09-13T18:02:53.692 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:53 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1739764531' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T18:02:53.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.689+0000 7fde56000640 1 -- 172.21.15.27:0/1049025459 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fde48098f90 con 0x7fde581065f0 2024-09-13T18:02:53.693 INFO:teuthology.orchestra.run.smithi027.stdout:313532612638 2024-09-13T18:02:53.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1190 msgr2=0x7fde3c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:53.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1190 0x7fde3c0a3650 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde40009900 tx=0x7fde40005a20 comp rx=0 tx=0).stop 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde581065f0 msgr2=0x7fde5819c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde581065f0 0x7fde5819c9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fde4800d950 tx=0x7fde4800de10 comp rx=0 tx=0).stop 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 shutdown_connections 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1190 0x7fde3c0a3650 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde5810b720 0x7fde581a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde58106fa0 0x7fde5819cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 --2- 172.21.15.27:0/1049025459 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde581065f0 0x7fde5819c9f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 >> 172.21.15.27:0/1049025459 conn(0x7fde58075d10 msgr2=0x7fde580770b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 shutdown_connections 2024-09-13T18:02:53.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.691+0000 7fde5fc00640 1 -- 172.21.15.27:0/1049025459 wait complete. 2024-09-13T18:02:53.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:53 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1739764531' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T18:02:53.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:53 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1739764531' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-13T18:02:54.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.817+0000 7f9f97400640 1 -- 172.21.15.27:0/424001788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f90100000 msgr2=0x7f9f901003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:54.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.817+0000 7f9f97400640 1 --2- 172.21.15.27:0/424001788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f90100000 0x7f9f901003e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009930 tx=0x7f9f8002a420 comp rx=0 tx=0).stop 2024-09-13T18:02:54.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.818+0000 7f9f97400640 1 -- 172.21.15.27:0/424001788 shutdown_connections 2024-09-13T18:02:54.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.818+0000 7f9f97400640 1 --2- 172.21.15.27:0/424001788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f90105130 0x7f9f9010ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:54.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.818+0000 7f9f97400640 1 --2- 172.21.15.27:0/424001788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f901009b0 0x7f9f90104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:54.296 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.818+0000 7f9f97400640 1 --2- 172.21.15.27:0/424001788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f90100000 0x7f9f901003e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.818+0000 7f9f97400640 1 -- 172.21.15.27:0/424001788 >> 172.21.15.27:0/424001788 conn(0x7f9f900fbaa0 msgr2=0x7f9f900fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.818+0000 7f9f97400640 1 -- 172.21.15.27:0/424001788 shutdown_connections 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.818+0000 7f9f97400640 1 -- 172.21.15.27:0/424001788 wait complete. 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.819+0000 7f9f97400640 1 Processor -- start 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.819+0000 7f9f97400640 1 -- start start 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.819+0000 7f9f97400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f90100000 0x7f9f90196440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.819+0000 7f9f97400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f901009b0 0x7f9f90196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.819+0000 7f9f97400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f90105130 0x7f9f9019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.819+0000 7f9f97400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9019b380 con 0x7f9f901009b0 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.819+0000 7f9f97400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9019b4f0 con 0x7f9f90105130 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.819+0000 7f9f97400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9019b660 con 0x7f9f90100000 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.819+0000 7f9f87e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f901009b0 0x7f9f90196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:54.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f87e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f901009b0 0x7f9f90196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46598/0 (socket says 172.21.15.27:46598) 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f87e00640 1 -- 172.21.15.27:0/1739764531 learned_addr learned my addr 172.21.15.27:0/1739764531 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f94a00640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f90100000 0x7f9f90196440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f95400640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f90105130 0x7f9f9019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f87e00640 1 -- 172.21.15.27:0/1739764531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f90100000 msgr2=0x7f9f90196440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f87e00640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f90100000 0x7f9f90196440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f87e00640 1 -- 172.21.15.27:0/1739764531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f90105130 msgr2=0x7f9f9019ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f87e00640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f90105130 0x7f9f9019ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f87e00640 1 -- 172.21.15.27:0/1739764531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009560 con 0x7f9f901009b0 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.820+0000 7f9f95400640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f90105130 0x7f9f9019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.821+0000 7f9f87e00640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f901009b0 0x7f9f90196980 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009f40 tx=0x7f9f7800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.821+0000 7f9f8e000640 1 -- 172.21.15.27:0/1739764531 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78009720 con 0x7f9f901009b0 2024-09-13T18:02:54.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.821+0000 7f9f8e000640 1 -- 172.21.15.27:0/1739764531 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9f78005020 con 0x7f9f901009b0 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.821+0000 7f9f8e000640 1 -- 172.21.15.27:0/1739764531 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78017ea0 con 0x7f9f901009b0 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.821+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9019b940 con 0x7f9f901009b0 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.821+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f900728b0 con 0x7f9f901009b0 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.822+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f901014e0 con 0x7f9f901009b0 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.825+0000 7f9f8e000640 1 -- 172.21.15.27:0/1739764531 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9f78005190 con 0x7f9f901009b0 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.827+0000 7f9f8e000640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9f740a1110 0x7f9f740a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.827+0000 7f9f8e000640 1 -- 172.21.15.27:0/1739764531 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9f780d5200 con 0x7f9f901009b0 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.827+0000 7f9f94a00640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9f740a1110 0x7f9f740a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.828+0000 7f9f94a00640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9f740a1110 0x7f9f740a35d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9f80005ab0 tx=0x7f9f80005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:54.299 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:52.831+0000 7f9f8e000640 1 -- 172.21.15.27:0/1739764531 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9f7809e9a0 con 0x7f9f901009b0 2024-09-13T18:02:54.300 INFO:teuthology.orchestra.run.smithi027.stdout:257698037801 2024-09-13T18:02:54.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.027+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f9f90100460 con 0x7f9f901009b0 2024-09-13T18:02:54.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.028+0000 7f9f8e000640 1 -- 172.21.15.27:0/1739764531 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f780a1fc0 con 0x7f9f901009b0 2024-09-13T18:02:54.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9f740a1110 msgr2=0x7f9f740a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:54.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9f740a1110 0x7f9f740a35d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9f80005ab0 tx=0x7f9f80005a20 comp rx=0 tx=0).stop 2024-09-13T18:02:54.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f901009b0 msgr2=0x7f9f90196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:54.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f901009b0 0x7f9f90196980 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009f40 tx=0x7f9f7800ee80 comp rx=0 tx=0).stop 2024-09-13T18:02:54.300 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 shutdown_connections 2024-09-13T18:02:54.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9f740a1110 0x7f9f740a35d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:54.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9f90105130 0x7f9f9019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:54.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9f901009b0 0x7f9f90196980 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:54.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 --2- 172.21.15.27:0/1739764531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9f90100000 0x7f9f90196440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:54.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.030+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 >> 172.21.15.27:0/1739764531 conn(0x7f9f900fbaa0 msgr2=0x7f9f900fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:54.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.031+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 shutdown_connections 2024-09-13T18:02:54.301 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:53.031+0000 7f9f97400640 1 -- 172.21.15.27:0/1739764531 wait complete. 2024-09-13T18:02:54.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:54 smithi027 ceph-mon[30611]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s; 93 B/s, 0 objects/s recovering 2024-09-13T18:02:54.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:54 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1049025459' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T18:02:54.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:54 smithi122 ceph-mon[35310]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s; 93 B/s, 0 objects/s recovering 2024-09-13T18:02:54.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:54 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1049025459' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T18:02:54.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:54 smithi143 ceph-mon[38210]: pgmap v327: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s; 93 B/s, 0 objects/s recovering 2024-09-13T18:02:54.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:54 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1049025459' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-13T18:02:56.062 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037797 got 257698037801 for osd.8 2024-09-13T18:02:56.062 DEBUG:teuthology.parallel:result is None 2024-09-13T18:02:56.704 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:56 smithi027 ceph-mon[30611]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:02:56.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:56 smithi122 ceph-mon[35310]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:02:56.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:56 smithi143 ceph-mon[38210]: pgmap v328: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:02:57.083 INFO:tasks.cephadm.ceph_manager.ceph:need seq 313532612633 got 313532612638 for osd.10 2024-09-13T18:02:57.083 DEBUG:teuthology.parallel:result is None 2024-09-13T18:02:58.528 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:58 smithi027 ceph-mon[30611]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:02:58.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:58 smithi122 ceph-mon[35310]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:02:58.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:58 smithi143 ceph-mon[38210]: pgmap v329: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:02:59.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.323+0000 7f075a000640 1 -- 172.21.15.27:0/4016845466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754102bb0 msgr2=0x7f0754106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.323+0000 7f075a000640 1 --2- 172.21.15.27:0/4016845466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754102bb0 0x7f0754106c00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0740009930 tx=0x7f074002a420 comp rx=0 tx=0).stop 2024-09-13T18:02:59.272 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.323+0000 7f075a000640 1 -- 172.21.15.27:0/4016845466 shutdown_connections 2024-09-13T18:02:59.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.323+0000 7f075a000640 1 --2- 172.21.15.27:0/4016845466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754107330 0x7f075410eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.323+0000 7f075a000640 1 --2- 172.21.15.27:0/4016845466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754102bb0 0x7f0754106c00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.323+0000 7f075a000640 1 --2- 172.21.15.27:0/4016845466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0754102200 0x7f07541025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.323+0000 7f075a000640 1 -- 172.21.15.27:0/4016845466 >> 172.21.15.27:0/4016845466 conn(0x7f07540fdc40 msgr2=0x7f0754100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:59.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.323+0000 7f075a000640 1 -- 172.21.15.27:0/4016845466 shutdown_connections 2024-09-13T18:02:59.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.323+0000 7f075a000640 1 -- 172.21.15.27:0/4016845466 wait complete. 2024-09-13T18:02:59.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.324+0000 7f075a000640 1 Processor -- start 2024-09-13T18:02:59.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.324+0000 7f075a000640 1 -- start start 2024-09-13T18:02:59.273 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.324+0000 7f075a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0754102200 0x7f07541985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.324+0000 7f075a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754102bb0 0x7f0754198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.324+0000 7f075a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754107330 0x7f075419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.324+0000 7f075a000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075419d4e0 con 0x7f0754107330 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.324+0000 7f075a000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075419d650 con 0x7f0754102200 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.324+0000 7f075a000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075419d7c0 con 0x7f0754102bb0 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0753e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754107330 0x7f075419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0753e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754107330 0x7f075419cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46636/0 (socket says 172.21.15.27:46636) 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0753e00640 1 -- 172.21.15.27:0/2443204888 learned_addr learned my addr 172.21.15.27:0/2443204888 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0752a00640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754102bb0 0x7f0754198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0753400640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0754102200 0x7f07541985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0753e00640 1 -- 172.21.15.27:0/2443204888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754102bb0 msgr2=0x7f0754198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0753e00640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754102bb0 0x7f0754198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0753e00640 1 -- 172.21.15.27:0/2443204888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0754102200 msgr2=0x7f07541985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0753e00640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0754102200 0x7f07541985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.325+0000 7f0753e00640 1 -- 172.21.15.27:0/2443204888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740009560 con 0x7f0754107330 2024-09-13T18:02:59.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.326+0000 7f0753e00640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754107330 0x7f075419cee0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f074c00eaa0 tx=0x7f074c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:59.275 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.326+0000 7f074be00640 1 -- 172.21.15.27:0/2443204888 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00cdb0 con 0x7f0754107330 2024-09-13T18:02:59.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.326+0000 7f074be00640 1 -- 172.21.15.27:0/2443204888 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f074c005020 con 0x7f0754107330 2024-09-13T18:02:59.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.326+0000 7f074be00640 1 -- 172.21.15.27:0/2443204888 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0116b0 con 0x7f0754107330 2024-09-13T18:02:59.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.326+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075419daa0 con 0x7f0754107330 2024-09-13T18:02:59.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.326+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07541a5360 con 0x7f0754107330 2024-09-13T18:02:59.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.327+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07541036e0 con 0x7f0754107330 2024-09-13T18:02:59.277 INFO:teuthology.orchestra.run.smithi027.stdout:292057776164 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.331+0000 7f074be00640 1 -- 172.21.15.27:0/2443204888 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f074c005520 con 0x7f0754107330 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.332+0000 7f074be00640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07380a1190 0x7f07380a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.332+0000 7f074be00640 1 -- 172.21.15.27:0/2443204888 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f074c0ccf10 con 0x7f0754107330 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.332+0000 7f0753400640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07380a1190 0x7f07380a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.333+0000 7f0753400640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07380a1190 0x7f07380a3650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0744005d00 tx=0x7f074400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.334+0000 7f074be00640 1 -- 172.21.15.27:0/2443204888 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f074c096620 con 0x7f0754107330 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.524+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f07541025e0 con 0x7f0754107330 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.525+0000 7f074be00640 1 -- 172.21.15.27:0/2443204888 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f074c01f020 con 0x7f0754107330 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07380a1190 msgr2=0x7f07380a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07380a1190 0x7f07380a3650 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0744005d00 tx=0x7f074400b410 comp rx=0 tx=0).stop 2024-09-13T18:02:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754107330 msgr2=0x7f075419cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754107330 0x7f075419cee0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f074c00eaa0 tx=0x7f074c00ef60 comp rx=0 tx=0).stop 2024-09-13T18:02:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 shutdown_connections 2024-09-13T18:02:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f07380a1190 0x7f07380a3650 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0754107330 0x7f075419cee0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0754102bb0 0x7f0754198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 --2- 172.21.15.27:0/2443204888 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0754102200 0x7f07541985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 >> 172.21.15.27:0/2443204888 conn(0x7f07540fdc40 msgr2=0x7f07540ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 shutdown_connections 2024-09-13T18:02:59.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:58.527+0000 7f075a000640 1 -- 172.21.15.27:0/2443204888 wait complete. 2024-09-13T18:02:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.131+0000 7f32e7c00640 1 -- 172.21.15.27:0/4289518216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e0110c40 msgr2=0x7f32e0113030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.131+0000 7f32e7c00640 1 --2- 172.21.15.27:0/4289518216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e0110c40 0x7f32e0113030 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009be0 tx=0x7f32d802a6c0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.131+0000 7f32e7c00640 1 -- 172.21.15.27:0/4289518216 shutdown_connections 2024-09-13T18:02:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.131+0000 7f32e7c00640 1 --2- 172.21.15.27:0/4289518216 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e0110c40 0x7f32e0113030 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.131+0000 7f32e7c00640 1 --2- 172.21.15.27:0/4289518216 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32e0075300 0x7f32e0110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.131+0000 7f32e7c00640 1 --2- 172.21.15.27:0/4289518216 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32e00749e0 0x7f32e0074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.131+0000 7f32e7c00640 1 -- 172.21.15.27:0/4289518216 >> 172.21.15.27:0/4289518216 conn(0x7f32e00fdc40 msgr2=0x7f32e0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:59.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.131+0000 7f32e7c00640 1 -- 172.21.15.27:0/4289518216 shutdown_connections 2024-09-13T18:02:59.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.131+0000 7f32e7c00640 1 -- 172.21.15.27:0/4289518216 wait complete. 2024-09-13T18:02:59.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.132+0000 7f32e7c00640 1 Processor -- start 2024-09-13T18:02:59.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.132+0000 7f32e7c00640 1 -- start start 2024-09-13T18:02:59.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e7c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e00749e0 0x7f32e01a26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:59.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e7c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32e0075300 0x7f32e01a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:59.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e7c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32e0110c40 0x7f32e019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:59.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e7c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e019ce90 con 0x7f32e00749e0 2024-09-13T18:02:59.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e7c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e019d000 con 0x7f32e0075300 2024-09-13T18:02:59.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e7c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e019d1c0 con 0x7f32e0110c40 2024-09-13T18:02:59.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e5200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e00749e0 0x7f32e01a26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:59.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e5200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e00749e0 0x7f32e01a26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:46646/0 (socket says 172.21.15.27:46646) 2024-09-13T18:02:59.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e5200640 1 -- 172.21.15.27:0/3424979295 learned_addr learned my addr 172.21.15.27:0/3424979295 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:02:59.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e5c00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32e0110c40 0x7f32e019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32dfe00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32e0075300 0x7f32e01a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e5200640 1 -- 172.21.15.27:0/3424979295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32e0110c40 msgr2=0x7f32e019c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e5200640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32e0110c40 0x7f32e019c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.133+0000 7f32e5200640 1 -- 172.21.15.27:0/3424979295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32e0075300 msgr2=0x7f32e01a2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.134+0000 7f32e5200640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32e0075300 0x7f32e01a2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.134+0000 7f32e5200640 1 -- 172.21.15.27:0/3424979295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d4009490 con 0x7f32e00749e0 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.134+0000 7f32dfe00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32e0075300 0x7f32e01a2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.134+0000 7f32e5200640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e00749e0 0x7f32e01a26c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32d400ea60 tx=0x7f32d400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.134+0000 7f32dd600640 1 -- 172.21.15.27:0/3424979295 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400cd20 con 0x7f32e00749e0 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.134+0000 7f32dd600640 1 -- 172.21.15.27:0/3424979295 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f32d400ce80 con 0x7f32e00749e0 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.134+0000 7f32dd600640 1 -- 172.21.15.27:0/3424979295 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4010690 con 0x7f32e00749e0 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.134+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d8009840 con 0x7f32e00749e0 2024-09-13T18:02:59.571 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.134+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e01a9520 con 0x7f32e00749e0 2024-09-13T18:02:59.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.135+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e0076120 con 0x7f32e00749e0 2024-09-13T18:02:59.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.137+0000 7f32dd600640 1 -- 172.21.15.27:0/3424979295 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f32d4003810 con 0x7f32e00749e0 2024-09-13T18:02:59.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.138+0000 7f32dd600640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f32c80a1190 0x7f32c80a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:02:59.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.139+0000 7f32dd600640 1 -- 172.21.15.27:0/3424979295 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f32d4014070 con 0x7f32e00749e0 2024-09-13T18:02:59.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.139+0000 7f32dfe00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f32c80a1190 0x7f32c80a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:02:59.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.139+0000 7f32dfe00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f32c80a1190 0x7f32c80a3650 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f32e019df50 tx=0x7f32cc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:02:59.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.143+0000 7f32dd600640 1 -- 172.21.15.27:0/3424979295 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f32d4096490 con 0x7f32e00749e0 2024-09-13T18:02:59.572 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.325+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f32e0074dc0 con 0x7f32e00749e0 2024-09-13T18:02:59.572 INFO:teuthology.orchestra.run.smithi027.stdout:347892351003 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.326+0000 7f32dd600640 1 -- 172.21.15.27:0/3424979295 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f32d4099ab0 con 0x7f32e00749e0 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f32c80a1190 msgr2=0x7f32c80a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f32c80a1190 0x7f32c80a3650 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f32e019df50 tx=0x7f32cc009260 comp rx=0 tx=0).stop 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e00749e0 msgr2=0x7f32e01a26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e00749e0 0x7f32e01a26c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f32d400ea60 tx=0x7f32d400ee60 comp rx=0 tx=0).stop 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 shutdown_connections 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f32c80a1190 0x7f32c80a3650 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f32e0110c40 0x7f32e019c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f32e0075300 0x7f32e01a2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 --2- 172.21.15.27:0/3424979295 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f32e00749e0 0x7f32e01a26c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:02:59.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 >> 172.21.15.27:0/3424979295 conn(0x7f32e00fdc40 msgr2=0x7f32e0112a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:02:59.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 shutdown_connections 2024-09-13T18:02:59.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:02:59.328+0000 7f32e7c00640 1 -- 172.21.15.27:0/3424979295 wait complete. 2024-09-13T18:02:59.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:59 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2443204888' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T18:02:59.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:02:59 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3424979295' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T18:02:59.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:59 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2443204888' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T18:02:59.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:02:59 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3424979295' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T18:02:59.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:59 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2443204888' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-13T18:02:59.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:02:59 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3424979295' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-13T18:03:00.043 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738441 got 34359738447 for osd.0 2024-09-13T18:03:00.044 DEBUG:teuthology.parallel:result is None 2024-09-13T18:03:00.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:00 smithi027 ceph-mon[30611]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:03:00.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:00 smithi122 ceph-mon[35310]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:03:00.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:00 smithi143 ceph-mon[38210]: pgmap v330: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:03:00.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.917+0000 7fa266800640 1 -- 172.21.15.27:0/168854808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2601009b0 msgr2=0x7fa260104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:00.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.917+0000 7fa266800640 1 --2- 172.21.15.27:0/168854808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2601009b0 0x7fa260104a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa248009930 tx=0x7fa24802a420 comp rx=0 tx=0).stop 2024-09-13T18:03:00.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.917+0000 7fa266800640 1 -- 172.21.15.27:0/168854808 shutdown_connections 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.917+0000 7fa266800640 1 --2- 172.21.15.27:0/168854808 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260105130 0x7fa26010ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.917+0000 7fa266800640 1 --2- 172.21.15.27:0/168854808 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2601009b0 0x7fa260104a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.917+0000 7fa266800640 1 --2- 172.21.15.27:0/168854808 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa260100000 0x7fa2601003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.917+0000 7fa266800640 1 -- 172.21.15.27:0/168854808 >> 172.21.15.27:0/168854808 conn(0x7fa2600fbaa0 msgr2=0x7fa2600fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.917+0000 7fa266800640 1 -- 172.21.15.27:0/168854808 shutdown_connections 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.917+0000 7fa266800640 1 -- 172.21.15.27:0/168854808 wait complete. 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.918+0000 7fa266800640 1 Processor -- start 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa266800640 1 -- start start 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa266800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260100000 0x7fa260198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa266800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2601009b0 0x7fa260198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa266800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa260105130 0x7fa26019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:00.944 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa266800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26019d540 con 0x7fa2601009b0 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa266800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26019d6b0 con 0x7fa260105130 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa266800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26019d820 con 0x7fa260100000 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa257e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2601009b0 0x7fa260198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa25fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa260105130 0x7fa26019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa25f400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260100000 0x7fa260198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa25f400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260100000 0x7fa260198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:55212/0 (socket says 172.21.15.27:55212) 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa25fe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa260105130 0x7fa26019cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:33852/0 (socket says 172.21.15.27:33852) 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.919+0000 7fa25f400640 1 -- 172.21.15.27:0/3870995141 learned_addr learned my addr 172.21.15.27:0/3870995141 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa25fe00640 1 -- 172.21.15.27:0/3870995141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260100000 msgr2=0x7fa260198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa25fe00640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260100000 0x7fa260198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa25fe00640 1 -- 172.21.15.27:0/3870995141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2601009b0 msgr2=0x7fa260198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa25fe00640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2601009b0 0x7fa260198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa25fe00640 1 -- 172.21.15.27:0/3870995141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250009490 con 0x7fa260105130 2024-09-13T18:03:00.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa25fe00640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa260105130 0x7fa26019cf40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa258009fd0 tx=0x7fa25800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa25cc00640 1 -- 172.21.15.27:0/3870995141 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800ce20 con 0x7fa260105130 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa25cc00640 1 -- 172.21.15.27:0/3870995141 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa258005020 con 0x7fa260105130 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa25cc00640 1 -- 172.21.15.27:0/3870995141 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258010690 con 0x7fa260105130 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.920+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248009560 con 0x7fa260105130 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.921+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2601a51f0 con 0x7fa260105130 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.922+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2601014e0 con 0x7fa260105130 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.924+0000 7fa25cc00640 1 -- 172.21.15.27:0/3870995141 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa258005500 con 0x7fa260105130 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.925+0000 7fa25cc00640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2440a1110 0x7fa2440a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.925+0000 7fa25cc00640 1 -- 172.21.15.27:0/3870995141 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa258014070 con 0x7fa260105130 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.925+0000 7fa25f400640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2440a1110 0x7fa2440a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.926+0000 7fa25f400640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2440a1110 0x7fa2440a35d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa250009e60 tx=0x7fa250005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:00.946 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.927+0000 7fa25cc00640 1 -- 172.21.15.27:0/3870995141 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa258096740 con 0x7fa260105130 2024-09-13T18:03:01.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.109+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa2601003e0 con 0x7fa260105130 2024-09-13T18:03:01.113 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.110+0000 7fa25cc00640 1 -- 172.21.15.27:0/3870995141 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa258005190 con 0x7fa260105130 2024-09-13T18:03:01.113 INFO:teuthology.orchestra.run.smithi027.stdout:55834574925 2024-09-13T18:03:01.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2440a1110 msgr2=0x7fa2440a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:01.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2440a1110 0x7fa2440a35d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa250009e60 tx=0x7fa250005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:01.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa260105130 msgr2=0x7fa26019cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:01.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa260105130 0x7fa26019cf40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa258009fd0 tx=0x7fa25800ef10 comp rx=0 tx=0).stop 2024-09-13T18:03:01.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 shutdown_connections 2024-09-13T18:03:01.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2440a1110 0x7fa2440a35d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa260105130 0x7fa26019cf40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa2601009b0 0x7fa260198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 --2- 172.21.15.27:0/3870995141 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa260100000 0x7fa260198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 >> 172.21.15.27:0/3870995141 conn(0x7fa2600fbaa0 msgr2=0x7fa2600fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:01.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 shutdown_connections 2024-09-13T18:03:01.116 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.112+0000 7fa266800640 1 -- 172.21.15.27:0/3870995141 wait complete. 2024-09-13T18:03:01.287 INFO:tasks.cephadm.ceph_manager.ceph:need seq 347892350998 got 347892351003 for osd.11 2024-09-13T18:03:01.287 DEBUG:teuthology.parallel:result is None 2024-09-13T18:03:01.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:01 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2759770528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T18:03:01.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:01 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3870995141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T18:03:01.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:01 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2759770528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T18:03:01.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:01 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3870995141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T18:03:01.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:01 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2759770528' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T18:03:01.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:01 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3870995141' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T18:03:01.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.884+0000 7f2078c00640 1 -- 172.21.15.27:0/2928695316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2074108c80 msgr2=0x7f207410b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:01.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.884+0000 7f2078c00640 1 --2- 172.21.15.27:0/2928695316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2074108c80 0x7f207410b070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f206c009ca0 tx=0x7f206c02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.884+0000 7f2078c00640 1 -- 172.21.15.27:0/2928695316 shutdown_connections 2024-09-13T18:03:01.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.884+0000 7f2078c00640 1 --2- 172.21.15.27:0/2928695316 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2074108c80 0x7f207410b070 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.884+0000 7f2078c00640 1 --2- 172.21.15.27:0/2928695316 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f20740fe900 0x7f2074102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.884+0000 7f2078c00640 1 --2- 172.21.15.27:0/2928695316 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20740671b0 0x7f20741029e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.884+0000 7f2078c00640 1 -- 172.21.15.27:0/2928695316 >> 172.21.15.27:0/2928695316 conn(0x7f20740f9b00 msgr2=0x7f20740fbf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:01.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.884+0000 7f2078c00640 1 -- 172.21.15.27:0/2928695316 shutdown_connections 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.884+0000 7f2078c00640 1 -- 172.21.15.27:0/2928695316 wait complete. 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.885+0000 7f2078c00640 1 Processor -- start 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.885+0000 7f2078c00640 1 -- start start 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.885+0000 7f2078c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20740671b0 0x7f2074198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.885+0000 7f2078c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20740fe900 0x7f2074199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.885+0000 7f2078c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2074108c80 0x7f2074107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.885+0000 7f2078c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2074107ec0 con 0x7f20740671b0 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.885+0000 7f2078c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2074108030 con 0x7f2074108c80 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.885+0000 7f2078c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20741081f0 con 0x7f20740fe900 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20740671b0 0x7f2074198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20740671b0 0x7f2074198c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50768/0 (socket says 172.21.15.27:50768) 2024-09-13T18:03:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073400640 1 -- 172.21.15.27:0/2794330272 learned_addr learned my addr 172.21.15.27:0/2794330272 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f206aa00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20740fe900 0x7f2074199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073e00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2074108c80 0x7f2074107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073400640 1 -- 172.21.15.27:0/2794330272 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20740fe900 msgr2=0x7f2074199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073400640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20740fe900 0x7f2074199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073400640 1 -- 172.21.15.27:0/2794330272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2074108c80 msgr2=0x7f2074107730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073400640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2074108c80 0x7f2074107730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073400640 1 -- 172.21.15.27:0/2794330272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c009900 con 0x7f20740671b0 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f206aa00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20740fe900 0x7f2074199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.886+0000 7f2073400640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20740671b0 0x7f2074198c00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f206400d950 tx=0x7f206400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.887+0000 7f2070c00640 1 -- 172.21.15.27:0/2794330272 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064009a30 con 0x7f20740671b0 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.887+0000 7f2070c00640 1 -- 172.21.15.27:0/2794330272 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2064009b90 con 0x7f20740671b0 2024-09-13T18:03:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.887+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20741a8f90 con 0x7f20740671b0 2024-09-13T18:03:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.887+0000 7f2070c00640 1 -- 172.21.15.27:0/2794330272 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064004a00 con 0x7f20740671b0 2024-09-13T18:03:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.887+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20741a92f0 con 0x7f20740671b0 2024-09-13T18:03:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.888+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20740ff4c0 con 0x7f20740671b0 2024-09-13T18:03:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.890+0000 7f2070c00640 1 -- 172.21.15.27:0/2794330272 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2064009d00 con 0x7f20740671b0 2024-09-13T18:03:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.891+0000 7f2070c00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f20580a1100 0x7f20580a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.891+0000 7f2070c00640 1 -- 172.21.15.27:0/2794330272 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f20640cc560 con 0x7f20740671b0 2024-09-13T18:03:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.892+0000 7f206aa00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f20580a1100 0x7f20580a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.892+0000 7f206aa00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f20580a1100 0x7f20580a35c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f205c005fd0 tx=0x7f205c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:01.895+0000 7f2070c00640 1 -- 172.21.15.27:0/2794330272 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f2064095b40 con 0x7f20740671b0 2024-09-13T18:03:02.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.081+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f20741029e0 con 0x7f20740671b0 2024-09-13T18:03:02.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.081+0000 7f2070c00640 1 -- 172.21.15.27:0/2794330272 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2064099160 con 0x7f20740671b0 2024-09-13T18:03:02.083 INFO:teuthology.orchestra.run.smithi027.stdout:167503724602 2024-09-13T18:03:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.083+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f20580a1100 msgr2=0x7f20580a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.083+0000 7f2078c00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f20580a1100 0x7f20580a35c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f205c005fd0 tx=0x7f205c005850 comp rx=0 tx=0).stop 2024-09-13T18:03:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.083+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20740671b0 msgr2=0x7f2074198c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.083+0000 7f2078c00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20740671b0 0x7f2074198c00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f206400d950 tx=0x7f206400de10 comp rx=0 tx=0).stop 2024-09-13T18:03:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.084+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 shutdown_connections 2024-09-13T18:03:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.084+0000 7f2078c00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f20580a1100 0x7f20580a35c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.084+0000 7f2078c00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2074108c80 0x7f2074107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.084+0000 7f2078c00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f20740fe900 0x7f2074199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.086 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.084+0000 7f2078c00640 1 --2- 172.21.15.27:0/2794330272 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f20740671b0 0x7f2074198c00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.084+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 >> 172.21.15.27:0/2794330272 conn(0x7f20740f9b00 msgr2=0x7f207410c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:02.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.084+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 shutdown_connections 2024-09-13T18:03:02.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.084+0000 7f2078c00640 1 -- 172.21.15.27:0/2794330272 wait complete. 2024-09-13T18:03:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.121+0000 7f6886c00640 1 -- 172.21.15.27:0/303307037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 msgr2=0x7f6880100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.121+0000 7f6886c00640 1 --2- 172.21.15.27:0/303307037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 0x7f6880100200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6874009890 tx=0x7f687402a370 comp rx=0 tx=0).stop 2024-09-13T18:03:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.121+0000 7f6886c00640 1 -- 172.21.15.27:0/303307037 shutdown_connections 2024-09-13T18:03:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.121+0000 7f6886c00640 1 --2- 172.21.15.27:0/303307037 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6880104f50 0x7f688010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.121+0000 7f6886c00640 1 --2- 172.21.15.27:0/303307037 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68801007d0 0x7f6880104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.121+0000 7f6886c00640 1 --2- 172.21.15.27:0/303307037 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 0x7f6880100200 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.121+0000 7f6886c00640 1 -- 172.21.15.27:0/303307037 >> 172.21.15.27:0/303307037 conn(0x7f68800fb900 msgr2=0x7f68800fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.121+0000 7f6886c00640 1 -- 172.21.15.27:0/303307037 shutdown_connections 2024-09-13T18:03:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.121+0000 7f6886c00640 1 -- 172.21.15.27:0/303307037 wait complete. 2024-09-13T18:03:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.122+0000 7f6886c00640 1 Processor -- start 2024-09-13T18:03:02.124 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.122+0000 7f6886c00640 1 -- start start 2024-09-13T18:03:02.125 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6886c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 0x7f6880198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6886c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68801007d0 0x7f6880198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6886c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6880104f50 0x7f688019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6886c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688019d370 con 0x7f6880104f50 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6886c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688019d4e0 con 0x7f68800ffe20 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6886c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688019d650 con 0x7f68801007d0 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6885800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 0x7f6880198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6885800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 0x7f6880198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:33902/0 (socket says 172.21.15.27:33902) 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6885800640 1 -- 172.21.15.27:0/3470243309 learned_addr learned my addr 172.21.15.27:0/3470243309 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.123+0000 7f6884e00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68801007d0 0x7f6880198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:02.126 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.124+0000 7f6886200640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6880104f50 0x7f688019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:02.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.124+0000 7f6885800640 1 -- 172.21.15.27:0/3470243309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68801007d0 msgr2=0x7f6880198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.124+0000 7f6885800640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68801007d0 0x7f6880198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.124+0000 7f6885800640 1 -- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6880104f50 msgr2=0x7f688019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.124+0000 7f6885800640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6880104f50 0x7f688019cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.124+0000 7f6885800640 1 -- 172.21.15.27:0/3470243309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c009560 con 0x7f68800ffe20 2024-09-13T18:03:02.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.124+0000 7f6886200640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6880104f50 0x7f688019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:02.127 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.124+0000 7f6884e00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68801007d0 0x7f6880198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:02.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.124+0000 7f6885800640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 0x7f6880198430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6874000c00 tx=0x7f6874033cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:02.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.125+0000 7f687e000640 1 -- 172.21.15.27:0/3470243309 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874030a20 con 0x7f68800ffe20 2024-09-13T18:03:02.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.125+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6878009840 con 0x7f68800ffe20 2024-09-13T18:03:02.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.125+0000 7f687e000640 1 -- 172.21.15.27:0/3470243309 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6874030460 con 0x7f68800ffe20 2024-09-13T18:03:02.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.125+0000 7f687e000640 1 -- 172.21.15.27:0/3470243309 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687403b3f0 con 0x7f68800ffe20 2024-09-13T18:03:02.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.125+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6874009490 con 0x7f68800ffe20 2024-09-13T18:03:02.128 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.126+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6880101300 con 0x7f68800ffe20 2024-09-13T18:03:02.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.128+0000 7f687e000640 1 -- 172.21.15.27:0/3470243309 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6874039040 con 0x7f68800ffe20 2024-09-13T18:03:02.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.129+0000 7f687e000640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68680a1180 0x7f68680a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:02.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.130+0000 7f687e000640 1 -- 172.21.15.27:0/3470243309 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f68740ecdf0 con 0x7f68800ffe20 2024-09-13T18:03:02.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.130+0000 7f6884e00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68680a1180 0x7f68680a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:02.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.130+0000 7f6884e00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68680a1180 0x7f68680a3640 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f68801999e0 tx=0x7f686c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:02.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.132+0000 7f687e000640 1 -- 172.21.15.27:0/3470243309 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f68740b6560 con 0x7f68800ffe20 2024-09-13T18:03:02.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.364+0000 7f0076000640 1 -- 172.21.15.27:0/888096418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0070102010 msgr2=0x7f00701023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.364+0000 7f0076000640 1 --2- 172.21.15.27:0/888096418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0070102010 0x7f00701023f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0064009930 tx=0x7f006402a420 comp rx=0 tx=0).stop 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.364+0000 7f0076000640 1 -- 172.21.15.27:0/888096418 shutdown_connections 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.364+0000 7f0076000640 1 --2- 172.21.15.27:0/888096418 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0070107140 0x7f007010ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.364+0000 7f0076000640 1 --2- 172.21.15.27:0/888096418 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00701029c0 0x7f0070106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.364+0000 7f0076000640 1 --2- 172.21.15.27:0/888096418 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0070102010 0x7f00701023f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.364+0000 7f0076000640 1 -- 172.21.15.27:0/888096418 >> 172.21.15.27:0/888096418 conn(0x7f00700fda70 msgr2=0x7f00700ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.364+0000 7f0076000640 1 -- 172.21.15.27:0/888096418 shutdown_connections 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.364+0000 7f0076000640 1 -- 172.21.15.27:0/888096418 wait complete. 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.365+0000 7f0076000640 1 Processor -- start 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0076000640 1 -- start start 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0076000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0070102010 0x7f0070198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0076000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00701029c0 0x7f00701988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:02.220 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0076000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0070107140 0x7f007019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0076000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007019d2d0 con 0x7f0070107140 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0076000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007019d440 con 0x7f0070102010 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0076000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007019d5b0 con 0x7f00701029c0 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0074c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0070102010 0x7f0070198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0074c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0070102010 0x7f0070198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:33836/0 (socket says 172.21.15.27:33836) 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0074c00640 1 -- 172.21.15.27:0/2759770528 learned_addr learned my addr 172.21.15.27:0/2759770528 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f0075600640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0070107140 0x7f007019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.366+0000 7f006fe00640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00701029c0 0x7f00701988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.367+0000 7f0074c00640 1 -- 172.21.15.27:0/2759770528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00701029c0 msgr2=0x7f00701988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.367+0000 7f0074c00640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00701029c0 0x7f00701988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.367+0000 7f0074c00640 1 -- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0070107140 msgr2=0x7f007019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.367+0000 7f0074c00640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0070107140 0x7f007019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.367+0000 7f0074c00640 1 -- 172.21.15.27:0/2759770528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0064009560 con 0x7f0070102010 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.367+0000 7f0074c00640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0070102010 0x7f0070198390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0064005ab0 tx=0x7f0064005620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.367+0000 7f006d600640 1 -- 172.21.15.27:0/2759770528 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064004b50 con 0x7f0070102010 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.367+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007019d830 con 0x7f0070102010 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.367+0000 7f006d600640 1 -- 172.21.15.27:0/2759770528 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0064004cb0 con 0x7f0070102010 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.368+0000 7f006d600640 1 -- 172.21.15.27:0/2759770528 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064031a40 con 0x7f0070102010 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.368+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00701a4f80 con 0x7f0070102010 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.369+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00701034f0 con 0x7f0070102010 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.371+0000 7f006d600640 1 -- 172.21.15.27:0/2759770528 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0064003c60 con 0x7f0070102010 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.372+0000 7f006d600640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f00580a1100 0x7f00580a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.372+0000 7f006d600640 1 -- 172.21.15.27:0/2759770528 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f00640ed860 con 0x7f0070102010 2024-09-13T18:03:02.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.372+0000 7f006fe00640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f00580a1100 0x7f00580a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:02.223 INFO:teuthology.orchestra.run.smithi027.stdout:111669149763 2024-09-13T18:03:02.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.373+0000 7f006fe00640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f00580a1100 0x7f00580a35c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0070199940 tx=0x7f005c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:02.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.385+0000 7f006d600640 1 -- 172.21.15.27:0/2759770528 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f00640b6ef0 con 0x7f0070102010 2024-09-13T18:03:02.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.567+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f007010a3b0 con 0x7f0070102010 2024-09-13T18:03:02.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.567+0000 7f006d600640 1 -- 172.21.15.27:0/2759770528 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0064040020 con 0x7f0070102010 2024-09-13T18:03:02.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f00580a1100 msgr2=0x7f00580a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f00580a1100 0x7f00580a35c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0070199940 tx=0x7f005c00b390 comp rx=0 tx=0).stop 2024-09-13T18:03:02.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0070102010 msgr2=0x7f0070198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0070102010 0x7f0070198390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0064005ab0 tx=0x7f0064005620 comp rx=0 tx=0).stop 2024-09-13T18:03:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 shutdown_connections 2024-09-13T18:03:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f00580a1100 0x7f00580a35c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0070107140 0x7f007019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00701029c0 0x7f00701988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 --2- 172.21.15.27:0/2759770528 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0070102010 0x7f0070198390 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 >> 172.21.15.27:0/2759770528 conn(0x7f00700fda70 msgr2=0x7f00700fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 shutdown_connections 2024-09-13T18:03:02.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:00.570+0000 7f0076000640 1 -- 172.21.15.27:0/2759770528 wait complete. 2024-09-13T18:03:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.316+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6880100200 con 0x7f68800ffe20 2024-09-13T18:03:02.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.317+0000 7f687e000640 1 -- 172.21.15.27:0/3470243309 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6874037090 con 0x7f68800ffe20 2024-09-13T18:03:02.319 INFO:teuthology.orchestra.run.smithi027.stdout:77309411401 2024-09-13T18:03:02.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68680a1180 msgr2=0x7f68680a3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68680a1180 0x7f68680a3640 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f68801999e0 tx=0x7f686c009260 comp rx=0 tx=0).stop 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 msgr2=0x7f6880198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 0x7f6880198430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6874000c00 tx=0x7f6874033cd0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 shutdown_connections 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f68680a1180 0x7f68680a3640 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f6880104f50 0x7f688019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f68801007d0 0x7f6880198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 --2- 172.21.15.27:0/3470243309 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f68800ffe20 0x7f6880198430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 >> 172.21.15.27:0/3470243309 conn(0x7f68800fb900 msgr2=0x7f68800fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 shutdown_connections 2024-09-13T18:03:02.322 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:02.319+0000 7f6886c00640 1 -- 172.21.15.27:0/3470243309 wait complete. 2024-09-13T18:03:02.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:02 smithi027 ceph-mon[30611]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:03:02.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:02 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2794330272' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T18:03:02.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:02 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3470243309' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T18:03:02.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:02 smithi122 ceph-mon[35310]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:03:02.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:02 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2794330272' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T18:03:02.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:02 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3470243309' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T18:03:02.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:02 smithi143 ceph-mon[38210]: pgmap v331: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:03:02.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:02 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2794330272' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T18:03:02.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:02 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3470243309' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T18:03:03.043 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149756 got 111669149763 for osd.3 2024-09-13T18:03:03.043 DEBUG:teuthology.parallel:result is None 2024-09-13T18:03:03.564 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776158 got 292057776164 for osd.9 2024-09-13T18:03:03.565 DEBUG:teuthology.parallel:result is None 2024-09-13T18:03:04.662 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:04 smithi027 ceph-mon[30611]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:03:04.694 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574919 got 55834574925 for osd.1 2024-09-13T18:03:04.694 DEBUG:teuthology.parallel:result is None 2024-09-13T18:03:04.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:04 smithi122 ceph-mon[35310]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:03:04.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:04 smithi143 ceph-mon[38210]: pgmap v332: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:03:05.417 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411395 got 77309411401 for osd.2 2024-09-13T18:03:05.418 DEBUG:teuthology.parallel:result is None 2024-09-13T18:03:06.008 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724596 got 167503724602 for osd.5 2024-09-13T18:03:06.008 DEBUG:teuthology.parallel:result is None 2024-09-13T18:03:06.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:06 smithi027 ceph-mon[30611]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:03:06.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:06 smithi143 ceph-mon[38210]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:03:06.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:06 smithi122 ceph-mon[35310]: pgmap v333: 97 pgs: 97 active+clean; 641 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:03:07.529 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.527+0000 7f3325e00640 1 -- 172.21.15.27:0/1383290153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320110a50 msgr2=0x7f3320112e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.527+0000 7f3325e00640 1 --2- 172.21.15.27:0/1383290153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320110a50 0x7f3320112e40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3318009ca0 tx=0x7f331802a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.527+0000 7f3325e00640 1 -- 172.21.15.27:0/1383290153 shutdown_connections 2024-09-13T18:03:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.527+0000 7f3325e00640 1 --2- 172.21.15.27:0/1383290153 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320110a50 0x7f3320112e40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.527+0000 7f3325e00640 1 --2- 172.21.15.27:0/1383290153 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3320075300 0x7f3320110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.527+0000 7f3325e00640 1 --2- 172.21.15.27:0/1383290153 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33200749e0 0x7f3320074dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.527+0000 7f3325e00640 1 -- 172.21.15.27:0/1383290153 >> 172.21.15.27:0/1383290153 conn(0x7f33200fda70 msgr2=0x7f33200ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.528+0000 7f3325e00640 1 -- 172.21.15.27:0/1383290153 shutdown_connections 2024-09-13T18:03:07.530 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.528+0000 7f3325e00640 1 -- 172.21.15.27:0/1383290153 wait complete. 2024-09-13T18:03:07.531 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.529+0000 7f3325e00640 1 Processor -- start 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.529+0000 7f3325e00640 1 -- start start 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.529+0000 7f3325e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33200749e0 0x7f33201a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.529+0000 7f3325e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320075300 0x7f33201a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.529+0000 7f3325e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3320110a50 0x7f332019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.529+0000 7f3325e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332019cce0 con 0x7f3320075300 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.529+0000 7f3325e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332019ce50 con 0x7f33200749e0 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.529+0000 7f3325e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f332019d010 con 0x7f3320110a50 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f331fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320075300 0x7f33201a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f331fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320075300 0x7f33201a2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:50792/0 (socket says 172.21.15.27:50792) 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f331fe00640 1 -- 172.21.15.27:0/2483915878 learned_addr learned my addr 172.21.15.27:0/2483915878 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:07.532 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f3324a00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33200749e0 0x7f33201a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f3325400640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3320110a50 0x7f332019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f3324a00640 1 -- 172.21.15.27:0/2483915878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3320110a50 msgr2=0x7f332019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f3324a00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3320110a50 0x7f332019c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f3324a00640 1 -- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320075300 msgr2=0x7f33201a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f3324a00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320075300 0x7f33201a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f3324a00640 1 -- 172.21.15.27:0/2483915878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3318009900 con 0x7f33200749e0 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f3325400640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3320110a50 0x7f332019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.530+0000 7f331fe00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320075300 0x7f33201a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.531+0000 7f3324a00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33200749e0 0x7f33201a24f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3314005fd0 tx=0x7f331400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.531+0000 7f331d600640 1 -- 172.21.15.27:0/2483915878 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314009c30 con 0x7f33200749e0 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.531+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f332019d2f0 con 0x7f33200749e0 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.531+0000 7f331d600640 1 -- 172.21.15.27:0/2483915878 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3314004510 con 0x7f33200749e0 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.531+0000 7f331d600640 1 -- 172.21.15.27:0/2483915878 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3314003e60 con 0x7f33200749e0 2024-09-13T18:03:07.534 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.531+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33201a94e0 con 0x7f33200749e0 2024-09-13T18:03:07.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.533+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3320076120 con 0x7f33200749e0 2024-09-13T18:03:07.536 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.534+0000 7f331d600640 1 -- 172.21.15.27:0/2483915878 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3314004030 con 0x7f33200749e0 2024-09-13T18:03:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.535+0000 7f331d600640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33080a10f0 0x7f33080a35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.536+0000 7f331d600640 1 -- 172.21.15.27:0/2483915878 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f33140cc400 con 0x7f33200749e0 2024-09-13T18:03:07.537 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.536+0000 7f331fe00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33080a10f0 0x7f33080a35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:07.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.536+0000 7f331fe00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33080a10f0 0x7f33080a35b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33200774c0 tx=0x7f330c00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:07.541 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.539+0000 7f331d600640 1 -- 172.21.15.27:0/2483915878 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3314095b40 con 0x7f33200749e0 2024-09-13T18:03:07.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.735+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f332019daf0 con 0x7f33200749e0 2024-09-13T18:03:07.738 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:07 smithi027 ceph-mon[30611]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-13T18:03:07.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.736+0000 7f331d600640 1 -- 172.21.15.27:0/2483915878 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3314099160 con 0x7f33200749e0 2024-09-13T18:03:07.738 INFO:teuthology.orchestra.run.smithi027.stdout:201863462965 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.738+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33080a10f0 msgr2=0x7f33080a35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.738+0000 7f3325e00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33080a10f0 0x7f33080a35b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f33200774c0 tx=0x7f330c00b480 comp rx=0 tx=0).stop 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.738+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33200749e0 msgr2=0x7f33201a24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.738+0000 7f3325e00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33200749e0 0x7f33201a24f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3314005fd0 tx=0x7f331400dde0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.739+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 shutdown_connections 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.739+0000 7f3325e00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f33080a10f0 0x7f33080a35b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.739+0000 7f3325e00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3320110a50 0x7f332019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.739+0000 7f3325e00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3320075300 0x7f33201a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.739+0000 7f3325e00640 1 --2- 172.21.15.27:0/2483915878 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f33200749e0 0x7f33201a24f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:07.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.739+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 >> 172.21.15.27:0/2483915878 conn(0x7f33200fda70 msgr2=0x7f33200ffe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:07.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.739+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 shutdown_connections 2024-09-13T18:03:07.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:07.739+0000 7f3325e00640 1 -- 172.21.15.27:0/2483915878 wait complete. 2024-09-13T18:03:07.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:07 smithi143 ceph-mon[38210]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-13T18:03:07.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:07 smithi122 ceph-mon[35310]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-13T18:03:08.514 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462959 got 201863462965 for osd.6 2024-09-13T18:03:08.514 DEBUG:teuthology.parallel:result is None 2024-09-13T18:03:08.514 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T18:03:08.515 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T18:03:08.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:08 smithi143 ceph-mon[38210]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T18:03:08.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:08 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2483915878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T18:03:08.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:08 smithi027 ceph-mon[30611]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T18:03:08.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:08 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2483915878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T18:03:08.872 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:08.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:08 smithi122 ceph-mon[35310]: pgmap v334: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T18:03:08.964 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:08 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2483915878' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-13T18:03:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:03:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:03:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:03:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:03:10.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:09 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:03:10.216 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:03:10.216 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:03:10.216 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:03:10.216 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:03:10.216 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:09 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:03:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:03:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:03:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:03:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:03:10.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:09 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:03:10.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.831+0000 7f0b10600640 1 -- 172.21.15.27:0/1948370869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b08102bb0 msgr2=0x7f0b08106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:10.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.831+0000 7f0b10600640 1 --2- 172.21.15.27:0/1948370869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b08102bb0 0x7f0b08106c00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009930 tx=0x7f0af402a420 comp rx=0 tx=0).stop 2024-09-13T18:03:10.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.831+0000 7f0b10600640 1 -- 172.21.15.27:0/1948370869 shutdown_connections 2024-09-13T18:03:10.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.831+0000 7f0b10600640 1 --2- 172.21.15.27:0/1948370869 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08107330 0x7f0b0810eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:10.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.831+0000 7f0b10600640 1 --2- 172.21.15.27:0/1948370869 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b08102bb0 0x7f0b08106c00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:10.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.831+0000 7f0b10600640 1 --2- 172.21.15.27:0/1948370869 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b08102200 0x7f0b081025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:10.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.831+0000 7f0b10600640 1 -- 172.21.15.27:0/1948370869 >> 172.21.15.27:0/1948370869 conn(0x7f0b080fdc60 msgr2=0x7f0b08100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:10.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.831+0000 7f0b10600640 1 -- 172.21.15.27:0/1948370869 shutdown_connections 2024-09-13T18:03:10.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.831+0000 7f0b10600640 1 -- 172.21.15.27:0/1948370869 wait complete. 2024-09-13T18:03:10.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.832+0000 7f0b10600640 1 Processor -- start 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.832+0000 7f0b10600640 1 -- start start 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b10600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b08102200 0x7f0b08198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b10600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b08102bb0 0x7f0b08198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b10600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08107330 0x7f0b0819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b10600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0819d490 con 0x7f0b08102bb0 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b10600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0819d600 con 0x7f0b08102200 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b10600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0819d770 con 0x7f0b08107330 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0d200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b08102bb0 0x7f0b08198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0d200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b08102bb0 0x7f0b08198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48986/0 (socket says 172.21.15.27:48986) 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0dc00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b08102200 0x7f0b08198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:10.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0d200640 1 -- 172.21.15.27:0/962363167 learned_addr learned my addr 172.21.15.27:0/962363167 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0e600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08107330 0x7f0b0819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0dc00640 1 -- 172.21.15.27:0/962363167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08107330 msgr2=0x7f0b0819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0dc00640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08107330 0x7f0b0819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0dc00640 1 -- 172.21.15.27:0/962363167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b08102bb0 msgr2=0x7f0b08198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0dc00640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b08102bb0 0x7f0b08198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0dc00640 1 -- 172.21.15.27:0/962363167 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af4009560 con 0x7f0b08102200 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.833+0000 7f0b0e600640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08107330 0x7f0b0819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.834+0000 7f0b0dc00640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b08102200 0x7f0b08198550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00e9f0 tx=0x7f0afc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.834+0000 7f0b06000640 1 -- 172.21.15.27:0/962363167 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc00ccc0 con 0x7f0b08102200 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.834+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0819da50 con 0x7f0b08102200 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.834+0000 7f0b06000640 1 -- 172.21.15.27:0/962363167 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0afc00ce20 con 0x7f0b08102200 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.834+0000 7f0b06000640 1 -- 172.21.15.27:0/962363167 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0afc018920 con 0x7f0b08102200 2024-09-13T18:03:10.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.834+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b081a5310 con 0x7f0b08102200 2024-09-13T18:03:10.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.835+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b081036e0 con 0x7f0b08102200 2024-09-13T18:03:10.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.837+0000 7f0b06000640 1 -- 172.21.15.27:0/962363167 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0afc018a80 con 0x7f0b08102200 2024-09-13T18:03:10.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.839+0000 7f0b06000640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0af00a1080 0x7f0af00a3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:10.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.839+0000 7f0b06000640 1 -- 172.21.15.27:0/962363167 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0afc014070 con 0x7f0b08102200 2024-09-13T18:03:10.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.839+0000 7f0b0d200640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0af00a1080 0x7f0af00a3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:10.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.839+0000 7f0b0d200640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0af00a1080 0x7f0af00a3540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0b08199b00 tx=0x7f0af40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:10.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:10.840+0000 7f0b06000640 1 -- 172.21.15.27:0/962363167 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0afc0963e0 con 0x7f0b08102200 2024-09-13T18:03:11.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.019+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b081998b0 con 0x7f0af00a1080 2024-09-13T18:03:11.021 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:10 smithi027 ceph-mon[30611]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-13T18:03:11.035 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.033+0000 7f0b06000640 1 -- 172.21.15.27:0/962363167 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344558 (secure 0 0 0) 0x7f0b081998b0 con 0x7f0af00a1080 2024-09-13T18:03:11.041 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:11.043 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-13T18:03:11.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0af00a1080 msgr2=0x7f0af00a3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:11.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0af00a1080 0x7f0af00a3540 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0b08199b00 tx=0x7f0af40058d0 comp rx=0 tx=0).stop 2024-09-13T18:03:11.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b08102200 msgr2=0x7f0b08198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:11.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b08102200 0x7f0b08198550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00e9f0 tx=0x7f0afc00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:03:11.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 shutdown_connections 2024-09-13T18:03:11.046 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0af00a1080 0x7f0af00a3540 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:11.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0b08107330 0x7f0b0819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:11.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0b08102bb0 0x7f0b08198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:11.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 --2- 172.21.15.27:0/962363167 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0b08102200 0x7f0b08198550 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:11.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 >> 172.21.15.27:0/962363167 conn(0x7f0b080fdc60 msgr2=0x7f0b080ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:11.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 shutdown_connections 2024-09-13T18:03:11.047 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:11.037+0000 7f0b10600640 1 -- 172.21.15.27:0/962363167 wait complete. 2024-09-13T18:03:11.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:10 smithi122 ceph-mon[35310]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-13T18:03:11.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:10 smithi143 ceph-mon[38210]: pgmap v335: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-13T18:03:11.779 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-13T18:03:09.389154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656333,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":870,"num_read_kb":574,"num_write":418,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1182530,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":792,"ondisk_log_size":792,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374448,"kb_used_data":13384,"kb_used_omap":18,"kb_used_meta":360941,"kb_avail":1124567376,"statfs":{"total":1151940427776,"available":1151556993024,"internally_reserved":0,"allocated":13705216,"data_stored":7475914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19127,"internal_metadata":369603913},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,13,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":61,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002922"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382583+0000","last_change":"2024-09-13T18:01:46.343413+0000","last_active":"2024-09-13T18:03:05.382583+0000","last_peered":"2024-09-13T18:03:05.382583+0000","last_clean":"2024-09-13T18:03:05.382583+0000","last_became_active":"2024-09-13T18:01:46.343086+0000","last_became_peered":"2024-09-13T18:01:46.343086+0000","last_unstale":"2024-09-13T18:03:05.382583+0000","last_undegraded":"2024-09-13T18:03:05.382583+0000","last_fullsized":"2024-09-13T18:03:05.382583+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:11.345474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164309+0000","last_change":"2024-09-13T18:01:46.338910+0000","last_active":"2024-09-13T18:02:36.164309+0000","last_peered":"2024-09-13T18:02:36.164309+0000","last_clean":"2024-09-13T18:02:36.164309+0000","last_became_active":"2024-09-13T18:01:46.338570+0000","last_became_peered":"2024-09-13T18:01:46.338570+0000","last_unstale":"2024-09-13T18:02:36.164309+0000","last_undegraded":"2024-09-13T18:02:36.164309+0000","last_fullsized":"2024-09-13T18:02:36.164309+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:24.664195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164366+0000","last_change":"2024-09-13T18:01:46.329371+0000","last_active":"2024-09-13T18:02:36.164366+0000","last_peered":"2024-09-13T18:02:36.164366+0000","last_clean":"2024-09-13T18:02:36.164366+0000","last_became_active":"2024-09-13T18:01:46.328778+0000","last_became_peered":"2024-09-13T18:01:46.328778+0000","last_unstale":"2024-09-13T18:02:36.164366+0000","last_undegraded":"2024-09-13T18:02:36.164366+0000","last_fullsized":"2024-09-13T18:02:36.164366+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:02.025318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.370300+0000","last_change":"2024-09-13T18:02:37.172904+0000","last_active":"2024-09-13T18:03:05.370300+0000","last_peered":"2024-09-13T18:03:05.370300+0000","last_clean":"2024-09-13T18:03:05.370300+0000","last_became_active":"2024-09-13T18:02:37.171485+0000","last_became_peered":"2024-09-13T18:02:37.171485+0000","last_unstale":"2024-09-13T18:03:05.370300+0000","last_undegraded":"2024-09-13T18:03:05.370300+0000","last_fullsized":"2024-09-13T18:03:05.370300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:52.473746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.388441+0000","last_change":"2024-09-13T18:01:46.357813+0000","last_active":"2024-09-13T18:03:05.388441+0000","last_peered":"2024-09-13T18:03:05.388441+0000","last_clean":"2024-09-13T18:03:05.388441+0000","last_became_active":"2024-09-13T18:01:46.357039+0000","last_became_peered":"2024-09-13T18:01:46.357039+0000","last_unstale":"2024-09-13T18:03:05.388441+0000","last_undegraded":"2024-09-13T18:03:05.388441+0000","last_fullsized":"2024-09-13T18:03:05.388441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:18.772049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.373679+0000","last_change":"2024-09-13T18:01:46.348881+0000","last_active":"2024-09-13T18:03:05.373679+0000","last_peered":"2024-09-13T18:03:05.373679+0000","last_clean":"2024-09-13T18:03:05.373679+0000","last_became_active":"2024-09-13T18:01:46.348576+0000","last_became_peered":"2024-09-13T18:01:46.348576+0000","last_unstale":"2024-09-13T18:03:05.373679+0000","last_undegraded":"2024-09-13T18:03:05.373679+0000","last_fullsized":"2024-09-13T18:03:05.373679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:56.322188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.380081+0000","last_change":"2024-09-13T18:02:37.172726+0000","last_active":"2024-09-13T18:03:05.380081+0000","last_peered":"2024-09-13T18:03:05.380081+0000","last_clean":"2024-09-13T18:03:05.380081+0000","last_became_active":"2024-09-13T18:02:37.172235+0000","last_became_peered":"2024-09-13T18:02:37.172235+0000","last_unstale":"2024-09-13T18:03:05.380081+0000","last_undegraded":"2024-09-13T18:03:05.380081+0000","last_fullsized":"2024-09-13T18:03:05.380081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:58.955763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.396043+0000","last_change":"2024-09-13T18:01:46.356670+0000","last_active":"2024-09-13T18:03:05.396043+0000","last_peered":"2024-09-13T18:03:05.396043+0000","last_clean":"2024-09-13T18:03:05.396043+0000","last_became_active":"2024-09-13T18:01:46.354951+0000","last_became_peered":"2024-09-13T18:01:46.354951+0000","last_unstale":"2024-09-13T18:03:05.396043+0000","last_undegraded":"2024-09-13T18:03:05.396043+0000","last_fullsized":"2024-09-13T18:03:05.396043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:26.335474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.376819+0000","last_change":"2024-09-13T18:01:46.339105+0000","last_active":"2024-09-13T18:03:05.376819+0000","last_peered":"2024-09-13T18:03:05.376819+0000","last_clean":"2024-09-13T18:03:05.376819+0000","last_became_active":"2024-09-13T18:01:46.338760+0000","last_became_peered":"2024-09-13T18:01:46.338760+0000","last_unstale":"2024-09-13T18:03:05.376819+0000","last_undegraded":"2024-09-13T18:03:05.376819+0000","last_fullsized":"2024-09-13T18:03:05.376819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:30.071385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.373360+0000","last_change":"2024-09-13T18:02:37.173238+0000","last_active":"2024-09-13T18:03:05.373360+0000","last_peered":"2024-09-13T18:03:05.373360+0000","last_clean":"2024-09-13T18:03:05.373360+0000","last_became_active":"2024-09-13T18:02:37.172670+0000","last_became_peered":"2024-09-13T18:02:37.172670+0000","last_unstale":"2024-09-13T18:03:05.373360+0000","last_undegraded":"2024-09-13T18:03:05.373360+0000","last_fullsized":"2024-09-13T18:03:05.373360+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:35.338659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382745+0000","last_change":"2024-09-13T18:01:46.345358+0000","last_active":"2024-09-13T18:03:05.382745+0000","last_peered":"2024-09-13T18:03:05.382745+0000","last_clean":"2024-09-13T18:03:05.382745+0000","last_became_active":"2024-09-13T18:01:46.345050+0000","last_became_peered":"2024-09-13T18:01:46.345050+0000","last_unstale":"2024-09-13T18:03:05.382745+0000","last_undegraded":"2024-09-13T18:03:05.382745+0000","last_fullsized":"2024-09-13T18:03:05.382745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:30.925633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.367661+0000","last_change":"2024-09-13T18:01:46.349011+0000","last_active":"2024-09-13T18:03:05.367661+0000","last_peered":"2024-09-13T18:03:05.367661+0000","last_clean":"2024-09-13T18:03:05.367661+0000","last_became_active":"2024-09-13T18:01:46.348245+0000","last_became_peered":"2024-09-13T18:01:46.348245+0000","last_unstale":"2024-09-13T18:03:05.367661+0000","last_undegraded":"2024-09-13T18:03:05.367661+0000","last_fullsized":"2024-09-13T18:03:05.367661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:47.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.401240+0000","last_change":"2024-09-13T18:01:46.342540+0000","last_active":"2024-09-13T18:03:05.401240+0000","last_peered":"2024-09-13T18:03:05.401240+0000","last_clean":"2024-09-13T18:03:05.401240+0000","last_became_active":"2024-09-13T18:01:46.342143+0000","last_became_peered":"2024-09-13T18:01:46.342143+0000","last_unstale":"2024-09-13T18:03:05.401240+0000","last_undegraded":"2024-09-13T18:03:05.401240+0000","last_fullsized":"2024-09-13T18:03:05.401240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:49.934091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164121+0000","last_change":"2024-09-13T18:01:46.338915+0000","last_active":"2024-09-13T18:02:36.164121+0000","last_peered":"2024-09-13T18:02:36.164121+0000","last_clean":"2024-09-13T18:02:36.164121+0000","last_became_active":"2024-09-13T18:01:46.338384+0000","last_became_peered":"2024-09-13T18:01:46.338384+0000","last_unstale":"2024-09-13T18:02:36.164121+0000","last_undegraded":"2024-09-13T18:02:36.164121+0000","last_fullsized":"2024-09-13T18:02:36.164121+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:13.478337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164039+0000","last_change":"2024-09-13T18:01:46.343959+0000","last_active":"2024-09-13T18:02:36.164039+0000","last_peered":"2024-09-13T18:02:36.164039+0000","last_clean":"2024-09-13T18:02:36.164039+0000","last_became_active":"2024-09-13T18:01:46.341063+0000","last_became_peered":"2024-09-13T18:01:46.341063+0000","last_unstale":"2024-09-13T18:02:36.164039+0000","last_undegraded":"2024-09-13T18:02:36.164039+0000","last_fullsized":"2024-09-13T18:02:36.164039+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.447487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.383867+0000","last_change":"2024-09-13T18:01:46.341971+0000","last_active":"2024-09-13T18:03:05.383867+0000","last_peered":"2024-09-13T18:03:05.383867+0000","last_clean":"2024-09-13T18:03:05.383867+0000","last_became_active":"2024-09-13T18:01:46.341636+0000","last_became_peered":"2024-09-13T18:01:46.341636+0000","last_unstale":"2024-09-13T18:03:05.383867+0000","last_undegraded":"2024-09-13T18:03:05.383867+0000","last_fullsized":"2024-09-13T18:03:05.383867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:27.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382785+0000","last_change":"2024-09-13T18:01:46.344009+0000","last_active":"2024-09-13T18:03:05.382785+0000","last_peered":"2024-09-13T18:03:05.382785+0000","last_clean":"2024-09-13T18:03:05.382785+0000","last_became_active":"2024-09-13T18:01:46.343639+0000","last_became_peered":"2024-09-13T18:01:46.343639+0000","last_unstale":"2024-09-13T18:03:05.382785+0000","last_undegraded":"2024-09-13T18:03:05.382785+0000","last_fullsized":"2024-09-13T18:03:05.382785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:09.271452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.385151+0000","last_change":"2024-09-13T18:01:46.343502+0000","last_active":"2024-09-13T18:03:05.385151+0000","last_peered":"2024-09-13T18:03:05.385151+0000","last_clean":"2024-09-13T18:03:05.385151+0000","last_became_active":"2024-09-13T18:01:46.343169+0000","last_became_peered":"2024-09-13T18:01:46.343169+0000","last_unstale":"2024-09-13T18:03:05.385151+0000","last_undegraded":"2024-09-13T18:03:05.385151+0000","last_fullsized":"2024-09-13T18:03:05.385151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:25.351119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.400547+0000","last_change":"2024-09-13T18:01:46.348957+0000","last_active":"2024-09-13T18:03:05.400547+0000","last_peered":"2024-09-13T18:03:05.400547+0000","last_clean":"2024-09-13T18:03:05.400547+0000","last_became_active":"2024-09-13T18:01:46.348617+0000","last_became_peered":"2024-09-13T18:01:46.348617+0000","last_unstale":"2024-09-13T18:03:05.400547+0000","last_undegraded":"2024-09-13T18:03:05.400547+0000","last_fullsized":"2024-09-13T18:03:05.400547+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:24.981539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.379855+0000","last_change":"2024-09-13T18:01:46.352010+0000","last_active":"2024-09-13T18:03:05.379855+0000","last_peered":"2024-09-13T18:03:05.379855+0000","last_clean":"2024-09-13T18:03:05.379855+0000","last_became_active":"2024-09-13T18:01:46.351708+0000","last_became_peered":"2024-09-13T18:01:46.351708+0000","last_unstale":"2024-09-13T18:03:05.379855+0000","last_undegraded":"2024-09-13T18:03:05.379855+0000","last_fullsized":"2024-09-13T18:03:05.379855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:04.022440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.402551+0000","last_change":"2024-09-13T18:01:46.346106+0000","last_active":"2024-09-13T18:03:05.402551+0000","last_peered":"2024-09-13T18:03:05.402551+0000","last_clean":"2024-09-13T18:03:05.402551+0000","last_became_active":"2024-09-13T18:01:46.345814+0000","last_became_peered":"2024-09-13T18:01:46.345814+0000","last_unstale":"2024-09-13T18:03:05.402551+0000","last_undegraded":"2024-09-13T18:03:05.402551+0000","last_fullsized":"2024-09-13T18:03:05.402551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:04.030278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.396243+0000","last_change":"2024-09-13T18:01:46.358966+0000","last_active":"2024-09-13T18:03:05.396243+0000","last_peered":"2024-09-13T18:03:05.396243+0000","last_clean":"2024-09-13T18:03:05.396243+0000","last_became_active":"2024-09-13T18:01:46.358048+0000","last_became_peered":"2024-09-13T18:01:46.358048+0000","last_unstale":"2024-09-13T18:03:05.396243+0000","last_undegraded":"2024-09-13T18:03:05.396243+0000","last_fullsized":"2024-09-13T18:03:05.396243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:02.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.392690+0000","last_change":"2024-09-13T18:01:46.352545+0000","last_active":"2024-09-13T18:03:05.392690+0000","last_peered":"2024-09-13T18:03:05.392690+0000","last_clean":"2024-09-13T18:03:05.392690+0000","last_became_active":"2024-09-13T18:01:46.352231+0000","last_became_peered":"2024-09-13T18:01:46.352231+0000","last_unstale":"2024-09-13T18:03:05.392690+0000","last_undegraded":"2024-09-13T18:03:05.392690+0000","last_fullsized":"2024-09-13T18:03:05.392690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:01.420823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.386465+0000","last_change":"2024-09-13T18:01:46.355755+0000","last_active":"2024-09-13T18:03:05.386465+0000","last_peered":"2024-09-13T18:03:05.386465+0000","last_clean":"2024-09-13T18:03:05.386465+0000","last_became_active":"2024-09-13T18:01:46.355251+0000","last_became_peered":"2024-09-13T18:01:46.355251+0000","last_unstale":"2024-09-13T18:03:05.386465+0000","last_undegraded":"2024-09-13T18:03:05.386465+0000","last_fullsized":"2024-09-13T18:03:05.386465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:28.658446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.390784+0000","last_change":"2024-09-13T18:01:46.359891+0000","last_active":"2024-09-13T18:03:05.390784+0000","last_peered":"2024-09-13T18:03:05.390784+0000","last_clean":"2024-09-13T18:03:05.390784+0000","last_became_active":"2024-09-13T18:01:46.359445+0000","last_became_peered":"2024-09-13T18:01:46.359445+0000","last_unstale":"2024-09-13T18:03:05.390784+0000","last_undegraded":"2024-09-13T18:03:05.390784+0000","last_fullsized":"2024-09-13T18:03:05.390784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:14.287904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.369459+0000","last_change":"2024-09-13T18:01:46.337012+0000","last_active":"2024-09-13T18:03:05.369459+0000","last_peered":"2024-09-13T18:03:05.369459+0000","last_clean":"2024-09-13T18:03:05.369459+0000","last_became_active":"2024-09-13T18:01:46.335134+0000","last_became_peered":"2024-09-13T18:01:46.335134+0000","last_unstale":"2024-09-13T18:03:05.369459+0000","last_undegraded":"2024-09-13T18:03:05.369459+0000","last_fullsized":"2024-09-13T18:03:05.369459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:00.932899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.375569+0000","last_change":"2024-09-13T18:01:46.345537+0000","last_active":"2024-09-13T18:03:05.375569+0000","last_peered":"2024-09-13T18:03:05.375569+0000","last_clean":"2024-09-13T18:03:05.375569+0000","last_became_active":"2024-09-13T18:01:46.344988+0000","last_became_peered":"2024-09-13T18:01:46.344988+0000","last_unstale":"2024-09-13T18:03:05.375569+0000","last_undegraded":"2024-09-13T18:03:05.375569+0000","last_fullsized":"2024-09-13T18:03:05.375569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:01.631371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.402253+0000","last_change":"2024-09-13T18:01:46.352355+0000","last_active":"2024-09-13T18:03:05.402253+0000","last_peered":"2024-09-13T18:03:05.402253+0000","last_clean":"2024-09-13T18:03:05.402253+0000","last_became_active":"2024-09-13T18:01:46.352027+0000","last_became_peered":"2024-09-13T18:01:46.352027+0000","last_unstale":"2024-09-13T18:03:05.402253+0000","last_undegraded":"2024-09-13T18:03:05.402253+0000","last_fullsized":"2024-09-13T18:03:05.402253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:21.204326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164832+0000","last_change":"2024-09-13T18:01:46.353703+0000","last_active":"2024-09-13T18:02:36.164832+0000","last_peered":"2024-09-13T18:02:36.164832+0000","last_clean":"2024-09-13T18:02:36.164832+0000","last_became_active":"2024-09-13T18:01:46.353278+0000","last_became_peered":"2024-09-13T18:01:46.353278+0000","last_unstale":"2024-09-13T18:02:36.164832+0000","last_undegraded":"2024-09-13T18:02:36.164832+0000","last_fullsized":"2024-09-13T18:02:36.164832+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:13.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.391189+0000","last_change":"2024-09-13T18:01:46.348944+0000","last_active":"2024-09-13T18:03:05.391189+0000","last_peered":"2024-09-13T18:03:05.391189+0000","last_clean":"2024-09-13T18:03:05.391189+0000","last_became_active":"2024-09-13T18:01:46.348600+0000","last_became_peered":"2024-09-13T18:01:46.348600+0000","last_unstale":"2024-09-13T18:03:05.391189+0000","last_undegraded":"2024-09-13T18:03:05.391189+0000","last_fullsized":"2024-09-13T18:03:05.391189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:52.474038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.365980+0000","last_change":"2024-09-13T18:01:46.343072+0000","last_active":"2024-09-13T18:03:05.365980+0000","last_peered":"2024-09-13T18:03:05.365980+0000","last_clean":"2024-09-13T18:03:05.365980+0000","last_became_active":"2024-09-13T18:01:46.342604+0000","last_became_peered":"2024-09-13T18:01:46.342604+0000","last_unstale":"2024-09-13T18:03:05.365980+0000","last_undegraded":"2024-09-13T18:03:05.365980+0000","last_fullsized":"2024-09-13T18:03:05.365980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:39.018568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.376803+0000","last_change":"2024-09-13T18:01:46.345568+0000","last_active":"2024-09-13T18:03:05.376803+0000","last_peered":"2024-09-13T18:03:05.376803+0000","last_clean":"2024-09-13T18:03:05.376803+0000","last_became_active":"2024-09-13T18:01:46.344980+0000","last_became_peered":"2024-09-13T18:01:46.344980+0000","last_unstale":"2024-09-13T18:03:05.376803+0000","last_undegraded":"2024-09-13T18:03:05.376803+0000","last_fullsized":"2024-09-13T18:03:05.376803+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:10.337136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.373387+0000","last_change":"2024-09-13T18:01:46.343778+0000","last_active":"2024-09-13T18:03:05.373387+0000","last_peered":"2024-09-13T18:03:05.373387+0000","last_clean":"2024-09-13T18:03:05.373387+0000","last_became_active":"2024-09-13T18:01:46.343315+0000","last_became_peered":"2024-09-13T18:01:46.343315+0000","last_unstale":"2024-09-13T18:03:05.373387+0000","last_undegraded":"2024-09-13T18:03:05.373387+0000","last_fullsized":"2024-09-13T18:03:05.373387+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:37.300512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:07.161931+0000","last_change":"2024-09-13T18:01:45.907544+0000","last_active":"2024-09-13T18:03:07.161931+0000","last_peered":"2024-09-13T18:03:07.161931+0000","last_clean":"2024-09-13T18:03:07.161931+0000","last_became_active":"2024-09-13T18:01:45.905723+0000","last_became_peered":"2024-09-13T18:01:45.905723+0000","last_unstale":"2024-09-13T18:03:07.161931+0000","last_undegraded":"2024-09-13T18:03:07.161931+0000","last_fullsized":"2024-09-13T18:03:07.161931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:36.956332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.388734+0000","last_change":"2024-09-13T18:01:46.354386+0000","last_active":"2024-09-13T18:03:05.388734+0000","last_peered":"2024-09-13T18:03:05.388734+0000","last_clean":"2024-09-13T18:03:05.388734+0000","last_became_active":"2024-09-13T18:01:46.353826+0000","last_became_peered":"2024-09-13T18:01:46.353826+0000","last_unstale":"2024-09-13T18:03:05.388734+0000","last_undegraded":"2024-09-13T18:03:05.388734+0000","last_fullsized":"2024-09-13T18:03:05.388734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:52.882814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.166942+0000","last_change":"2024-09-13T18:01:45.905700+0000","last_active":"2024-09-13T18:02:36.166942+0000","last_peered":"2024-09-13T18:02:36.166942+0000","last_clean":"2024-09-13T18:02:36.166942+0000","last_became_active":"2024-09-13T18:01:45.905041+0000","last_became_peered":"2024-09-13T18:01:45.905041+0000","last_unstale":"2024-09-13T18:02:36.166942+0000","last_undegraded":"2024-09-13T18:02:36.166942+0000","last_fullsized":"2024-09-13T18:02:36.166942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:42.452899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.392126+0000","last_change":"2024-09-13T18:01:45.909342+0000","last_active":"2024-09-13T18:02:36.392126+0000","last_peered":"2024-09-13T18:02:36.392126+0000","last_clean":"2024-09-13T18:02:36.392126+0000","last_became_active":"2024-09-13T18:01:45.903521+0000","last_became_peered":"2024-09-13T18:01:45.903521+0000","last_unstale":"2024-09-13T18:02:36.392126+0000","last_undegraded":"2024-09-13T18:02:36.392126+0000","last_fullsized":"2024-09-13T18:02:36.392126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:51.641256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.403990+0000","last_change":"2024-09-13T18:01:46.352544+0000","last_active":"2024-09-13T18:03:05.403990+0000","last_peered":"2024-09-13T18:03:05.403990+0000","last_clean":"2024-09-13T18:03:05.403990+0000","last_became_active":"2024-09-13T18:01:46.352037+0000","last_became_peered":"2024-09-13T18:01:46.352037+0000","last_unstale":"2024-09-13T18:03:05.403990+0000","last_undegraded":"2024-09-13T18:03:05.403990+0000","last_fullsized":"2024-09-13T18:03:05.403990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:39.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.167021+0000","last_change":"2024-09-13T18:01:45.908424+0000","last_active":"2024-09-13T18:02:36.167021+0000","last_peered":"2024-09-13T18:02:36.167021+0000","last_clean":"2024-09-13T18:02:36.167021+0000","last_became_active":"2024-09-13T18:01:45.908046+0000","last_became_peered":"2024-09-13T18:01:45.908046+0000","last_unstale":"2024-09-13T18:02:36.167021+0000","last_undegraded":"2024-09-13T18:02:36.167021+0000","last_fullsized":"2024-09-13T18:02:36.167021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:36.894538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.394156+0000","last_change":"2024-09-13T18:01:46.356279+0000","last_active":"2024-09-13T18:03:05.394156+0000","last_peered":"2024-09-13T18:03:05.394156+0000","last_clean":"2024-09-13T18:03:05.394156+0000","last_became_active":"2024-09-13T18:01:46.355954+0000","last_became_peered":"2024-09-13T18:01:46.355954+0000","last_unstale":"2024-09-13T18:03:05.394156+0000","last_undegraded":"2024-09-13T18:03:05.394156+0000","last_fullsized":"2024-09-13T18:03:05.394156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:30.595635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":170,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:06.205257+0000","last_change":"2024-09-13T18:01:45.903952+0000","last_active":"2024-09-13T18:03:06.205257+0000","last_peered":"2024-09-13T18:03:06.205257+0000","last_clean":"2024-09-13T18:03:06.205257+0000","last_became_active":"2024-09-13T18:01:45.903664+0000","last_became_peered":"2024-09-13T18:01:45.903664+0000","last_unstale":"2024-09-13T18:03:06.205257+0000","last_undegraded":"2024-09-13T18:03:06.205257+0000","last_fullsized":"2024-09-13T18:03:06.205257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:08.599379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":151,"num_read_kb":151,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.383369+0000","last_change":"2024-09-13T18:01:46.343183+0000","last_active":"2024-09-13T18:03:05.383369+0000","last_peered":"2024-09-13T18:03:05.383369+0000","last_clean":"2024-09-13T18:03:05.383369+0000","last_became_active":"2024-09-13T18:01:46.342773+0000","last_became_peered":"2024-09-13T18:01:46.342773+0000","last_unstale":"2024-09-13T18:03:05.383369+0000","last_undegraded":"2024-09-13T18:03:05.383369+0000","last_fullsized":"2024-09-13T18:03:05.383369+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:50.038027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164100+0000","last_change":"2024-09-13T18:01:45.911889+0000","last_active":"2024-09-13T18:02:36.164100+0000","last_peered":"2024-09-13T18:02:36.164100+0000","last_clean":"2024-09-13T18:02:36.164100+0000","last_became_active":"2024-09-13T18:01:45.911418+0000","last_became_peered":"2024-09-13T18:01:45.911418+0000","last_unstale":"2024-09-13T18:02:36.164100+0000","last_undegraded":"2024-09-13T18:02:36.164100+0000","last_fullsized":"2024-09-13T18:02:36.164100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:05.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164658+0000","last_change":"2024-09-13T18:01:46.354364+0000","last_active":"2024-09-13T18:02:36.164658+0000","last_peered":"2024-09-13T18:02:36.164658+0000","last_clean":"2024-09-13T18:02:36.164658+0000","last_became_active":"2024-09-13T18:01:46.354026+0000","last_became_peered":"2024-09-13T18:01:46.354026+0000","last_unstale":"2024-09-13T18:02:36.164658+0000","last_undegraded":"2024-09-13T18:02:36.164658+0000","last_fullsized":"2024-09-13T18:02:36.164658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168090+0000","last_change":"2024-09-13T18:01:45.901597+0000","last_active":"2024-09-13T18:02:36.168090+0000","last_peered":"2024-09-13T18:02:36.168090+0000","last_clean":"2024-09-13T18:02:36.168090+0000","last_became_active":"2024-09-13T18:01:45.901239+0000","last_became_peered":"2024-09-13T18:01:45.901239+0000","last_unstale":"2024-09-13T18:02:36.168090+0000","last_undegraded":"2024-09-13T18:02:36.168090+0000","last_fullsized":"2024-09-13T18:02:36.168090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:10.833206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.383032+0000","last_change":"2024-09-13T18:01:46.351157+0000","last_active":"2024-09-13T18:03:05.383032+0000","last_peered":"2024-09-13T18:03:05.383032+0000","last_clean":"2024-09-13T18:03:05.383032+0000","last_became_active":"2024-09-13T18:01:46.350805+0000","last_became_peered":"2024-09-13T18:01:46.350805+0000","last_unstale":"2024-09-13T18:03:05.383032+0000","last_undegraded":"2024-09-13T18:03:05.383032+0000","last_fullsized":"2024-09-13T18:03:05.383032+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:15.680744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'33","reported_seq":208,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:07.172312+0000","last_change":"2024-09-13T18:01:45.898614+0000","last_active":"2024-09-13T18:03:07.172312+0000","last_peered":"2024-09-13T18:03:07.172312+0000","last_clean":"2024-09-13T18:03:07.172312+0000","last_became_active":"2024-09-13T18:01:45.898279+0000","last_became_peered":"2024-09-13T18:01:45.898279+0000","last_unstale":"2024-09-13T18:03:07.172312+0000","last_undegraded":"2024-09-13T18:03:07.172312+0000","last_fullsized":"2024-09-13T18:03:07.172312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:49.174143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58968,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":161,"num_read_kb":138,"num_write":35,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.383424+0000","last_change":"2024-09-13T18:01:46.340270+0000","last_active":"2024-09-13T18:03:05.383424+0000","last_peered":"2024-09-13T18:03:05.383424+0000","last_clean":"2024-09-13T18:03:05.383424+0000","last_became_active":"2024-09-13T18:01:46.339968+0000","last_became_peered":"2024-09-13T18:01:46.339968+0000","last_unstale":"2024-09-13T18:03:05.383424+0000","last_undegraded":"2024-09-13T18:03:05.383424+0000","last_fullsized":"2024-09-13T18:03:05.383424+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:42.070652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.170616+0000","last_change":"2024-09-13T18:01:45.909336+0000","last_active":"2024-09-13T18:02:36.170616+0000","last_peered":"2024-09-13T18:02:36.170616+0000","last_clean":"2024-09-13T18:02:36.170616+0000","last_became_active":"2024-09-13T18:01:45.908956+0000","last_became_peered":"2024-09-13T18:01:45.908956+0000","last_unstale":"2024-09-13T18:02:36.170616+0000","last_undegraded":"2024-09-13T18:02:36.170616+0000","last_fullsized":"2024-09-13T18:02:36.170616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:29.327701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.401677+0000","last_change":"2024-09-13T18:01:46.354627+0000","last_active":"2024-09-13T18:03:05.401677+0000","last_peered":"2024-09-13T18:03:05.401677+0000","last_clean":"2024-09-13T18:03:05.401677+0000","last_became_active":"2024-09-13T18:01:46.354318+0000","last_became_peered":"2024-09-13T18:01:46.354318+0000","last_unstale":"2024-09-13T18:03:05.401677+0000","last_undegraded":"2024-09-13T18:03:05.401677+0000","last_fullsized":"2024-09-13T18:03:05.401677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:55.814673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.167360+0000","last_change":"2024-09-13T18:01:45.909477+0000","last_active":"2024-09-13T18:02:36.167360+0000","last_peered":"2024-09-13T18:02:36.167360+0000","last_clean":"2024-09-13T18:02:36.167360+0000","last_became_active":"2024-09-13T18:01:45.909143+0000","last_became_peered":"2024-09-13T18:01:45.909143+0000","last_unstale":"2024-09-13T18:02:36.167360+0000","last_undegraded":"2024-09-13T18:02:36.167360+0000","last_fullsized":"2024-09-13T18:02:36.167360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:52.276839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.408645+0000","last_change":"2024-09-13T18:01:46.351293+0000","last_active":"2024-09-13T18:03:05.408645+0000","last_peered":"2024-09-13T18:03:05.408645+0000","last_clean":"2024-09-13T18:03:05.408645+0000","last_became_active":"2024-09-13T18:01:46.350980+0000","last_became_peered":"2024-09-13T18:01:46.350980+0000","last_unstale":"2024-09-13T18:03:05.408645+0000","last_undegraded":"2024-09-13T18:03:05.408645+0000","last_fullsized":"2024-09-13T18:03:05.408645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:20.656282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":96,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.158254+0000","last_change":"2024-09-13T18:01:45.905434+0000","last_active":"2024-09-13T18:03:05.158254+0000","last_peered":"2024-09-13T18:03:05.158254+0000","last_clean":"2024-09-13T18:03:05.158254+0000","last_became_active":"2024-09-13T18:01:45.904719+0000","last_became_peered":"2024-09-13T18:01:45.904719+0000","last_unstale":"2024-09-13T18:03:05.158254+0000","last_undegraded":"2024-09-13T18:03:05.158254+0000","last_fullsized":"2024-09-13T18:03:05.158254+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:43.949977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.367350+0000","last_change":"2024-09-13T18:01:46.348191+0000","last_active":"2024-09-13T18:03:05.367350+0000","last_peered":"2024-09-13T18:03:05.367350+0000","last_clean":"2024-09-13T18:03:05.367350+0000","last_became_active":"2024-09-13T18:01:46.347886+0000","last_became_peered":"2024-09-13T18:01:46.347886+0000","last_unstale":"2024-09-13T18:03:05.367350+0000","last_undegraded":"2024-09-13T18:03:05.367350+0000","last_fullsized":"2024-09-13T18:03:05.367350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:40.986385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.163450+0000","last_change":"2024-09-13T18:01:45.904429+0000","last_active":"2024-09-13T18:02:36.163450+0000","last_peered":"2024-09-13T18:02:36.163450+0000","last_clean":"2024-09-13T18:02:36.163450+0000","last_became_active":"2024-09-13T18:01:45.904134+0000","last_became_peered":"2024-09-13T18:01:45.904134+0000","last_unstale":"2024-09-13T18:02:36.163450+0000","last_undegraded":"2024-09-13T18:02:36.163450+0000","last_fullsized":"2024-09-13T18:02:36.163450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:54.073044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.369041+0000","last_change":"2024-09-13T18:01:46.350725+0000","last_active":"2024-09-13T18:03:05.369041+0000","last_peered":"2024-09-13T18:03:05.369041+0000","last_clean":"2024-09-13T18:03:05.369041+0000","last_became_active":"2024-09-13T18:01:46.350061+0000","last_became_peered":"2024-09-13T18:01:46.350061+0000","last_unstale":"2024-09-13T18:03:05.369041+0000","last_undegraded":"2024-09-13T18:03:05.369041+0000","last_fullsized":"2024-09-13T18:03:05.369041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:09.649534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.165037+0000","last_change":"2024-09-13T18:01:45.903251+0000","last_active":"2024-09-13T18:02:36.165037+0000","last_peered":"2024-09-13T18:02:36.165037+0000","last_clean":"2024-09-13T18:02:36.165037+0000","last_became_active":"2024-09-13T18:01:45.901593+0000","last_became_peered":"2024-09-13T18:01:45.901593+0000","last_unstale":"2024-09-13T18:02:36.165037+0000","last_undegraded":"2024-09-13T18:02:36.165037+0000","last_fullsized":"2024-09-13T18:02:36.165037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.197806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.377372+0000","last_change":"2024-09-13T18:01:46.351524+0000","last_active":"2024-09-13T18:03:05.377372+0000","last_peered":"2024-09-13T18:03:05.377372+0000","last_clean":"2024-09-13T18:03:05.377372+0000","last_became_active":"2024-09-13T18:01:46.351136+0000","last_became_peered":"2024-09-13T18:01:46.351136+0000","last_unstale":"2024-09-13T18:03:05.377372+0000","last_undegraded":"2024-09-13T18:03:05.377372+0000","last_fullsized":"2024-09-13T18:03:05.377372+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:39.639592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.392401+0000","last_change":"2024-09-13T18:01:45.914866+0000","last_active":"2024-09-13T18:02:36.392401+0000","last_peered":"2024-09-13T18:02:36.392401+0000","last_clean":"2024-09-13T18:02:36.392401+0000","last_became_active":"2024-09-13T18:01:45.914549+0000","last_became_peered":"2024-09-13T18:01:45.914549+0000","last_unstale":"2024-09-13T18:02:36.392401+0000","last_undegraded":"2024-09-13T18:02:36.392401+0000","last_fullsized":"2024-09-13T18:02:36.392401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:46.789559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.380969+0000","last_change":"2024-09-13T18:01:46.342386+0000","last_active":"2024-09-13T18:03:05.380969+0000","last_peered":"2024-09-13T18:03:05.380969+0000","last_clean":"2024-09-13T18:03:05.380969+0000","last_became_active":"2024-09-13T18:01:46.342086+0000","last_became_peered":"2024-09-13T18:01:46.342086+0000","last_unstale":"2024-09-13T18:03:05.380969+0000","last_undegraded":"2024-09-13T18:03:05.380969+0000","last_fullsized":"2024-09-13T18:03:05.380969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:44.379756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168162+0000","last_change":"2024-09-13T18:01:45.909247+0000","last_active":"2024-09-13T18:02:36.168162+0000","last_peered":"2024-09-13T18:02:36.168162+0000","last_clean":"2024-09-13T18:02:36.168162+0000","last_became_active":"2024-09-13T18:01:45.908930+0000","last_became_peered":"2024-09-13T18:01:45.908930+0000","last_unstale":"2024-09-13T18:02:36.168162+0000","last_undegraded":"2024-09-13T18:02:36.168162+0000","last_fullsized":"2024-09-13T18:02:36.168162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:46.433561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.398272+0000","last_change":"2024-09-13T18:01:46.358240+0000","last_active":"2024-09-13T18:03:05.398272+0000","last_peered":"2024-09-13T18:03:05.398272+0000","last_clean":"2024-09-13T18:03:05.398272+0000","last_became_active":"2024-09-13T18:01:46.357893+0000","last_became_peered":"2024-09-13T18:01:46.357893+0000","last_unstale":"2024-09-13T18:03:05.398272+0000","last_undegraded":"2024-09-13T18:03:05.398272+0000","last_fullsized":"2024-09-13T18:03:05.398272+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:41.725958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.204532+0000","last_change":"2024-09-13T18:02:37.177662+0000","last_active":"2024-09-13T18:03:05.204532+0000","last_peered":"2024-09-13T18:03:05.204532+0000","last_clean":"2024-09-13T18:03:05.204532+0000","last_became_active":"2024-09-13T18:02:37.171075+0000","last_became_peered":"2024-09-13T18:02:37.171075+0000","last_unstale":"2024-09-13T18:03:05.204532+0000","last_undegraded":"2024-09-13T18:03:05.204532+0000","last_fullsized":"2024-09-13T18:03:05.204532+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:19.759107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1122,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382829+0000","last_change":"2024-09-13T18:01:46.343336+0000","last_active":"2024-09-13T18:03:05.382829+0000","last_peered":"2024-09-13T18:03:05.382829+0000","last_clean":"2024-09-13T18:03:05.382829+0000","last_became_active":"2024-09-13T18:01:46.342941+0000","last_became_peered":"2024-09-13T18:01:46.342941+0000","last_unstale":"2024-09-13T18:03:05.382829+0000","last_undegraded":"2024-09-13T18:03:05.382829+0000","last_fullsized":"2024-09-13T18:03:05.382829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:13.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":331,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164092+0000","last_change":"2024-09-13T18:00:36.038635+0000","last_active":"2024-09-13T18:02:36.164092+0000","last_peered":"2024-09-13T18:02:36.164092+0000","last_clean":"2024-09-13T18:02:36.164092+0000","last_became_active":"2024-09-13T18:00:36.038227+0000","last_became_peered":"2024-09-13T18:00:36.038227+0000","last_unstale":"2024-09-13T18:02:36.164092+0000","last_undegraded":"2024-09-13T18:02:36.164092+0000","last_fullsized":"2024-09-13T18:02:36.164092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:57:10.088656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:57:10.088656+0000","last_clean_scrub_stamp":"2024-09-13T17:57:10.088656+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:54.824216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.167538+0000","last_change":"2024-09-13T18:01:45.901622+0000","last_active":"2024-09-13T18:02:36.167538+0000","last_peered":"2024-09-13T18:02:36.167538+0000","last_clean":"2024-09-13T18:02:36.167538+0000","last_became_active":"2024-09-13T18:01:45.901212+0000","last_became_peered":"2024-09-13T18:01:45.901212+0000","last_unstale":"2024-09-13T18:02:36.167538+0000","last_undegraded":"2024-09-13T18:02:36.167538+0000","last_fullsized":"2024-09-13T18:02:36.167538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:57.417769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.389768+0000","last_change":"2024-09-13T18:01:46.351439+0000","last_active":"2024-09-13T18:03:05.389768+0000","last_peered":"2024-09-13T18:03:05.389768+0000","last_clean":"2024-09-13T18:03:05.389768+0000","last_became_active":"2024-09-13T18:01:46.350801+0000","last_became_peered":"2024-09-13T18:01:46.350801+0000","last_unstale":"2024-09-13T18:03:05.389768+0000","last_undegraded":"2024-09-13T18:03:05.389768+0000","last_fullsized":"2024-09-13T18:03:05.389768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:32.407058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.163654+0000","last_change":"2024-09-13T18:01:45.907122+0000","last_active":"2024-09-13T18:02:36.163654+0000","last_peered":"2024-09-13T18:02:36.163654+0000","last_clean":"2024-09-13T18:02:36.163654+0000","last_became_active":"2024-09-13T18:01:45.906741+0000","last_became_peered":"2024-09-13T18:01:45.906741+0000","last_unstale":"2024-09-13T18:02:36.163654+0000","last_undegraded":"2024-09-13T18:02:36.163654+0000","last_fullsized":"2024-09-13T18:02:36.163654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:09.242844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.400265+0000","last_change":"2024-09-13T18:01:46.341715+0000","last_active":"2024-09-13T18:03:05.400265+0000","last_peered":"2024-09-13T18:03:05.400265+0000","last_clean":"2024-09-13T18:03:05.400265+0000","last_became_active":"2024-09-13T18:01:46.340930+0000","last_became_peered":"2024-09-13T18:01:46.340930+0000","last_unstale":"2024-09-13T18:03:05.400265+0000","last_undegraded":"2024-09-13T18:03:05.400265+0000","last_fullsized":"2024-09-13T18:03:05.400265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:02.050831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":97,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:07.160457+0000","last_change":"2024-09-13T18:01:45.918611+0000","last_active":"2024-09-13T18:03:07.160457+0000","last_peered":"2024-09-13T18:03:07.160457+0000","last_clean":"2024-09-13T18:03:07.160457+0000","last_became_active":"2024-09-13T18:01:45.916885+0000","last_became_peered":"2024-09-13T18:01:45.916885+0000","last_unstale":"2024-09-13T18:03:07.160457+0000","last_undegraded":"2024-09-13T18:03:07.160457+0000","last_fullsized":"2024-09-13T18:03:07.160457+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:59.917562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.367749+0000","last_change":"2024-09-13T18:01:46.350526+0000","last_active":"2024-09-13T18:03:05.367749+0000","last_peered":"2024-09-13T18:03:05.367749+0000","last_clean":"2024-09-13T18:03:05.367749+0000","last_became_active":"2024-09-13T18:01:46.350065+0000","last_became_peered":"2024-09-13T18:01:46.350065+0000","last_unstale":"2024-09-13T18:03:05.367749+0000","last_undegraded":"2024-09-13T18:03:05.367749+0000","last_fullsized":"2024-09-13T18:03:05.367749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:43.573806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":94,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.634879+0000","last_change":"2024-09-13T18:01:45.911811+0000","last_active":"2024-09-13T18:03:05.634879+0000","last_peered":"2024-09-13T18:03:05.634879+0000","last_clean":"2024-09-13T18:03:05.634879+0000","last_became_active":"2024-09-13T18:01:45.911086+0000","last_became_peered":"2024-09-13T18:01:45.911086+0000","last_unstale":"2024-09-13T18:03:05.634879+0000","last_undegraded":"2024-09-13T18:03:05.634879+0000","last_fullsized":"2024-09-13T18:03:05.634879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:31.743257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.379646+0000","last_change":"2024-09-13T18:02:37.174095+0000","last_active":"2024-09-13T18:03:05.379646+0000","last_peered":"2024-09-13T18:03:05.379646+0000","last_clean":"2024-09-13T18:03:05.379646+0000","last_became_active":"2024-09-13T18:02:37.173682+0000","last_became_peered":"2024-09-13T18:02:37.173682+0000","last_unstale":"2024-09-13T18:03:05.379646+0000","last_undegraded":"2024-09-13T18:03:05.379646+0000","last_fullsized":"2024-09-13T18:03:05.379646+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:43.378503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168276+0000","last_change":"2024-09-13T18:01:45.912239+0000","last_active":"2024-09-13T18:02:36.168276+0000","last_peered":"2024-09-13T18:02:36.168276+0000","last_clean":"2024-09-13T18:02:36.168276+0000","last_became_active":"2024-09-13T18:01:45.911898+0000","last_became_peered":"2024-09-13T18:01:45.911898+0000","last_unstale":"2024-09-13T18:02:36.168276+0000","last_undegraded":"2024-09-13T18:02:36.168276+0000","last_fullsized":"2024-09-13T18:02:36.168276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.473369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.407931+0000","last_change":"2024-09-13T18:01:46.353872+0000","last_active":"2024-09-13T18:03:05.407931+0000","last_peered":"2024-09-13T18:03:05.407931+0000","last_clean":"2024-09-13T18:03:05.407931+0000","last_became_active":"2024-09-13T18:01:46.353253+0000","last_became_peered":"2024-09-13T18:01:46.353253+0000","last_unstale":"2024-09-13T18:03:05.407931+0000","last_undegraded":"2024-09-13T18:03:05.407931+0000","last_fullsized":"2024-09-13T18:03:05.407931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:11.247278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164497+0000","last_change":"2024-09-13T18:01:45.911329+0000","last_active":"2024-09-13T18:02:36.164497+0000","last_peered":"2024-09-13T18:02:36.164497+0000","last_clean":"2024-09-13T18:02:36.164497+0000","last_became_active":"2024-09-13T18:01:45.911036+0000","last_became_peered":"2024-09-13T18:01:45.911036+0000","last_unstale":"2024-09-13T18:02:36.164497+0000","last_undegraded":"2024-09-13T18:02:36.164497+0000","last_fullsized":"2024-09-13T18:02:36.164497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:17.661879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.389347+0000","last_change":"2024-09-13T18:01:46.341156+0000","last_active":"2024-09-13T18:03:05.389347+0000","last_peered":"2024-09-13T18:03:05.389347+0000","last_clean":"2024-09-13T18:03:05.389347+0000","last_became_active":"2024-09-13T18:01:46.340770+0000","last_became_peered":"2024-09-13T18:01:46.340770+0000","last_unstale":"2024-09-13T18:03:05.389347+0000","last_undegraded":"2024-09-13T18:03:05.389347+0000","last_fullsized":"2024-09-13T18:03:05.389347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:27.782016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168385+0000","last_change":"2024-09-13T18:01:45.910311+0000","last_active":"2024-09-13T18:02:36.168385+0000","last_peered":"2024-09-13T18:02:36.168385+0000","last_clean":"2024-09-13T18:02:36.168385+0000","last_became_active":"2024-09-13T18:01:45.909959+0000","last_became_peered":"2024-09-13T18:01:45.909959+0000","last_unstale":"2024-09-13T18:02:36.168385+0000","last_undegraded":"2024-09-13T18:02:36.168385+0000","last_fullsized":"2024-09-13T18:02:36.168385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:58.840803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.396411+0000","last_change":"2024-09-13T18:01:46.354213+0000","last_active":"2024-09-13T18:03:05.396411+0000","last_peered":"2024-09-13T18:03:05.396411+0000","last_clean":"2024-09-13T18:03:05.396411+0000","last_became_active":"2024-09-13T18:01:46.353381+0000","last_became_peered":"2024-09-13T18:01:46.353381+0000","last_unstale":"2024-09-13T18:03:05.396411+0000","last_undegraded":"2024-09-13T18:03:05.396411+0000","last_fullsized":"2024-09-13T18:03:05.396411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:17.236617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168315+0000","last_change":"2024-09-13T18:01:45.915203+0000","last_active":"2024-09-13T18:02:36.168315+0000","last_peered":"2024-09-13T18:02:36.168315+0000","last_clean":"2024-09-13T18:02:36.168315+0000","last_became_active":"2024-09-13T18:01:45.914901+0000","last_became_peered":"2024-09-13T18:01:45.914901+0000","last_unstale":"2024-09-13T18:02:36.168315+0000","last_undegraded":"2024-09-13T18:02:36.168315+0000","last_fullsized":"2024-09-13T18:02:36.168315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:52.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164390+0000","last_change":"2024-09-13T18:01:46.351561+0000","last_active":"2024-09-13T18:02:36.164390+0000","last_peered":"2024-09-13T18:02:36.164390+0000","last_clean":"2024-09-13T18:02:36.164390+0000","last_became_active":"2024-09-13T18:01:46.351245+0000","last_became_peered":"2024-09-13T18:01:46.351245+0000","last_unstale":"2024-09-13T18:02:36.164390+0000","last_undegraded":"2024-09-13T18:02:36.164390+0000","last_fullsized":"2024-09-13T18:02:36.164390+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:16.878552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.169715+0000","last_change":"2024-09-13T18:01:45.904200+0000","last_active":"2024-09-13T18:02:36.169715+0000","last_peered":"2024-09-13T18:02:36.169715+0000","last_clean":"2024-09-13T18:02:36.169715+0000","last_became_active":"2024-09-13T18:01:45.903139+0000","last_became_peered":"2024-09-13T18:01:45.903139+0000","last_unstale":"2024-09-13T18:02:36.169715+0000","last_undegraded":"2024-09-13T18:02:36.169715+0000","last_fullsized":"2024-09-13T18:02:36.169715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:19.104048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.370190+0000","last_change":"2024-09-13T18:01:46.339384+0000","last_active":"2024-09-13T18:03:05.370190+0000","last_peered":"2024-09-13T18:03:05.370190+0000","last_clean":"2024-09-13T18:03:05.370190+0000","last_became_active":"2024-09-13T18:01:46.338962+0000","last_became_peered":"2024-09-13T18:01:46.338962+0000","last_unstale":"2024-09-13T18:03:05.370190+0000","last_undegraded":"2024-09-13T18:03:05.370190+0000","last_fullsized":"2024-09-13T18:03:05.370190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:09.452756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.170638+0000","last_change":"2024-09-13T18:01:45.907717+0000","last_active":"2024-09-13T18:02:36.170638+0000","last_peered":"2024-09-13T18:02:36.170638+0000","last_clean":"2024-09-13T18:02:36.170638+0000","last_became_active":"2024-09-13T18:01:45.907022+0000","last_became_peered":"2024-09-13T18:01:45.907022+0000","last_unstale":"2024-09-13T18:02:36.170638+0000","last_undegraded":"2024-09-13T18:02:36.170638+0000","last_fullsized":"2024-09-13T18:02:36.170638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:16.800561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382057+0000","last_change":"2024-09-13T18:01:46.341053+0000","last_active":"2024-09-13T18:03:05.382057+0000","last_peered":"2024-09-13T18:03:05.382057+0000","last_clean":"2024-09-13T18:03:05.382057+0000","last_became_active":"2024-09-13T18:01:46.340729+0000","last_became_peered":"2024-09-13T18:01:46.340729+0000","last_unstale":"2024-09-13T18:03:05.382057+0000","last_undegraded":"2024-09-13T18:03:05.382057+0000","last_fullsized":"2024-09-13T18:03:05.382057+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:10.585837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:02:37.179499+0000","last_change":"2024-09-13T18:02:37.179499+0000","last_active":"2024-09-13T18:02:37.179499+0000","last_peered":"2024-09-13T18:02:37.179499+0000","last_clean":"2024-09-13T18:02:37.179499+0000","last_became_active":"2024-09-13T18:02:37.171832+0000","last_became_peered":"2024-09-13T18:02:37.171832+0000","last_unstale":"2024-09-13T18:02:37.179499+0000","last_undegraded":"2024-09-13T18:02:37.179499+0000","last_fullsized":"2024-09-13T18:02:37.179499+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:25.435443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.396708+0000","last_change":"2024-09-13T18:01:46.351532+0000","last_active":"2024-09-13T18:03:05.396708+0000","last_peered":"2024-09-13T18:03:05.396708+0000","last_clean":"2024-09-13T18:03:05.396708+0000","last_became_active":"2024-09-13T18:01:46.350476+0000","last_became_peered":"2024-09-13T18:01:46.350476+0000","last_unstale":"2024-09-13T18:03:05.396708+0000","last_undegraded":"2024-09-13T18:03:05.396708+0000","last_fullsized":"2024-09-13T18:03:05.396708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:30.558987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:02:37.176043+0000","last_change":"2024-09-13T18:02:37.176043+0000","last_active":"2024-09-13T18:02:37.176043+0000","last_peered":"2024-09-13T18:02:37.176043+0000","last_clean":"2024-09-13T18:02:37.176043+0000","last_became_active":"2024-09-13T18:02:37.171193+0000","last_became_peered":"2024-09-13T18:02:37.171193+0000","last_unstale":"2024-09-13T18:02:37.176043+0000","last_undegraded":"2024-09-13T18:02:37.176043+0000","last_fullsized":"2024-09-13T18:02:37.176043+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:30.316633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.403165+0000","last_change":"2024-09-13T18:01:46.344087+0000","last_active":"2024-09-13T18:03:05.403165+0000","last_peered":"2024-09-13T18:03:05.403165+0000","last_clean":"2024-09-13T18:03:05.403165+0000","last_became_active":"2024-09-13T18:01:46.343801+0000","last_became_peered":"2024-09-13T18:01:46.343801+0000","last_unstale":"2024-09-13T18:03:05.403165+0000","last_undegraded":"2024-09-13T18:03:05.403165+0000","last_fullsized":"2024-09-13T18:03:05.403165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:11.305588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.368344+0000","last_change":"2024-09-13T18:01:46.350596+0000","last_active":"2024-09-13T18:03:05.368344+0000","last_peered":"2024-09-13T18:03:05.368344+0000","last_clean":"2024-09-13T18:03:05.368344+0000","last_became_active":"2024-09-13T18:01:46.350171+0000","last_became_peered":"2024-09-13T18:01:46.350171+0000","last_unstale":"2024-09-13T18:03:05.368344+0000","last_undegraded":"2024-09-13T18:03:05.368344+0000","last_fullsized":"2024-09-13T18:03:05.368344+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:53.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164214+0000","last_change":"2024-09-13T18:01:45.904016+0000","last_active":"2024-09-13T18:02:36.164214+0000","last_peered":"2024-09-13T18:02:36.164214+0000","last_clean":"2024-09-13T18:02:36.164214+0000","last_became_active":"2024-09-13T18:01:45.903446+0000","last_became_peered":"2024-09-13T18:01:45.903446+0000","last_unstale":"2024-09-13T18:02:36.164214+0000","last_undegraded":"2024-09-13T18:02:36.164214+0000","last_fullsized":"2024-09-13T18:02:36.164214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:57.308647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.407055+0000","last_change":"2024-09-13T18:01:46.341346+0000","last_active":"2024-09-13T18:03:05.407055+0000","last_peered":"2024-09-13T18:03:05.407055+0000","last_clean":"2024-09-13T18:03:05.407055+0000","last_became_active":"2024-09-13T18:01:46.340969+0000","last_became_peered":"2024-09-13T18:01:46.340969+0000","last_unstale":"2024-09-13T18:03:05.407055+0000","last_undegraded":"2024-09-13T18:03:05.407055+0000","last_fullsized":"2024-09-13T18:03:05.407055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:17.664968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164442+0000","last_change":"2024-09-13T18:01:45.906196+0000","last_active":"2024-09-13T18:02:36.164442+0000","last_peered":"2024-09-13T18:02:36.164442+0000","last_clean":"2024-09-13T18:02:36.164442+0000","last_became_active":"2024-09-13T18:01:45.905867+0000","last_became_peered":"2024-09-13T18:01:45.905867+0000","last_unstale":"2024-09-13T18:02:36.164442+0000","last_undegraded":"2024-09-13T18:02:36.164442+0000","last_fullsized":"2024-09-13T18:02:36.164442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:06.525027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164634+0000","last_change":"2024-09-13T18:01:46.342392+0000","last_active":"2024-09-13T18:02:36.164634+0000","last_peered":"2024-09-13T18:02:36.164634+0000","last_clean":"2024-09-13T18:02:36.164634+0000","last_became_active":"2024-09-13T18:01:46.341822+0000","last_became_peered":"2024-09-13T18:01:46.341822+0000","last_unstale":"2024-09-13T18:02:36.164634+0000","last_undegraded":"2024-09-13T18:02:36.164634+0000","last_fullsized":"2024-09-13T18:02:36.164634+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:13.008898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.171102+0000","last_change":"2024-09-13T18:01:45.907263+0000","last_active":"2024-09-13T18:02:36.171102+0000","last_peered":"2024-09-13T18:02:36.171102+0000","last_clean":"2024-09-13T18:02:36.171102+0000","last_became_active":"2024-09-13T18:01:45.906956+0000","last_became_peered":"2024-09-13T18:01:45.906956+0000","last_unstale":"2024-09-13T18:02:36.171102+0000","last_undegraded":"2024-09-13T18:02:36.171102+0000","last_fullsized":"2024-09-13T18:02:36.171102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:49.474806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.395038+0000","last_change":"2024-09-13T18:01:46.350698+0000","last_active":"2024-09-13T18:03:05.395038+0000","last_peered":"2024-09-13T18:03:05.395038+0000","last_clean":"2024-09-13T18:03:05.395038+0000","last_became_active":"2024-09-13T18:01:46.348569+0000","last_became_peered":"2024-09-13T18:01:46.348569+0000","last_unstale":"2024-09-13T18:03:05.395038+0000","last_undegraded":"2024-09-13T18:03:05.395038+0000","last_fullsized":"2024-09-13T18:03:05.395038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:21.104362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:06.635716+0000","last_change":"2024-09-13T18:02:37.601243+0000","last_active":"2024-09-13T18:03:06.635716+0000","last_peered":"2024-09-13T18:03:06.635716+0000","last_clean":"2024-09-13T18:03:06.635716+0000","last_became_active":"2024-09-13T18:02:37.591424+0000","last_became_peered":"2024-09-13T18:02:37.591424+0000","last_unstale":"2024-09-13T18:03:06.635716+0000","last_undegraded":"2024-09-13T18:03:06.635716+0000","last_fullsized":"2024-09-13T18:03:06.635716+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:26.592918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":448,"ondisk_log_size":448,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65731,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":744,"num_read_kb":465,"num_write":235,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1794,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":460177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":1.131,"15min":1.131},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68400000000000005,"5min":1.167,"15min":1.167},"last":0.502}]},{"osd":1,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.47299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78100000000000003,"5min":1.252,"15min":1.252},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63}]},{"osd":2,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60399999999999998,"5min":0.628,"15min":0.628},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.45000000000000001,"15min":0.45600000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.376}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84099999999999997,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.627,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.755,"5min":1.236,"15min":1.236},"last":0.67400000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":0.87,"15min":0.87},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82999999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46899999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.629}]},{"osd":7,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70399999999999996,"15min":0.70699999999999996},"min":{"1min":0.46800000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88500000000000001,"5min":1.218,"15min":1.218},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.55700000000000005,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.70099999999999996}]},{"osd":8,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.52100000000000002}]},{"osd":9,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89400000000000002,"5min":1.365,"15min":1.365},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.55000000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.53500000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.93700000000000006,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85299999999999998,"5min":1.337,"15min":1.337},"last":0.621}]}]},{"osd":10,"up_from":73,"seq":313532612641,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1110174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.5}]},{"osd":1,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40500000000000003,"15min":0.41299999999999998},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.52300000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.59999999999999998,"15min":0.61099999999999999},"min":{"1min":0.39100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69899999999999995,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.628}]},{"osd":3,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69199999999999995,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.441},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67200000000000004,"5min":0.753,"15min":0.753},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.63600000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71099999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76300000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.82899999999999996,"5min":1.468,"15min":1.468},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.76700000000000002,"15min":0.80100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72299999999999998,"5min":2.879,"15min":2.879},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.77600000000000002,"15min":0.80900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.73299999999999998,"5min":2.927,"15min":2.927},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45100000000000001}]},{"osd":8,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84999999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.83199999999999996,"15min":0.86399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77800000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.84699999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.54500000000000004}]},{"osd":11,"last update":"Fri Sep 13 18:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.73699999999999999}]}]},{"osd":9,"up_from":68,"seq":292057776167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":983040,"data_stored":460155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90500000000000003,"5min":1.02,"15min":1.02},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94899999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.747,"15min":0.76600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.629}]},{"osd":4,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.78200000000000003,"15min":0.79900000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0069999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90800000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.84199999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.02,"5min":1.296,"15min":1.296},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.872,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.86799999999999999,"15min":0.88500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98199999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.91400000000000003,"15min":0.93500000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.01,"5min":1.238,"15min":1.238},"last":0.90400000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.92400000000000004,"15min":0.94199999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.93200000000000005,"15min":0.95099999999999996},"min":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89800000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.92000000000000004,"15min":0.93400000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1020000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.96199999999999997}]}]},{"osd":8,"up_from":60,"seq":257698037805,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":459861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.373},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85599999999999998,"5min":0.875,"15min":0.875},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.44,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.62}]},{"osd":2,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.433,"15min":0.42699999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70699999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.61899999999999999},"min":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80100000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.45400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74099999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.48799999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.748}]},{"osd":5,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.47699999999999998},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.317,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79400000000000004,"5min":1.016,"15min":1.016},"last":0.50800000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60699999999999998},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.61799999999999999},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91200000000000003,"5min":1.05,"15min":1.05},"last":0.76400000000000001}]},{"osd":9,"last update":"Fri Sep 13 18:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91400000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.72499999999999998}]},{"osd":10,"last update":"Fri Sep 13 18:02:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67800000000000005,"15min":0.67200000000000004},"min":{"1min":0.52300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68100000000000005,"15min":0.67200000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81899999999999995}]},{"osd":11,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.79300000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32652,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712500,"statfs":{"total":95995035648,"available":95961600000,"internally_reserved":0,"allocated":1576960,"data_stored":1053049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.41299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56599999999999995,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40600000000000003,"15min":0.41799999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53100000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.433},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54600000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.878,"15min":0.878},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.628},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.621}]},{"osd":4,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46500000000000002,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64000000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79000000000000004,"5min":0.874,"15min":0.874},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68700000000000006,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.60399999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82799999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.72299999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70499999999999996}]},{"osd":9,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85099999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83999999999999997,"5min":1.022,"15min":1.022},"last":0.67400000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83799999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64300000000000002,"15min":0.65100000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80100000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65300000000000002}]},{"osd":11,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.73699999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462966,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":459551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.57899999999999996,"15min":0.54700000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.33200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.70399999999999996,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.091,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.749,"15min":0.71599999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.5819999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.77000000000000002,"15min":0.73599999999999999},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.748}]},{"osd":3,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.68500000000000005,"15min":0.65000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3070000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.72299999999999998,"15min":0.70999999999999996},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.1749999999999998,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.78800000000000003,"15min":0.75800000000000001},"min":{"1min":0.5,"5min":0.436,"15min":0.436},"max":{"1min":4.423,"5min":4.423,"15min":4.423},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1379999999999999,"5min":1.587,"15min":1.587},"last":0.65600000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.81999999999999995,"15min":0.79500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":4.5350000000000001,"5min":4.5350000000000001,"15min":4.5350000000000001},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.86199999999999999,"15min":0.84699999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":4.46,"5min":4.46,"15min":4.46},"last":0.624},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81499999999999995,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.206,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.70699999999999996}]},{"osd":8,"last update":"Fri Sep 13 18:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.85499999999999998,"15min":0.82699999999999996},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.073,"5min":0.91200000000000003,"15min":0.89500000000000002},"min":{"1min":0.55500000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.78700000000000003}]},{"osd":9,"last update":"Fri Sep 13 18:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.93999999999999995,"15min":0.91600000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.5019999999999998,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.81399999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:02:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.6769999999999996,"5min":4.6769999999999996,"15min":4.6769999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.89500000000000002,"15min":0.89700000000000002},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.84899999999999998}]}]},{"osd":5,"up_from":39,"seq":167503724604,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32660,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712492,"statfs":{"total":95995035648,"available":95961591808,"internally_reserved":0,"allocated":1585152,"data_stored":1052492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.39000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66500000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73099999999999998,"5min":0.745,"15min":0.745},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.27900000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.313},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.374,"15min":0.36799999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57599999999999996,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.42899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73099999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.40999999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.88800000000000001,"15min":1.1379999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89000000000000001,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.141,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.44,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77000000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.498}]},{"osd":8,"last update":"Fri Sep 13 18:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.376,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.747,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60499999999999998}]},{"osd":9,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.80300000000000005,"5min":0.872,"15min":0.872},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.87,"5min":1.026,"15min":1.026},"last":0.61899999999999999}]},{"osd":10,"last update":"Fri Sep 13 18:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.441,"5min":0.433,"15min":0.433},"max":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.55800000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.55900000000000005}]}]},{"osd":4,"up_from":34,"seq":146028888129,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":974848,"data_stored":460807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.47099999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74299999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.51400000000000001,"15min":0.48899999999999999},"min":{"1min":0.38300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71199999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.26700000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.34899999999999998},"min":{"1min":0.253,"5min":0.218,"15min":0.218},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.42299999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.33300000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.79000000000000004,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.55100000000000005,"15min":0.51700000000000002},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57199999999999995,"15min":0.55800000000000005},"min":{"1min":0.41599999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.85099999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.46600000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.80600000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Sep 13 18:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64100000000000001,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85699999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.62},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79000000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.501}]},{"osd":7,"last update":"Fri Sep 13 18:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.45500000000000002},"min":{"1min":0.40799999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.34000000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.38500000000000001}]},{"osd":8,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.52200000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.77600000000000002}]},{"osd":9,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.53400000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.69899999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86199999999999999,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54700000000000004}]},{"osd":11,"last update":"Fri Sep 13 18:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.746}]}]},{"osd":3,"up_from":26,"seq":111669149765,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":978944,"data_stored":459366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45800000000000002,"15min":0.41099999999999998},"min":{"1min":0.313,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.41999999999999998},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.85699999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.96699999999999997,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.60599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84999999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72999999999999998,"15min":0.64200000000000002},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.996,"5min":6.8520000000000003,"15min":6.8520000000000003},"last":0.622}]},{"osd":4,"last update":"Fri Sep 13 18:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89600000000000002,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.52700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0169999999999999,"5min":1.048,"15min":1.048},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.012,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.46100000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.75700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65600000000000003,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.089,"5min":1.135,"15min":1.135},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65500000000000003,"15min":0.60399999999999998},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":1.302,"15min":1.302},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.58599999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90300000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73999999999999999,"15min":0.71999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88300000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.66400000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0580000000000001,"5min":1.421,"15min":1.421},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.115,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.80200000000000005}]},{"osd":9,"last update":"Fri Sep 13 18:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.86799999999999999,"15min":0.88600000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.153,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.91300000000000003,"15min":0.93500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.181,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.79200000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:02:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.92600000000000005,"15min":0.94999999999999996},"min":{"1min":0.65400000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.94099999999999995,"5min":1.617,"15min":1.617},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.91700000000000004,"15min":0.93200000000000005},"min":{"1min":0.67600000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":0.93899999999999995,"5min":1.365,"15min":1.365},"last":0.71199999999999997}]},{"osd":11,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.78600000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":519288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53700000000000003,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78000000000000003,"5min":1.296,"15min":1.296},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.53400000000000003,"15min":0.498},"min":{"1min":0.44600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70699999999999996,"5min":1.077,"15min":1.077},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78300000000000003,"5min":1.234,"15min":1.234},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.875,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.41599999999999998,"15min":0.38800000000000001},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.5},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66600000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.622},"min":{"1min":0.434,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81699999999999995,"5min":3.778,"15min":3.778},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61099999999999999},"min":{"1min":0.45900000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82899999999999996,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.443}]},{"osd":8,"last update":"Fri Sep 13 18:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.80100000000000005}]},{"osd":9,"last update":"Fri Sep 13 18:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.71399999999999997,"15min":0.72499999999999998},"min":{"1min":0.47999999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85999999999999999,"5min":1.27,"15min":1.27},"last":0.749},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.81899999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.85299999999999998}]},{"osd":11,"last update":"Fri Sep 13 18:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.82699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":520104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,3,13,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.629,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.30599999999999999},"max":{"1min":1.2669999999999999,"5min":10.179,"15min":10.179},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66300000000000003,"15min":0.56299999999999994},"min":{"1min":0.45600000000000002,"5min":0.33700000000000002,"15min":0.28899999999999998},"max":{"1min":0.80400000000000005,"5min":10.117000000000001,"15min":10.117000000000001},"last":0.78900000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59899999999999998,"15min":0.497},"min":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74199999999999999,"5min":8.593,"15min":8.593},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52200000000000002,"15min":0.48099999999999998},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82199999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.60499999999999998,"15min":0.57799999999999996},"min":{"1min":0.46100000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.623},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.63300000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.26800000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.441},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.38900000000000001,"15min":0.379},"min":{"1min":0.28499999999999998,"5min":0.248,"15min":0.248},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.373}]},{"osd":5,"last update":"Fri Sep 13 18:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.876,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.439,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91600000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:03:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75,"15min":0.64800000000000002},"min":{"1min":0.57799999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6739999999999999,"5min":10.161,"15min":10.161},"last":1.6739999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.70599999999999996,"15min":0.64400000000000002},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":6.8339999999999996,"5min":6.8339999999999996,"15min":6.8339999999999996},"last":6.8339999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.34300000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76200000000000001,"5min":1.012,"15min":1.012},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57299999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.85699999999999998,"15min":0.97399999999999998},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84999999999999998,"5min":10.141,"15min":10.141},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.67900000000000005,"15min":0.66600000000000004},"min":{"1min":0.54400000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.95699999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.55700000000000005}]},{"osd":9,"last update":"Fri Sep 13 18:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.50800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.90300000000000002,"5min":0.995,"15min":0.995},"last":2.3119999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88200000000000001,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.746}]},{"osd":10,"last update":"Fri Sep 13 18:02:40 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.39400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93400000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.65500000000000003}]},{"osd":11,"last update":"Fri Sep 13 18:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.61199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36176,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708976,"statfs":{"total":95995035648,"available":95957991424,"internally_reserved":0,"allocated":983040,"data_stored":460890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59499999999999997,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.91100000000000003,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.437},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85399999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.61199999999999999,"15min":0.58199999999999996},"min":{"1min":0.433,"5min":0.373,"15min":0.373},"max":{"1min":0.85099999999999998,"5min":1.012,"15min":1.012},"last":0.92300000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78800000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.64800000000000002,"15min":0.61399999999999999},"min":{"1min":0.48099999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.92700000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61799999999999999,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70699999999999996,"15min":0.67300000000000004},"min":{"1min":0.50900000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.67100000000000004,"15min":0.621},"min":{"1min":0.46000000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67700000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77700000000000002,"5min":1.165,"15min":1.165},"last":0.5},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.022,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.96299999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79400000000000004,"15min":0.78200000000000003},"min":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.73299999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":0.88400000000000001},"min":{"1min":0.57999999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.087,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.006,"5min":1.04,"15min":1.04},"last":0.71299999999999997}]},{"osd":9,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.85299999999999998,"15min":0.874},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0009999999999999,"5min":1.103,"15min":1.103},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81399999999999995,"15min":0.83199999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.073,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.89400000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.86199999999999999,"15min":0.88},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0669999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.046},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.90200000000000002,"15min":0.92000000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.026,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.74399999999999999}]},{"osd":11,"last update":"Fri Sep 13 18:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0229999999999999,"5min":1.129,"15min":1.129},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.875,"15min":0.877},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.048,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.78200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:03:11.786 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T18:03:12.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:11 smithi027 ceph-mon[30611]: from='client.24896 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:03:12.115 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:12.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:11 smithi122 ceph-mon[35310]: from='client.24896 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:03:12.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:11 smithi143 ceph-mon[38210]: from='client.24896 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:03:13.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:12 smithi122 ceph-mon[35310]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T18:03:13.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:12 smithi143 ceph-mon[38210]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T18:03:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:12 smithi027 ceph-mon[30611]: pgmap v336: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-13T18:03:14.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.012+0000 7f7d1ca00640 1 -- 172.21.15.27:0/2831071945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d180731a0 msgr2=0x7f7d1810bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:14.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.012+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/2831071945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d180731a0 0x7f7d1810bf10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7d00009900 tx=0x7f7d0002a480 comp rx=0 tx=0).stop 2024-09-13T18:03:14.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.012+0000 7f7d1ca00640 1 -- 172.21.15.27:0/2831071945 shutdown_connections 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.012+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/2831071945 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d1810c450 0x7f7d1810e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.012+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/2831071945 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d180731a0 0x7f7d1810bf10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.012+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/2831071945 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d18072880 0x7f7d18072c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.012+0000 7f7d1ca00640 1 -- 172.21.15.27:0/2831071945 >> 172.21.15.27:0/2831071945 conn(0x7f7d180fb870 msgr2=0x7f7d180fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.012+0000 7f7d1ca00640 1 -- 172.21.15.27:0/2831071945 shutdown_connections 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.012+0000 7f7d1ca00640 1 -- 172.21.15.27:0/2831071945 wait complete. 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.013+0000 7f7d1ca00640 1 Processor -- start 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d1ca00640 1 -- start start 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d1ca00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d18072880 0x7f7d18198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d1ca00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d180731a0 0x7f7d181989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d1ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d1810c450 0x7f7d1819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:14.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d1ca00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1819d3a0 con 0x7f7d180731a0 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d1ca00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1819d510 con 0x7f7d1810c450 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d1ca00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1819d680 con 0x7f7d18072880 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d17400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d18072880 0x7f7d18198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d17400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d18072880 0x7f7d18198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:52232/0 (socket says 172.21.15.27:52232) 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d17400640 1 -- 172.21.15.27:0/4267505722 learned_addr learned my addr 172.21.15.27:0/4267505722 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d0ea00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d180731a0 0x7f7d181989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.014+0000 7f7d17e00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d1810c450 0x7f7d1819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d17400640 1 -- 172.21.15.27:0/4267505722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d1810c450 msgr2=0x7f7d1819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d17400640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d1810c450 0x7f7d1819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d17400640 1 -- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d180731a0 msgr2=0x7f7d181989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d17400640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d180731a0 0x7f7d181989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d17400640 1 -- 172.21.15.27:0/4267505722 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d10009490 con 0x7f7d18072880 2024-09-13T18:03:14.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d17400640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d18072880 0x7f7d18198460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800eb90 tx=0x7f7d0800ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d14c00640 1 -- 172.21.15.27:0/4267505722 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d0800cea0 con 0x7f7d18072880 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d14c00640 1 -- 172.21.15.27:0/4267505722 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7d08005020 con 0x7f7d18072880 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d00009560 con 0x7f7d18072880 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d14c00640 1 -- 172.21.15.27:0/4267505722 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d08010670 con 0x7f7d18072880 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.015+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d181a5050 con 0x7f7d18072880 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.016+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d18073f30 con 0x7f7d18072880 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.018+0000 7f7d14c00640 1 -- 172.21.15.27:0/4267505722 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7d08005500 con 0x7f7d18072880 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.019+0000 7f7d14c00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7cfc0a1070 0x7f7cfc0a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.020+0000 7f7d14c00640 1 -- 172.21.15.27:0/4267505722 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7d08014070 con 0x7f7d18072880 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.020+0000 7f7d0ea00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7cfc0a1070 0x7f7cfc0a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:14.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.020+0000 7f7d0ea00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7cfc0a1070 0x7f7cfc0a3530 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7d00005ec0 tx=0x7f7d00005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:14.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.024+0000 7f7d14c00640 1 -- 172.21.15.27:0/4267505722 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7d08096660 con 0x7f7d18072880 2024-09-13T18:03:14.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.202+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d181997c0 con 0x7f7cfc0a1070 2024-09-13T18:03:14.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.212+0000 7f7d14c00640 1 -- 172.21.15.27:0/4267505722 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344625 (secure 0 0 0) 0x7f7d181997c0 con 0x7f7cfc0a1070 2024-09-13T18:03:14.218 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:14.220 INFO:teuthology.orchestra.run.smithi027.stderr:dumped all 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7cfc0a1070 msgr2=0x7f7cfc0a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7cfc0a1070 0x7f7cfc0a3530 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7d00005ec0 tx=0x7f7d00005a20 comp rx=0 tx=0).stop 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d18072880 msgr2=0x7f7d18198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d18072880 0x7f7d18198460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7d0800eb90 tx=0x7f7d0800ef90 comp rx=0 tx=0).stop 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 shutdown_connections 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7cfc0a1070 0x7f7cfc0a3530 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7d1810c450 0x7f7d1819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7d180731a0 0x7f7d181989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 --2- 172.21.15.27:0/4267505722 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7d18072880 0x7f7d18198460 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:14.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.216+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 >> 172.21.15.27:0/4267505722 conn(0x7f7d180fb870 msgr2=0x7f7d180fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:14.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.217+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 shutdown_connections 2024-09-13T18:03:14.223 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:14.217+0000 7f7d1ca00640 1 -- 172.21.15.27:0/4267505722 wait complete. 2024-09-13T18:03:15.010 INFO:teuthology.orchestra.run.smithi027.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-13T18:03:13.390156+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":656333,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":915,"num_read_kb":594,"num_write":418,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":1182530,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":846,"ondisk_log_size":846,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374440,"kb_used_data":13384,"kb_used_omap":18,"kb_used_meta":360941,"kb_avail":1124567384,"statfs":{"total":1151940427776,"available":1151557001216,"internally_reserved":0,"allocated":13705216,"data_stored":7475914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19127,"internal_metadata":369603913},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":390,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":71,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002986"},"pg_stats":[{"pgid":"3.3f","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382583+0000","last_change":"2024-09-13T18:01:46.343413+0000","last_active":"2024-09-13T18:03:05.382583+0000","last_peered":"2024-09-13T18:03:05.382583+0000","last_clean":"2024-09-13T18:03:05.382583+0000","last_became_active":"2024-09-13T18:01:46.343086+0000","last_became_peered":"2024-09-13T18:01:46.343086+0000","last_unstale":"2024-09-13T18:03:05.382583+0000","last_undegraded":"2024-09-13T18:03:05.382583+0000","last_fullsized":"2024-09-13T18:03:05.382583+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:11.345474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"88'4","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.379434+0000","last_change":"2024-09-13T18:01:46.338910+0000","last_active":"2024-09-13T18:03:05.379434+0000","last_peered":"2024-09-13T18:03:05.379434+0000","last_clean":"2024-09-13T18:03:05.379434+0000","last_became_active":"2024-09-13T18:01:46.338570+0000","last_became_peered":"2024-09-13T18:01:46.338570+0000","last_unstale":"2024-09-13T18:03:05.379434+0000","last_undegraded":"2024-09-13T18:03:05.379434+0000","last_fullsized":"2024-09-13T18:03:05.379434+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:24.664195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.388158+0000","last_change":"2024-09-13T18:01:46.329371+0000","last_active":"2024-09-13T18:03:05.388158+0000","last_peered":"2024-09-13T18:03:05.388158+0000","last_clean":"2024-09-13T18:03:05.388158+0000","last_became_active":"2024-09-13T18:01:46.328778+0000","last_became_peered":"2024-09-13T18:01:46.328778+0000","last_unstale":"2024-09-13T18:03:05.388158+0000","last_undegraded":"2024-09-13T18:03:05.388158+0000","last_fullsized":"2024-09-13T18:03:05.388158+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:02.025318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"88'8","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.370300+0000","last_change":"2024-09-13T18:02:37.172904+0000","last_active":"2024-09-13T18:03:05.370300+0000","last_peered":"2024-09-13T18:03:05.370300+0000","last_clean":"2024-09-13T18:03:05.370300+0000","last_became_active":"2024-09-13T18:02:37.171485+0000","last_became_peered":"2024-09-13T18:02:37.171485+0000","last_unstale":"2024-09-13T18:03:05.370300+0000","last_undegraded":"2024-09-13T18:03:05.370300+0000","last_fullsized":"2024-09-13T18:03:05.370300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:52.473746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"88'4","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.388441+0000","last_change":"2024-09-13T18:01:46.357813+0000","last_active":"2024-09-13T18:03:05.388441+0000","last_peered":"2024-09-13T18:03:05.388441+0000","last_clean":"2024-09-13T18:03:05.388441+0000","last_became_active":"2024-09-13T18:01:46.357039+0000","last_became_peered":"2024-09-13T18:01:46.357039+0000","last_unstale":"2024-09-13T18:03:05.388441+0000","last_undegraded":"2024-09-13T18:03:05.388441+0000","last_fullsized":"2024-09-13T18:03:05.388441+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:18.772049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.373679+0000","last_change":"2024-09-13T18:01:46.348881+0000","last_active":"2024-09-13T18:03:05.373679+0000","last_peered":"2024-09-13T18:03:05.373679+0000","last_clean":"2024-09-13T18:03:05.373679+0000","last_became_active":"2024-09-13T18:01:46.348576+0000","last_became_peered":"2024-09-13T18:01:46.348576+0000","last_unstale":"2024-09-13T18:03:05.373679+0000","last_undegraded":"2024-09-13T18:03:05.373679+0000","last_fullsized":"2024-09-13T18:03:05.373679+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:56.322188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"88'5","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.380081+0000","last_change":"2024-09-13T18:02:37.172726+0000","last_active":"2024-09-13T18:03:05.380081+0000","last_peered":"2024-09-13T18:03:05.380081+0000","last_clean":"2024-09-13T18:03:05.380081+0000","last_became_active":"2024-09-13T18:02:37.172235+0000","last_became_peered":"2024-09-13T18:02:37.172235+0000","last_unstale":"2024-09-13T18:03:05.380081+0000","last_undegraded":"2024-09-13T18:03:05.380081+0000","last_fullsized":"2024-09-13T18:03:05.380081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:58.955763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.396043+0000","last_change":"2024-09-13T18:01:46.356670+0000","last_active":"2024-09-13T18:03:05.396043+0000","last_peered":"2024-09-13T18:03:05.396043+0000","last_clean":"2024-09-13T18:03:05.396043+0000","last_became_active":"2024-09-13T18:01:46.354951+0000","last_became_peered":"2024-09-13T18:01:46.354951+0000","last_unstale":"2024-09-13T18:03:05.396043+0000","last_undegraded":"2024-09-13T18:03:05.396043+0000","last_fullsized":"2024-09-13T18:03:05.396043+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:45:26.335474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"88'11","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.376819+0000","last_change":"2024-09-13T18:01:46.339105+0000","last_active":"2024-09-13T18:03:05.376819+0000","last_peered":"2024-09-13T18:03:05.376819+0000","last_clean":"2024-09-13T18:03:05.376819+0000","last_became_active":"2024-09-13T18:01:46.338760+0000","last_became_peered":"2024-09-13T18:01:46.338760+0000","last_unstale":"2024-09-13T18:03:05.376819+0000","last_undegraded":"2024-09-13T18:03:05.376819+0000","last_fullsized":"2024-09-13T18:03:05.376819+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:30.071385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"88'16","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.373360+0000","last_change":"2024-09-13T18:02:37.173238+0000","last_active":"2024-09-13T18:03:05.373360+0000","last_peered":"2024-09-13T18:03:05.373360+0000","last_clean":"2024-09-13T18:03:05.373360+0000","last_became_active":"2024-09-13T18:02:37.172670+0000","last_became_peered":"2024-09-13T18:02:37.172670+0000","last_unstale":"2024-09-13T18:03:05.373360+0000","last_undegraded":"2024-09-13T18:03:05.373360+0000","last_fullsized":"2024-09-13T18:03:05.373360+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:39:35.338659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382745+0000","last_change":"2024-09-13T18:01:46.345358+0000","last_active":"2024-09-13T18:03:05.382745+0000","last_peered":"2024-09-13T18:03:05.382745+0000","last_clean":"2024-09-13T18:03:05.382745+0000","last_became_active":"2024-09-13T18:01:46.345050+0000","last_became_peered":"2024-09-13T18:01:46.345050+0000","last_unstale":"2024-09-13T18:03:05.382745+0000","last_undegraded":"2024-09-13T18:03:05.382745+0000","last_fullsized":"2024-09-13T18:03:05.382745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:30.925633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.367661+0000","last_change":"2024-09-13T18:01:46.349011+0000","last_active":"2024-09-13T18:03:05.367661+0000","last_peered":"2024-09-13T18:03:05.367661+0000","last_clean":"2024-09-13T18:03:05.367661+0000","last_became_active":"2024-09-13T18:01:46.348245+0000","last_became_peered":"2024-09-13T18:01:46.348245+0000","last_unstale":"2024-09-13T18:03:05.367661+0000","last_undegraded":"2024-09-13T18:03:05.367661+0000","last_fullsized":"2024-09-13T18:03:05.367661+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:47.583978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"88'10","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.401240+0000","last_change":"2024-09-13T18:01:46.342540+0000","last_active":"2024-09-13T18:03:05.401240+0000","last_peered":"2024-09-13T18:03:05.401240+0000","last_clean":"2024-09-13T18:03:05.401240+0000","last_became_active":"2024-09-13T18:01:46.342143+0000","last_became_peered":"2024-09-13T18:01:46.342143+0000","last_unstale":"2024-09-13T18:03:05.401240+0000","last_undegraded":"2024-09-13T18:03:05.401240+0000","last_fullsized":"2024-09-13T18:03:05.401240+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:49.934091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.380652+0000","last_change":"2024-09-13T18:01:46.338915+0000","last_active":"2024-09-13T18:03:05.380652+0000","last_peered":"2024-09-13T18:03:05.380652+0000","last_clean":"2024-09-13T18:03:05.380652+0000","last_became_active":"2024-09-13T18:01:46.338384+0000","last_became_peered":"2024-09-13T18:01:46.338384+0000","last_unstale":"2024-09-13T18:03:05.380652+0000","last_undegraded":"2024-09-13T18:03:05.380652+0000","last_fullsized":"2024-09-13T18:03:05.380652+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:13.478337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.380093+0000","last_change":"2024-09-13T18:01:46.343959+0000","last_active":"2024-09-13T18:03:05.380093+0000","last_peered":"2024-09-13T18:03:05.380093+0000","last_clean":"2024-09-13T18:03:05.380093+0000","last_became_active":"2024-09-13T18:01:46.341063+0000","last_became_peered":"2024-09-13T18:01:46.341063+0000","last_unstale":"2024-09-13T18:03:05.380093+0000","last_undegraded":"2024-09-13T18:03:05.380093+0000","last_fullsized":"2024-09-13T18:03:05.380093+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.447487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.383867+0000","last_change":"2024-09-13T18:01:46.341971+0000","last_active":"2024-09-13T18:03:05.383867+0000","last_peered":"2024-09-13T18:03:05.383867+0000","last_clean":"2024-09-13T18:03:05.383867+0000","last_became_active":"2024-09-13T18:01:46.341636+0000","last_became_peered":"2024-09-13T18:01:46.341636+0000","last_unstale":"2024-09-13T18:03:05.383867+0000","last_undegraded":"2024-09-13T18:03:05.383867+0000","last_fullsized":"2024-09-13T18:03:05.383867+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:27.386124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382785+0000","last_change":"2024-09-13T18:01:46.344009+0000","last_active":"2024-09-13T18:03:05.382785+0000","last_peered":"2024-09-13T18:03:05.382785+0000","last_clean":"2024-09-13T18:03:05.382785+0000","last_became_active":"2024-09-13T18:01:46.343639+0000","last_became_peered":"2024-09-13T18:01:46.343639+0000","last_unstale":"2024-09-13T18:03:05.382785+0000","last_undegraded":"2024-09-13T18:03:05.382785+0000","last_fullsized":"2024-09-13T18:03:05.382785+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:09.271452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"88'10","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.385151+0000","last_change":"2024-09-13T18:01:46.343502+0000","last_active":"2024-09-13T18:03:05.385151+0000","last_peered":"2024-09-13T18:03:05.385151+0000","last_clean":"2024-09-13T18:03:05.385151+0000","last_became_active":"2024-09-13T18:01:46.343169+0000","last_became_peered":"2024-09-13T18:01:46.343169+0000","last_unstale":"2024-09-13T18:03:05.385151+0000","last_undegraded":"2024-09-13T18:03:05.385151+0000","last_fullsized":"2024-09-13T18:03:05.385151+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:25.351119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.400547+0000","last_change":"2024-09-13T18:01:46.348957+0000","last_active":"2024-09-13T18:03:05.400547+0000","last_peered":"2024-09-13T18:03:05.400547+0000","last_clean":"2024-09-13T18:03:05.400547+0000","last_became_active":"2024-09-13T18:01:46.348617+0000","last_became_peered":"2024-09-13T18:01:46.348617+0000","last_unstale":"2024-09-13T18:03:05.400547+0000","last_undegraded":"2024-09-13T18:03:05.400547+0000","last_fullsized":"2024-09-13T18:03:05.400547+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:24.981539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.379855+0000","last_change":"2024-09-13T18:01:46.352010+0000","last_active":"2024-09-13T18:03:05.379855+0000","last_peered":"2024-09-13T18:03:05.379855+0000","last_clean":"2024-09-13T18:03:05.379855+0000","last_became_active":"2024-09-13T18:01:46.351708+0000","last_became_peered":"2024-09-13T18:01:46.351708+0000","last_unstale":"2024-09-13T18:03:05.379855+0000","last_undegraded":"2024-09-13T18:03:05.379855+0000","last_fullsized":"2024-09-13T18:03:05.379855+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:04.022440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"88'11","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.402551+0000","last_change":"2024-09-13T18:01:46.346106+0000","last_active":"2024-09-13T18:03:05.402551+0000","last_peered":"2024-09-13T18:03:05.402551+0000","last_clean":"2024-09-13T18:03:05.402551+0000","last_became_active":"2024-09-13T18:01:46.345814+0000","last_became_peered":"2024-09-13T18:01:46.345814+0000","last_unstale":"2024-09-13T18:03:05.402551+0000","last_undegraded":"2024-09-13T18:03:05.402551+0000","last_fullsized":"2024-09-13T18:03:05.402551+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:11:04.030278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"88'10","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.396243+0000","last_change":"2024-09-13T18:01:46.358966+0000","last_active":"2024-09-13T18:03:05.396243+0000","last_peered":"2024-09-13T18:03:05.396243+0000","last_clean":"2024-09-13T18:03:05.396243+0000","last_became_active":"2024-09-13T18:01:46.358048+0000","last_became_peered":"2024-09-13T18:01:46.358048+0000","last_unstale":"2024-09-13T18:03:05.396243+0000","last_undegraded":"2024-09-13T18:03:05.396243+0000","last_fullsized":"2024-09-13T18:03:05.396243+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:02.336322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.392690+0000","last_change":"2024-09-13T18:01:46.352545+0000","last_active":"2024-09-13T18:03:05.392690+0000","last_peered":"2024-09-13T18:03:05.392690+0000","last_clean":"2024-09-13T18:03:05.392690+0000","last_became_active":"2024-09-13T18:01:46.352231+0000","last_became_peered":"2024-09-13T18:01:46.352231+0000","last_unstale":"2024-09-13T18:03:05.392690+0000","last_undegraded":"2024-09-13T18:03:05.392690+0000","last_fullsized":"2024-09-13T18:03:05.392690+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:01.420823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.386465+0000","last_change":"2024-09-13T18:01:46.355755+0000","last_active":"2024-09-13T18:03:05.386465+0000","last_peered":"2024-09-13T18:03:05.386465+0000","last_clean":"2024-09-13T18:03:05.386465+0000","last_became_active":"2024-09-13T18:01:46.355251+0000","last_became_peered":"2024-09-13T18:01:46.355251+0000","last_unstale":"2024-09-13T18:03:05.386465+0000","last_undegraded":"2024-09-13T18:03:05.386465+0000","last_fullsized":"2024-09-13T18:03:05.386465+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:28.658446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"88'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.390784+0000","last_change":"2024-09-13T18:01:46.359891+0000","last_active":"2024-09-13T18:03:05.390784+0000","last_peered":"2024-09-13T18:03:05.390784+0000","last_clean":"2024-09-13T18:03:05.390784+0000","last_became_active":"2024-09-13T18:01:46.359445+0000","last_became_peered":"2024-09-13T18:01:46.359445+0000","last_unstale":"2024-09-13T18:03:05.390784+0000","last_undegraded":"2024-09-13T18:03:05.390784+0000","last_fullsized":"2024-09-13T18:03:05.390784+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:14.287904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"88'15","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.369459+0000","last_change":"2024-09-13T18:01:46.337012+0000","last_active":"2024-09-13T18:03:05.369459+0000","last_peered":"2024-09-13T18:03:05.369459+0000","last_clean":"2024-09-13T18:03:05.369459+0000","last_became_active":"2024-09-13T18:01:46.335134+0000","last_became_peered":"2024-09-13T18:01:46.335134+0000","last_unstale":"2024-09-13T18:03:05.369459+0000","last_undegraded":"2024-09-13T18:03:05.369459+0000","last_fullsized":"2024-09-13T18:03:05.369459+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:00.932899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.375569+0000","last_change":"2024-09-13T18:01:46.345537+0000","last_active":"2024-09-13T18:03:05.375569+0000","last_peered":"2024-09-13T18:03:05.375569+0000","last_clean":"2024-09-13T18:03:05.375569+0000","last_became_active":"2024-09-13T18:01:46.344988+0000","last_became_peered":"2024-09-13T18:01:46.344988+0000","last_unstale":"2024-09-13T18:03:05.375569+0000","last_undegraded":"2024-09-13T18:03:05.375569+0000","last_fullsized":"2024-09-13T18:03:05.375569+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:01.631371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"88'4","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.402253+0000","last_change":"2024-09-13T18:01:46.352355+0000","last_active":"2024-09-13T18:03:05.402253+0000","last_peered":"2024-09-13T18:03:05.402253+0000","last_clean":"2024-09-13T18:03:05.402253+0000","last_became_active":"2024-09-13T18:01:46.352027+0000","last_became_peered":"2024-09-13T18:01:46.352027+0000","last_unstale":"2024-09-13T18:03:05.402253+0000","last_undegraded":"2024-09-13T18:03:05.402253+0000","last_fullsized":"2024-09-13T18:03:05.402253+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:21.204326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.408546+0000","last_change":"2024-09-13T18:01:46.353703+0000","last_active":"2024-09-13T18:03:05.408546+0000","last_peered":"2024-09-13T18:03:05.408546+0000","last_clean":"2024-09-13T18:03:05.408546+0000","last_became_active":"2024-09-13T18:01:46.353278+0000","last_became_peered":"2024-09-13T18:01:46.353278+0000","last_unstale":"2024-09-13T18:03:05.408546+0000","last_undegraded":"2024-09-13T18:03:05.408546+0000","last_fullsized":"2024-09-13T18:03:05.408546+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:13.407308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.391189+0000","last_change":"2024-09-13T18:01:46.348944+0000","last_active":"2024-09-13T18:03:05.391189+0000","last_peered":"2024-09-13T18:03:05.391189+0000","last_clean":"2024-09-13T18:03:05.391189+0000","last_became_active":"2024-09-13T18:01:46.348600+0000","last_became_peered":"2024-09-13T18:01:46.348600+0000","last_unstale":"2024-09-13T18:03:05.391189+0000","last_undegraded":"2024-09-13T18:03:05.391189+0000","last_fullsized":"2024-09-13T18:03:05.391189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:52.474038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"88'12","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.365980+0000","last_change":"2024-09-13T18:01:46.343072+0000","last_active":"2024-09-13T18:03:05.365980+0000","last_peered":"2024-09-13T18:03:05.365980+0000","last_clean":"2024-09-13T18:03:05.365980+0000","last_became_active":"2024-09-13T18:01:46.342604+0000","last_became_peered":"2024-09-13T18:01:46.342604+0000","last_unstale":"2024-09-13T18:03:05.365980+0000","last_undegraded":"2024-09-13T18:03:05.365980+0000","last_fullsized":"2024-09-13T18:03:05.365980+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:39.018568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.376803+0000","last_change":"2024-09-13T18:01:46.345568+0000","last_active":"2024-09-13T18:03:05.376803+0000","last_peered":"2024-09-13T18:03:05.376803+0000","last_clean":"2024-09-13T18:03:05.376803+0000","last_became_active":"2024-09-13T18:01:46.344980+0000","last_became_peered":"2024-09-13T18:01:46.344980+0000","last_unstale":"2024-09-13T18:03:05.376803+0000","last_undegraded":"2024-09-13T18:03:05.376803+0000","last_fullsized":"2024-09-13T18:03:05.376803+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:10.337136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.373387+0000","last_change":"2024-09-13T18:01:46.343778+0000","last_active":"2024-09-13T18:03:05.373387+0000","last_peered":"2024-09-13T18:03:05.373387+0000","last_clean":"2024-09-13T18:03:05.373387+0000","last_became_active":"2024-09-13T18:01:46.343315+0000","last_became_peered":"2024-09-13T18:01:46.343315+0000","last_unstale":"2024-09-13T18:03:05.373387+0000","last_undegraded":"2024-09-13T18:03:05.373387+0000","last_fullsized":"2024-09-13T18:03:05.373387+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:37.300512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"88'7","reported_seq":106,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:12.169453+0000","last_change":"2024-09-13T18:01:45.907544+0000","last_active":"2024-09-13T18:03:12.169453+0000","last_peered":"2024-09-13T18:03:12.169453+0000","last_clean":"2024-09-13T18:03:12.169453+0000","last_became_active":"2024-09-13T18:01:45.905723+0000","last_became_peered":"2024-09-13T18:01:45.905723+0000","last_unstale":"2024-09-13T18:03:12.169453+0000","last_undegraded":"2024-09-13T18:03:12.169453+0000","last_fullsized":"2024-09-13T18:03:12.169453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:53:36.956332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1107,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":3,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.388734+0000","last_change":"2024-09-13T18:01:46.354386+0000","last_active":"2024-09-13T18:03:05.388734+0000","last_peered":"2024-09-13T18:03:05.388734+0000","last_clean":"2024-09-13T18:03:05.388734+0000","last_became_active":"2024-09-13T18:01:46.353826+0000","last_became_peered":"2024-09-13T18:01:46.353826+0000","last_unstale":"2024-09-13T18:03:05.388734+0000","last_undegraded":"2024-09-13T18:03:05.388734+0000","last_fullsized":"2024-09-13T18:03:05.388734+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:46:52.882814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"86'7","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.166942+0000","last_change":"2024-09-13T18:01:45.905700+0000","last_active":"2024-09-13T18:02:36.166942+0000","last_peered":"2024-09-13T18:02:36.166942+0000","last_clean":"2024-09-13T18:02:36.166942+0000","last_became_active":"2024-09-13T18:01:45.905041+0000","last_became_peered":"2024-09-13T18:01:45.905041+0000","last_unstale":"2024-09-13T18:02:36.166942+0000","last_undegraded":"2024-09-13T18:02:36.166942+0000","last_fullsized":"2024-09-13T18:02:36.166942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:42.452899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"86'3","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.392126+0000","last_change":"2024-09-13T18:01:45.909342+0000","last_active":"2024-09-13T18:02:36.392126+0000","last_peered":"2024-09-13T18:02:36.392126+0000","last_clean":"2024-09-13T18:02:36.392126+0000","last_became_active":"2024-09-13T18:01:45.903521+0000","last_became_peered":"2024-09-13T18:01:45.903521+0000","last_unstale":"2024-09-13T18:02:36.392126+0000","last_undegraded":"2024-09-13T18:02:36.392126+0000","last_fullsized":"2024-09-13T18:02:36.392126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:51.641256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.403990+0000","last_change":"2024-09-13T18:01:46.352544+0000","last_active":"2024-09-13T18:03:05.403990+0000","last_peered":"2024-09-13T18:03:05.403990+0000","last_clean":"2024-09-13T18:03:05.403990+0000","last_became_active":"2024-09-13T18:01:46.352037+0000","last_became_peered":"2024-09-13T18:01:46.352037+0000","last_unstale":"2024-09-13T18:03:05.403990+0000","last_undegraded":"2024-09-13T18:03:05.403990+0000","last_fullsized":"2024-09-13T18:03:05.403990+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:39.463686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.167021+0000","last_change":"2024-09-13T18:01:45.908424+0000","last_active":"2024-09-13T18:02:36.167021+0000","last_peered":"2024-09-13T18:02:36.167021+0000","last_clean":"2024-09-13T18:02:36.167021+0000","last_became_active":"2024-09-13T18:01:45.908046+0000","last_became_peered":"2024-09-13T18:01:45.908046+0000","last_unstale":"2024-09-13T18:02:36.167021+0000","last_undegraded":"2024-09-13T18:02:36.167021+0000","last_fullsized":"2024-09-13T18:02:36.167021+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:07:36.894538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"88'11","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.394156+0000","last_change":"2024-09-13T18:01:46.356279+0000","last_active":"2024-09-13T18:03:05.394156+0000","last_peered":"2024-09-13T18:03:05.394156+0000","last_clean":"2024-09-13T18:03:05.394156+0000","last_became_active":"2024-09-13T18:01:46.355954+0000","last_became_peered":"2024-09-13T18:01:46.355954+0000","last_unstale":"2024-09-13T18:03:05.394156+0000","last_undegraded":"2024-09-13T18:03:05.394156+0000","last_fullsized":"2024-09-13T18:03:05.394156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:30.595635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'5","reported_seq":180,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:11.210976+0000","last_change":"2024-09-13T18:01:45.903952+0000","last_active":"2024-09-13T18:03:11.210976+0000","last_peered":"2024-09-13T18:03:11.210976+0000","last_clean":"2024-09-13T18:03:11.210976+0000","last_became_active":"2024-09-13T18:01:45.903664+0000","last_became_peered":"2024-09-13T18:01:45.903664+0000","last_unstale":"2024-09-13T18:03:11.210976+0000","last_undegraded":"2024-09-13T18:03:11.210976+0000","last_fullsized":"2024-09-13T18:03:11.210976+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:20:08.599379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":161,"num_read_kb":161,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"88'10","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.383369+0000","last_change":"2024-09-13T18:01:46.343183+0000","last_active":"2024-09-13T18:03:05.383369+0000","last_peered":"2024-09-13T18:03:05.383369+0000","last_clean":"2024-09-13T18:03:05.383369+0000","last_became_active":"2024-09-13T18:01:46.342773+0000","last_became_peered":"2024-09-13T18:01:46.342773+0000","last_unstale":"2024-09-13T18:03:05.383369+0000","last_undegraded":"2024-09-13T18:03:05.383369+0000","last_fullsized":"2024-09-13T18:03:05.383369+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:50.038027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164100+0000","last_change":"2024-09-13T18:01:45.911889+0000","last_active":"2024-09-13T18:02:36.164100+0000","last_peered":"2024-09-13T18:02:36.164100+0000","last_clean":"2024-09-13T18:02:36.164100+0000","last_became_active":"2024-09-13T18:01:45.911418+0000","last_became_peered":"2024-09-13T18:01:45.911418+0000","last_unstale":"2024-09-13T18:02:36.164100+0000","last_undegraded":"2024-09-13T18:02:36.164100+0000","last_fullsized":"2024-09-13T18:02:36.164100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:18:05.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.377346+0000","last_change":"2024-09-13T18:01:46.354364+0000","last_active":"2024-09-13T18:03:05.377346+0000","last_peered":"2024-09-13T18:03:05.377346+0000","last_clean":"2024-09-13T18:03:05.377346+0000","last_became_active":"2024-09-13T18:01:46.354026+0000","last_became_peered":"2024-09-13T18:01:46.354026+0000","last_unstale":"2024-09-13T18:03:05.377346+0000","last_undegraded":"2024-09-13T18:03:05.377346+0000","last_fullsized":"2024-09-13T18:03:05.377346+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:17.624085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168090+0000","last_change":"2024-09-13T18:01:45.901597+0000","last_active":"2024-09-13T18:02:36.168090+0000","last_peered":"2024-09-13T18:02:36.168090+0000","last_clean":"2024-09-13T18:02:36.168090+0000","last_became_active":"2024-09-13T18:01:45.901239+0000","last_became_peered":"2024-09-13T18:01:45.901239+0000","last_unstale":"2024-09-13T18:02:36.168090+0000","last_undegraded":"2024-09-13T18:02:36.168090+0000","last_fullsized":"2024-09-13T18:02:36.168090+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:10.833206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"88'11","reported_seq":24,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.383032+0000","last_change":"2024-09-13T18:01:46.351157+0000","last_active":"2024-09-13T18:03:05.383032+0000","last_peered":"2024-09-13T18:03:05.383032+0000","last_clean":"2024-09-13T18:03:05.383032+0000","last_became_active":"2024-09-13T18:01:46.350805+0000","last_became_peered":"2024-09-13T18:01:46.350805+0000","last_unstale":"2024-09-13T18:03:05.383032+0000","last_undegraded":"2024-09-13T18:03:05.383032+0000","last_fullsized":"2024-09-13T18:03:05.383032+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:15.680744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'33","reported_seq":218,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:12.178388+0000","last_change":"2024-09-13T18:01:45.898614+0000","last_active":"2024-09-13T18:03:12.178388+0000","last_peered":"2024-09-13T18:03:12.178388+0000","last_clean":"2024-09-13T18:03:12.178388+0000","last_became_active":"2024-09-13T18:01:45.898279+0000","last_became_peered":"2024-09-13T18:01:45.898279+0000","last_unstale":"2024-09-13T18:03:12.178388+0000","last_undegraded":"2024-09-13T18:03:12.178388+0000","last_fullsized":"2024-09-13T18:03:12.178388+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:49.174143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58968,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":171,"num_read_kb":143,"num_write":35,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.383424+0000","last_change":"2024-09-13T18:01:46.340270+0000","last_active":"2024-09-13T18:03:05.383424+0000","last_peered":"2024-09-13T18:03:05.383424+0000","last_clean":"2024-09-13T18:03:05.383424+0000","last_became_active":"2024-09-13T18:01:46.339968+0000","last_became_peered":"2024-09-13T18:01:46.339968+0000","last_unstale":"2024-09-13T18:03:05.383424+0000","last_undegraded":"2024-09-13T18:03:05.383424+0000","last_fullsized":"2024-09-13T18:03:05.383424+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:42.070652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"86'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.170616+0000","last_change":"2024-09-13T18:01:45.909336+0000","last_active":"2024-09-13T18:02:36.170616+0000","last_peered":"2024-09-13T18:02:36.170616+0000","last_clean":"2024-09-13T18:02:36.170616+0000","last_became_active":"2024-09-13T18:01:45.908956+0000","last_became_peered":"2024-09-13T18:01:45.908956+0000","last_unstale":"2024-09-13T18:02:36.170616+0000","last_undegraded":"2024-09-13T18:02:36.170616+0000","last_fullsized":"2024-09-13T18:02:36.170616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:29.327701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.401677+0000","last_change":"2024-09-13T18:01:46.354627+0000","last_active":"2024-09-13T18:03:05.401677+0000","last_peered":"2024-09-13T18:03:05.401677+0000","last_clean":"2024-09-13T18:03:05.401677+0000","last_became_active":"2024-09-13T18:01:46.354318+0000","last_became_peered":"2024-09-13T18:01:46.354318+0000","last_unstale":"2024-09-13T18:03:05.401677+0000","last_undegraded":"2024-09-13T18:03:05.401677+0000","last_fullsized":"2024-09-13T18:03:05.401677+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:55.814673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.167360+0000","last_change":"2024-09-13T18:01:45.909477+0000","last_active":"2024-09-13T18:02:36.167360+0000","last_peered":"2024-09-13T18:02:36.167360+0000","last_clean":"2024-09-13T18:02:36.167360+0000","last_became_active":"2024-09-13T18:01:45.909143+0000","last_became_peered":"2024-09-13T18:01:45.909143+0000","last_unstale":"2024-09-13T18:02:36.167360+0000","last_undegraded":"2024-09-13T18:02:36.167360+0000","last_fullsized":"2024-09-13T18:02:36.167360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:52.276839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"88'15","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.408645+0000","last_change":"2024-09-13T18:01:46.351293+0000","last_active":"2024-09-13T18:03:05.408645+0000","last_peered":"2024-09-13T18:03:05.408645+0000","last_clean":"2024-09-13T18:03:05.408645+0000","last_became_active":"2024-09-13T18:01:46.350980+0000","last_became_peered":"2024-09-13T18:01:46.350980+0000","last_unstale":"2024-09-13T18:03:05.408645+0000","last_undegraded":"2024-09-13T18:03:05.408645+0000","last_fullsized":"2024-09-13T18:03:05.408645+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:20.656282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'5","reported_seq":101,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:10.165330+0000","last_change":"2024-09-13T18:01:45.905434+0000","last_active":"2024-09-13T18:03:10.165330+0000","last_peered":"2024-09-13T18:03:10.165330+0000","last_clean":"2024-09-13T18:03:10.165330+0000","last_became_active":"2024-09-13T18:01:45.904719+0000","last_became_peered":"2024-09-13T18:01:45.904719+0000","last_unstale":"2024-09-13T18:03:10.165330+0000","last_undegraded":"2024-09-13T18:03:10.165330+0000","last_fullsized":"2024-09-13T18:03:10.165330+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:43.949977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.367350+0000","last_change":"2024-09-13T18:01:46.348191+0000","last_active":"2024-09-13T18:03:05.367350+0000","last_peered":"2024-09-13T18:03:05.367350+0000","last_clean":"2024-09-13T18:03:05.367350+0000","last_became_active":"2024-09-13T18:01:46.347886+0000","last_became_peered":"2024-09-13T18:01:46.347886+0000","last_unstale":"2024-09-13T18:03:05.367350+0000","last_undegraded":"2024-09-13T18:03:05.367350+0000","last_fullsized":"2024-09-13T18:03:05.367350+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:05:40.986385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"86'17","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.163450+0000","last_change":"2024-09-13T18:01:45.904429+0000","last_active":"2024-09-13T18:02:36.163450+0000","last_peered":"2024-09-13T18:02:36.163450+0000","last_clean":"2024-09-13T18:02:36.163450+0000","last_became_active":"2024-09-13T18:01:45.904134+0000","last_became_peered":"2024-09-13T18:01:45.904134+0000","last_unstale":"2024-09-13T18:02:36.163450+0000","last_undegraded":"2024-09-13T18:02:36.163450+0000","last_fullsized":"2024-09-13T18:02:36.163450+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:49:54.073044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.369041+0000","last_change":"2024-09-13T18:01:46.350725+0000","last_active":"2024-09-13T18:03:05.369041+0000","last_peered":"2024-09-13T18:03:05.369041+0000","last_clean":"2024-09-13T18:03:05.369041+0000","last_became_active":"2024-09-13T18:01:46.350061+0000","last_became_peered":"2024-09-13T18:01:46.350061+0000","last_unstale":"2024-09-13T18:03:05.369041+0000","last_undegraded":"2024-09-13T18:03:05.369041+0000","last_fullsized":"2024-09-13T18:03:05.369041+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:09.649534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"86'2","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.165037+0000","last_change":"2024-09-13T18:01:45.903251+0000","last_active":"2024-09-13T18:02:36.165037+0000","last_peered":"2024-09-13T18:02:36.165037+0000","last_clean":"2024-09-13T18:02:36.165037+0000","last_became_active":"2024-09-13T18:01:45.901593+0000","last_became_peered":"2024-09-13T18:01:45.901593+0000","last_unstale":"2024-09-13T18:02:36.165037+0000","last_undegraded":"2024-09-13T18:02:36.165037+0000","last_fullsized":"2024-09-13T18:02:36.165037+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.197806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.377372+0000","last_change":"2024-09-13T18:01:46.351524+0000","last_active":"2024-09-13T18:03:05.377372+0000","last_peered":"2024-09-13T18:03:05.377372+0000","last_clean":"2024-09-13T18:03:05.377372+0000","last_became_active":"2024-09-13T18:01:46.351136+0000","last_became_peered":"2024-09-13T18:01:46.351136+0000","last_unstale":"2024-09-13T18:03:05.377372+0000","last_undegraded":"2024-09-13T18:03:05.377372+0000","last_fullsized":"2024-09-13T18:03:05.377372+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:39.639592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"86'5","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.392401+0000","last_change":"2024-09-13T18:01:45.914866+0000","last_active":"2024-09-13T18:02:36.392401+0000","last_peered":"2024-09-13T18:02:36.392401+0000","last_clean":"2024-09-13T18:02:36.392401+0000","last_became_active":"2024-09-13T18:01:45.914549+0000","last_became_peered":"2024-09-13T18:01:45.914549+0000","last_unstale":"2024-09-13T18:02:36.392401+0000","last_undegraded":"2024-09-13T18:02:36.392401+0000","last_fullsized":"2024-09-13T18:02:36.392401+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:46.789559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.380969+0000","last_change":"2024-09-13T18:01:46.342386+0000","last_active":"2024-09-13T18:03:05.380969+0000","last_peered":"2024-09-13T18:03:05.380969+0000","last_clean":"2024-09-13T18:03:05.380969+0000","last_became_active":"2024-09-13T18:01:46.342086+0000","last_became_peered":"2024-09-13T18:01:46.342086+0000","last_unstale":"2024-09-13T18:03:05.380969+0000","last_undegraded":"2024-09-13T18:03:05.380969+0000","last_fullsized":"2024-09-13T18:03:05.380969+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:44.379756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"86'3","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168162+0000","last_change":"2024-09-13T18:01:45.909247+0000","last_active":"2024-09-13T18:02:36.168162+0000","last_peered":"2024-09-13T18:02:36.168162+0000","last_clean":"2024-09-13T18:02:36.168162+0000","last_became_active":"2024-09-13T18:01:45.908930+0000","last_became_peered":"2024-09-13T18:01:45.908930+0000","last_unstale":"2024-09-13T18:02:36.168162+0000","last_undegraded":"2024-09-13T18:02:36.168162+0000","last_fullsized":"2024-09-13T18:02:36.168162+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:46.433561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.398272+0000","last_change":"2024-09-13T18:01:46.358240+0000","last_active":"2024-09-13T18:03:05.398272+0000","last_peered":"2024-09-13T18:03:05.398272+0000","last_clean":"2024-09-13T18:03:05.398272+0000","last_became_active":"2024-09-13T18:01:46.357893+0000","last_became_peered":"2024-09-13T18:01:46.357893+0000","last_unstale":"2024-09-13T18:03:05.398272+0000","last_undegraded":"2024-09-13T18:03:05.398272+0000","last_fullsized":"2024-09-13T18:03:05.398272+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:41.725958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'5","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:10.210192+0000","last_change":"2024-09-13T18:02:37.177662+0000","last_active":"2024-09-13T18:03:10.210192+0000","last_peered":"2024-09-13T18:03:10.210192+0000","last_clean":"2024-09-13T18:03:10.210192+0000","last_became_active":"2024-09-13T18:02:37.171075+0000","last_became_peered":"2024-09-13T18:02:37.171075+0000","last_unstale":"2024-09-13T18:03:10.210192+0000","last_undegraded":"2024-09-13T18:03:10.210192+0000","last_fullsized":"2024-09-13T18:03:10.210192+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:19.759107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":1122,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,0],"acting":[4,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382829+0000","last_change":"2024-09-13T18:01:46.343336+0000","last_active":"2024-09-13T18:03:05.382829+0000","last_peered":"2024-09-13T18:03:05.382829+0000","last_clean":"2024-09-13T18:03:05.382829+0000","last_became_active":"2024-09-13T18:01:46.342941+0000","last_became_peered":"2024-09-13T18:01:46.342941+0000","last_unstale":"2024-09-13T18:03:05.382829+0000","last_undegraded":"2024-09-13T18:03:05.382829+0000","last_fullsized":"2024-09-13T18:03:05.382829+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:13.639875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":331,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164092+0000","last_change":"2024-09-13T18:00:36.038635+0000","last_active":"2024-09-13T18:02:36.164092+0000","last_peered":"2024-09-13T18:02:36.164092+0000","last_clean":"2024-09-13T18:02:36.164092+0000","last_became_active":"2024-09-13T18:00:36.038227+0000","last_became_peered":"2024-09-13T18:00:36.038227+0000","last_unstale":"2024-09-13T18:02:36.164092+0000","last_undegraded":"2024-09-13T18:02:36.164092+0000","last_fullsized":"2024-09-13T18:02:36.164092+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T17:57:10.088656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T17:57:10.088656+0000","last_clean_scrub_stamp":"2024-09-13T17:57:10.088656+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:54.824216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"86'6","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.167538+0000","last_change":"2024-09-13T18:01:45.901622+0000","last_active":"2024-09-13T18:02:36.167538+0000","last_peered":"2024-09-13T18:02:36.167538+0000","last_clean":"2024-09-13T18:02:36.167538+0000","last_became_active":"2024-09-13T18:01:45.901212+0000","last_became_peered":"2024-09-13T18:01:45.901212+0000","last_unstale":"2024-09-13T18:02:36.167538+0000","last_undegraded":"2024-09-13T18:02:36.167538+0000","last_fullsized":"2024-09-13T18:02:36.167538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:57.417769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.389768+0000","last_change":"2024-09-13T18:01:46.351439+0000","last_active":"2024-09-13T18:03:05.389768+0000","last_peered":"2024-09-13T18:03:05.389768+0000","last_clean":"2024-09-13T18:03:05.389768+0000","last_became_active":"2024-09-13T18:01:46.350801+0000","last_became_peered":"2024-09-13T18:01:46.350801+0000","last_unstale":"2024-09-13T18:03:05.389768+0000","last_undegraded":"2024-09-13T18:03:05.389768+0000","last_fullsized":"2024-09-13T18:03:05.389768+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:32.407058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"86'4","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.163654+0000","last_change":"2024-09-13T18:01:45.907122+0000","last_active":"2024-09-13T18:02:36.163654+0000","last_peered":"2024-09-13T18:02:36.163654+0000","last_clean":"2024-09-13T18:02:36.163654+0000","last_became_active":"2024-09-13T18:01:45.906741+0000","last_became_peered":"2024-09-13T18:01:45.906741+0000","last_unstale":"2024-09-13T18:02:36.163654+0000","last_undegraded":"2024-09-13T18:02:36.163654+0000","last_fullsized":"2024-09-13T18:02:36.163654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:23:09.242844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.400265+0000","last_change":"2024-09-13T18:01:46.341715+0000","last_active":"2024-09-13T18:03:05.400265+0000","last_peered":"2024-09-13T18:03:05.400265+0000","last_clean":"2024-09-13T18:03:05.400265+0000","last_became_active":"2024-09-13T18:01:46.340930+0000","last_became_peered":"2024-09-13T18:01:46.340930+0000","last_unstale":"2024-09-13T18:03:05.400265+0000","last_undegraded":"2024-09-13T18:03:05.400265+0000","last_fullsized":"2024-09-13T18:03:05.400265+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:42:02.050831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"86'5","reported_seq":102,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:12.167772+0000","last_change":"2024-09-13T18:01:45.918611+0000","last_active":"2024-09-13T18:03:12.167772+0000","last_peered":"2024-09-13T18:03:12.167772+0000","last_clean":"2024-09-13T18:03:12.167772+0000","last_became_active":"2024-09-13T18:01:45.916885+0000","last_became_peered":"2024-09-13T18:01:45.916885+0000","last_unstale":"2024-09-13T18:03:12.167772+0000","last_undegraded":"2024-09-13T18:03:12.167772+0000","last_fullsized":"2024-09-13T18:03:12.167772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:59.917562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.367749+0000","last_change":"2024-09-13T18:01:46.350526+0000","last_active":"2024-09-13T18:03:05.367749+0000","last_peered":"2024-09-13T18:03:05.367749+0000","last_clean":"2024-09-13T18:03:05.367749+0000","last_became_active":"2024-09-13T18:01:46.350065+0000","last_became_peered":"2024-09-13T18:01:46.350065+0000","last_unstale":"2024-09-13T18:03:05.367749+0000","last_undegraded":"2024-09-13T18:03:05.367749+0000","last_fullsized":"2024-09-13T18:03:05.367749+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:43.573806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"86'5","reported_seq":99,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:10.642270+0000","last_change":"2024-09-13T18:01:45.911811+0000","last_active":"2024-09-13T18:03:10.642270+0000","last_peered":"2024-09-13T18:03:10.642270+0000","last_clean":"2024-09-13T18:03:10.642270+0000","last_became_active":"2024-09-13T18:01:45.911086+0000","last_became_peered":"2024-09-13T18:01:45.911086+0000","last_unstale":"2024-09-13T18:03:10.642270+0000","last_undegraded":"2024-09-13T18:03:10.642270+0000","last_fullsized":"2024-09-13T18:03:10.642270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:31.743257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"88'7","reported_seq":29,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.379646+0000","last_change":"2024-09-13T18:02:37.174095+0000","last_active":"2024-09-13T18:03:05.379646+0000","last_peered":"2024-09-13T18:03:05.379646+0000","last_clean":"2024-09-13T18:03:05.379646+0000","last_became_active":"2024-09-13T18:02:37.173682+0000","last_became_peered":"2024-09-13T18:02:37.173682+0000","last_unstale":"2024-09-13T18:03:05.379646+0000","last_undegraded":"2024-09-13T18:03:05.379646+0000","last_fullsized":"2024-09-13T18:03:05.379646+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:47:43.378503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"86'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168276+0000","last_change":"2024-09-13T18:01:45.912239+0000","last_active":"2024-09-13T18:02:36.168276+0000","last_peered":"2024-09-13T18:02:36.168276+0000","last_clean":"2024-09-13T18:02:36.168276+0000","last_became_active":"2024-09-13T18:01:45.911898+0000","last_became_peered":"2024-09-13T18:01:45.911898+0000","last_unstale":"2024-09-13T18:02:36.168276+0000","last_undegraded":"2024-09-13T18:02:36.168276+0000","last_fullsized":"2024-09-13T18:02:36.168276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.473369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.407931+0000","last_change":"2024-09-13T18:01:46.353872+0000","last_active":"2024-09-13T18:03:05.407931+0000","last_peered":"2024-09-13T18:03:05.407931+0000","last_clean":"2024-09-13T18:03:05.407931+0000","last_became_active":"2024-09-13T18:01:46.353253+0000","last_became_peered":"2024-09-13T18:01:46.353253+0000","last_unstale":"2024-09-13T18:03:05.407931+0000","last_undegraded":"2024-09-13T18:03:05.407931+0000","last_fullsized":"2024-09-13T18:03:05.407931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:18:11.247278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"86'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164497+0000","last_change":"2024-09-13T18:01:45.911329+0000","last_active":"2024-09-13T18:02:36.164497+0000","last_peered":"2024-09-13T18:02:36.164497+0000","last_clean":"2024-09-13T18:02:36.164497+0000","last_became_active":"2024-09-13T18:01:45.911036+0000","last_became_peered":"2024-09-13T18:01:45.911036+0000","last_unstale":"2024-09-13T18:02:36.164497+0000","last_undegraded":"2024-09-13T18:02:36.164497+0000","last_fullsized":"2024-09-13T18:02:36.164497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:17.661879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.389347+0000","last_change":"2024-09-13T18:01:46.341156+0000","last_active":"2024-09-13T18:03:05.389347+0000","last_peered":"2024-09-13T18:03:05.389347+0000","last_clean":"2024-09-13T18:03:05.389347+0000","last_became_active":"2024-09-13T18:01:46.340770+0000","last_became_peered":"2024-09-13T18:01:46.340770+0000","last_unstale":"2024-09-13T18:03:05.389347+0000","last_undegraded":"2024-09-13T18:03:05.389347+0000","last_fullsized":"2024-09-13T18:03:05.389347+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:27.782016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'9","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168385+0000","last_change":"2024-09-13T18:01:45.910311+0000","last_active":"2024-09-13T18:02:36.168385+0000","last_peered":"2024-09-13T18:02:36.168385+0000","last_clean":"2024-09-13T18:02:36.168385+0000","last_became_active":"2024-09-13T18:01:45.909959+0000","last_became_peered":"2024-09-13T18:01:45.909959+0000","last_unstale":"2024-09-13T18:02:36.168385+0000","last_undegraded":"2024-09-13T18:02:36.168385+0000","last_fullsized":"2024-09-13T18:02:36.168385+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:58.840803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.396411+0000","last_change":"2024-09-13T18:01:46.354213+0000","last_active":"2024-09-13T18:03:05.396411+0000","last_peered":"2024-09-13T18:03:05.396411+0000","last_clean":"2024-09-13T18:03:05.396411+0000","last_became_active":"2024-09-13T18:01:46.353381+0000","last_became_peered":"2024-09-13T18:01:46.353381+0000","last_unstale":"2024-09-13T18:03:05.396411+0000","last_undegraded":"2024-09-13T18:03:05.396411+0000","last_fullsized":"2024-09-13T18:03:05.396411+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:17.236617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"86'7","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.168315+0000","last_change":"2024-09-13T18:01:45.915203+0000","last_active":"2024-09-13T18:02:36.168315+0000","last_peered":"2024-09-13T18:02:36.168315+0000","last_clean":"2024-09-13T18:02:36.168315+0000","last_became_active":"2024-09-13T18:01:45.914901+0000","last_became_peered":"2024-09-13T18:01:45.914901+0000","last_unstale":"2024-09-13T18:02:36.168315+0000","last_undegraded":"2024-09-13T18:02:36.168315+0000","last_fullsized":"2024-09-13T18:02:36.168315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:52.208873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"88'7","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.396132+0000","last_change":"2024-09-13T18:01:46.351561+0000","last_active":"2024-09-13T18:03:05.396132+0000","last_peered":"2024-09-13T18:03:05.396132+0000","last_clean":"2024-09-13T18:03:05.396132+0000","last_became_active":"2024-09-13T18:01:46.351245+0000","last_became_peered":"2024-09-13T18:01:46.351245+0000","last_unstale":"2024-09-13T18:03:05.396132+0000","last_undegraded":"2024-09-13T18:03:05.396132+0000","last_fullsized":"2024-09-13T18:03:05.396132+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:16.878552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.169715+0000","last_change":"2024-09-13T18:01:45.904200+0000","last_active":"2024-09-13T18:02:36.169715+0000","last_peered":"2024-09-13T18:02:36.169715+0000","last_clean":"2024-09-13T18:02:36.169715+0000","last_became_active":"2024-09-13T18:01:45.903139+0000","last_became_peered":"2024-09-13T18:01:45.903139+0000","last_unstale":"2024-09-13T18:02:36.169715+0000","last_undegraded":"2024-09-13T18:02:36.169715+0000","last_fullsized":"2024-09-13T18:02:36.169715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:30:19.104048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"88'2","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.370190+0000","last_change":"2024-09-13T18:01:46.339384+0000","last_active":"2024-09-13T18:03:05.370190+0000","last_peered":"2024-09-13T18:03:05.370190+0000","last_clean":"2024-09-13T18:03:05.370190+0000","last_became_active":"2024-09-13T18:01:46.338962+0000","last_became_peered":"2024-09-13T18:01:46.338962+0000","last_unstale":"2024-09-13T18:03:05.370190+0000","last_undegraded":"2024-09-13T18:03:05.370190+0000","last_fullsized":"2024-09-13T18:03:05.370190+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:09.452756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"86'7","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.170638+0000","last_change":"2024-09-13T18:01:45.907717+0000","last_active":"2024-09-13T18:02:36.170638+0000","last_peered":"2024-09-13T18:02:36.170638+0000","last_clean":"2024-09-13T18:02:36.170638+0000","last_became_active":"2024-09-13T18:01:45.907022+0000","last_became_peered":"2024-09-13T18:01:45.907022+0000","last_unstale":"2024-09-13T18:02:36.170638+0000","last_undegraded":"2024-09-13T18:02:36.170638+0000","last_fullsized":"2024-09-13T18:02:36.170638+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:16.800561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.382057+0000","last_change":"2024-09-13T18:01:46.341053+0000","last_active":"2024-09-13T18:03:05.382057+0000","last_peered":"2024-09-13T18:03:05.382057+0000","last_clean":"2024-09-13T18:03:05.382057+0000","last_became_active":"2024-09-13T18:01:46.340729+0000","last_became_peered":"2024-09-13T18:01:46.340729+0000","last_unstale":"2024-09-13T18:03:05.382057+0000","last_undegraded":"2024-09-13T18:03:05.382057+0000","last_fullsized":"2024-09-13T18:03:05.382057+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:10.585837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"86'3","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:02:37.179499+0000","last_change":"2024-09-13T18:02:37.179499+0000","last_active":"2024-09-13T18:02:37.179499+0000","last_peered":"2024-09-13T18:02:37.179499+0000","last_clean":"2024-09-13T18:02:37.179499+0000","last_became_active":"2024-09-13T18:02:37.171832+0000","last_became_peered":"2024-09-13T18:02:37.171832+0000","last_unstale":"2024-09-13T18:02:37.179499+0000","last_undegraded":"2024-09-13T18:02:37.179499+0000","last_fullsized":"2024-09-13T18:02:37.179499+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:25.435443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"88'8","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.396708+0000","last_change":"2024-09-13T18:01:46.351532+0000","last_active":"2024-09-13T18:03:05.396708+0000","last_peered":"2024-09-13T18:03:05.396708+0000","last_clean":"2024-09-13T18:03:05.396708+0000","last_became_active":"2024-09-13T18:01:46.350476+0000","last_became_peered":"2024-09-13T18:01:46.350476+0000","last_unstale":"2024-09-13T18:03:05.396708+0000","last_undegraded":"2024-09-13T18:03:05.396708+0000","last_fullsized":"2024-09-13T18:03:05.396708+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:30.558987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"86'4","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:02:37.176043+0000","last_change":"2024-09-13T18:02:37.176043+0000","last_active":"2024-09-13T18:02:37.176043+0000","last_peered":"2024-09-13T18:02:37.176043+0000","last_clean":"2024-09-13T18:02:37.176043+0000","last_became_active":"2024-09-13T18:02:37.171193+0000","last_became_peered":"2024-09-13T18:02:37.171193+0000","last_unstale":"2024-09-13T18:02:37.176043+0000","last_undegraded":"2024-09-13T18:02:37.176043+0000","last_fullsized":"2024-09-13T18:02:37.176043+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:30.316633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.403165+0000","last_change":"2024-09-13T18:01:46.344087+0000","last_active":"2024-09-13T18:03:05.403165+0000","last_peered":"2024-09-13T18:03:05.403165+0000","last_clean":"2024-09-13T18:03:05.403165+0000","last_became_active":"2024-09-13T18:01:46.343801+0000","last_became_peered":"2024-09-13T18:01:46.343801+0000","last_unstale":"2024-09-13T18:03:05.403165+0000","last_undegraded":"2024-09-13T18:03:05.403165+0000","last_fullsized":"2024-09-13T18:03:05.403165+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:11.305588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"88'15","reported_seq":28,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.368344+0000","last_change":"2024-09-13T18:01:46.350596+0000","last_active":"2024-09-13T18:03:05.368344+0000","last_peered":"2024-09-13T18:03:05.368344+0000","last_clean":"2024-09-13T18:03:05.368344+0000","last_became_active":"2024-09-13T18:01:46.350171+0000","last_became_peered":"2024-09-13T18:01:46.350171+0000","last_unstale":"2024-09-13T18:03:05.368344+0000","last_undegraded":"2024-09-13T18:03:05.368344+0000","last_fullsized":"2024-09-13T18:03:05.368344+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:08:53.201652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"86'5","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164214+0000","last_change":"2024-09-13T18:01:45.904016+0000","last_active":"2024-09-13T18:02:36.164214+0000","last_peered":"2024-09-13T18:02:36.164214+0000","last_clean":"2024-09-13T18:02:36.164214+0000","last_became_active":"2024-09-13T18:01:45.903446+0000","last_became_peered":"2024-09-13T18:01:45.903446+0000","last_unstale":"2024-09-13T18:02:36.164214+0000","last_undegraded":"2024-09-13T18:02:36.164214+0000","last_fullsized":"2024-09-13T18:02:36.164214+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:57.308647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"88'9","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.407055+0000","last_change":"2024-09-13T18:01:46.341346+0000","last_active":"2024-09-13T18:03:05.407055+0000","last_peered":"2024-09-13T18:03:05.407055+0000","last_clean":"2024-09-13T18:03:05.407055+0000","last_became_active":"2024-09-13T18:01:46.340969+0000","last_became_peered":"2024-09-13T18:01:46.340969+0000","last_unstale":"2024-09-13T18:03:05.407055+0000","last_undegraded":"2024-09-13T18:03:05.407055+0000","last_fullsized":"2024-09-13T18:03:05.407055+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:47:17.664968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"86'12","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.164442+0000","last_change":"2024-09-13T18:01:45.906196+0000","last_active":"2024-09-13T18:02:36.164442+0000","last_peered":"2024-09-13T18:02:36.164442+0000","last_clean":"2024-09-13T18:02:36.164442+0000","last_became_active":"2024-09-13T18:01:45.905867+0000","last_became_peered":"2024-09-13T18:01:45.905867+0000","last_unstale":"2024-09-13T18:02:36.164442+0000","last_undegraded":"2024-09-13T18:02:36.164442+0000","last_fullsized":"2024-09-13T18:02:36.164442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:06.525027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"88'6","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.384446+0000","last_change":"2024-09-13T18:01:46.342392+0000","last_active":"2024-09-13T18:03:05.384446+0000","last_peered":"2024-09-13T18:03:05.384446+0000","last_clean":"2024-09-13T18:03:05.384446+0000","last_became_active":"2024-09-13T18:01:46.341822+0000","last_became_peered":"2024-09-13T18:01:46.341822+0000","last_unstale":"2024-09-13T18:03:05.384446+0000","last_undegraded":"2024-09-13T18:03:05.384446+0000","last_fullsized":"2024-09-13T18:03:05.384446+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:13.008898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"86'2","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-13T18:02:36.171102+0000","last_change":"2024-09-13T18:01:45.907263+0000","last_active":"2024-09-13T18:02:36.171102+0000","last_peered":"2024-09-13T18:02:36.171102+0000","last_clean":"2024-09-13T18:02:36.171102+0000","last_became_active":"2024-09-13T18:01:45.906956+0000","last_became_peered":"2024-09-13T18:01:45.906956+0000","last_unstale":"2024-09-13T18:02:36.171102+0000","last_undegraded":"2024-09-13T18:02:36.171102+0000","last_fullsized":"2024-09-13T18:02:36.171102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:14:49.474806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"88'5","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:05.395038+0000","last_change":"2024-09-13T18:01:46.350698+0000","last_active":"2024-09-13T18:03:05.395038+0000","last_peered":"2024-09-13T18:03:05.395038+0000","last_clean":"2024-09-13T18:03:05.395038+0000","last_became_active":"2024-09-13T18:01:46.348569+0000","last_became_peered":"2024-09-13T18:01:46.348569+0000","last_unstale":"2024-09-13T18:03:05.395038+0000","last_undegraded":"2024-09-13T18:03:05.395038+0000","last_fullsized":"2024-09-13T18:03:05.395038+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:45.883845+0000","last_clean_scrub_stamp":"2024-09-13T18:01:45.883845+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:21.104362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"86'13","reported_seq":126,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-13T18:03:06.635716+0000","last_change":"2024-09-13T18:02:37.601243+0000","last_active":"2024-09-13T18:03:06.635716+0000","last_peered":"2024-09-13T18:03:06.635716+0000","last_clean":"2024-09-13T18:03:06.635716+0000","last_became_active":"2024-09-13T18:02:37.591424+0000","last_became_peered":"2024-09-13T18:02:37.591424+0000","last_unstale":"2024-09-13T18:03:06.635716+0000","last_undegraded":"2024-09-13T18:03:06.635716+0000","last_fullsized":"2024-09-13T18:03:06.635716+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:01:44.714554+0000","last_clean_scrub_stamp":"2024-09-13T18:01:44.714554+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:26.592918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":73,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,1],"acting":[9,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65731,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":789,"num_read_kb":485,"num_write":235,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1794,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":197193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":81,"seq":347892351006,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":958464,"data_stored":460177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.58199999999999996,"15min":0.58799999999999997},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.77000000000000002,"5min":1.131,"15min":1.131},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.56699999999999995,"15min":0.57899999999999996},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68400000000000005,"5min":1.167,"15min":1.167},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.622,"15min":0.62},"min":{"1min":0.47299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78100000000000003,"5min":1.252,"15min":1.252},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56100000000000005,"15min":0.55700000000000005},"min":{"1min":0.40500000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.70199999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.442,"15min":0.439},"min":{"1min":0.28000000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60399999999999998,"5min":0.628,"15min":0.628},"last":0.745},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.45000000000000001,"15min":0.45600000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.64500000000000002,"15min":0.64700000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.84099999999999997,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.627,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.755,"5min":1.236,"15min":1.236},"last":0.77600000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.308,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.71299999999999997,"5min":0.87,"15min":0.87},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54400000000000004,"15min":0.54600000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.82999999999999996,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79600000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.629}]},{"osd":7,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.70399999999999996,"15min":0.70699999999999996},"min":{"1min":0.46800000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88500000000000001,"5min":1.218,"15min":1.218},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.55700000000000005,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.80600000000000005}]},{"osd":8,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.88700000000000001}]},{"osd":9,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.47399999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89400000000000002,"5min":1.365,"15min":1.365},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.72699999999999998,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91700000000000004,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.92200000000000004}]},{"osd":10,"last update":"Fri Sep 13 18:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.53500000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.93700000000000006,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85299999999999998,"5min":1.337,"15min":1.337},"last":0.871}]}]},{"osd":10,"up_from":73,"seq":313532612642,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1620,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1658880,"data_stored":1110174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.5}]},{"osd":1,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.39900000000000002,"15min":0.40500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.51100000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.40500000000000003,"15min":0.41299999999999998},"min":{"1min":0.28100000000000003,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.52300000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56799999999999995,"15min":0.57099999999999995},"min":{"1min":0.41099999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.59999999999999998,"15min":0.61099999999999999},"min":{"1min":0.39100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69899999999999995,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.628}]},{"osd":3,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.60199999999999998,"15min":0.61399999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.69199999999999995,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.441},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67200000000000004,"5min":0.753,"15min":0.753},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.5,"15min":0.51100000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.63600000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.46700000000000003,"15min":0.47699999999999998},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.71099999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76300000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.44500000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.82899999999999996,"5min":1.468,"15min":1.468},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.76700000000000002,"15min":0.80100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.72299999999999998,"5min":2.879,"15min":2.879},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.77600000000000002,"15min":0.80900000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.73299999999999998,"5min":2.927,"15min":2.927},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:01:32 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45100000000000001}]},{"osd":8,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.65300000000000002,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86399999999999999,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.70199999999999996,"15min":0.71199999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84999999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.60299999999999998}]},{"osd":9,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.83199999999999996,"15min":0.86399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.77800000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.75900000000000001,"15min":0.77300000000000002},"min":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.84699999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.54500000000000004}]},{"osd":11,"last update":"Fri Sep 13 18:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.90900000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.73699999999999999}]}]},{"osd":9,"up_from":68,"seq":292057776167,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32072,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713080,"statfs":{"total":95995035648,"available":95962193920,"internally_reserved":0,"allocated":983040,"data_stored":460155,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.56000000000000005,"15min":0.56399999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.628,"15min":0.63300000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90500000000000003,"5min":1.02,"15min":1.02},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69199999999999995,"15min":0.69899999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.71599999999999997,"15min":0.72599999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94899999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.77300000000000002},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.83399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.747,"15min":0.76600000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90400000000000003,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.75900000000000001,"15min":0.78100000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.93799999999999994,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.629}]},{"osd":4,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.78200000000000003,"15min":0.79900000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0069999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.82399999999999995,"15min":0.83799999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.81699999999999995,"15min":0.83099999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.90800000000000003,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.84199999999999997,"15min":0.86199999999999999},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.02,"5min":1.296,"15min":1.296},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.872,"15min":0.88700000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":0.88900000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.86799999999999999,"15min":0.88500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98199999999999998,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.91400000000000003,"15min":0.93500000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.01,"5min":1.238,"15min":1.238},"last":0.90400000000000003}]},{"osd":8,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.92400000000000004,"15min":0.94199999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.93200000000000005,"15min":0.95099999999999996},"min":{"1min":0.59799999999999998,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.89800000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.92000000000000004,"15min":0.93400000000000005},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.91200000000000003,"15min":0.92600000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.1020000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.96199999999999997}]}]},{"osd":8,"up_from":60,"seq":257698037806,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":459861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.40899999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56899999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85599999999999998,"5min":0.875,"15min":0.875},"last":0.60899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.40100000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.44,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73299999999999998,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.75600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.433,"15min":0.42699999999999999},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.443,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70699999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.60199999999999998,"15min":0.61899999999999999},"min":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80100000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.45400000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.74099999999999999,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.58099999999999996,"15min":0.56499999999999995},"min":{"1min":0.48799999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.70499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.48899999999999999,"15min":0.47699999999999998},"min":{"1min":0.308,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76300000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.317,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79400000000000004,"5min":1.016,"15min":1.016},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64700000000000002,"15min":0.65300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.66200000000000003,"15min":0.66900000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.876,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.90200000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.62,"15min":0.60699999999999998},"min":{"1min":0.51200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.61799999999999999},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91200000000000003,"5min":1.05,"15min":1.05},"last":0.92300000000000004}]},{"osd":9,"last update":"Fri Sep 13 18:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91400000000000003,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.98099999999999998}]},{"osd":10,"last update":"Fri Sep 13 18:02:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67800000000000005,"15min":0.67200000000000004},"min":{"1min":0.52300000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68100000000000005,"15min":0.67200000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.84699999999999998}]},{"osd":11,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.88600000000000001}]}]},{"osd":7,"up_from":52,"seq":223338299442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32652,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712500,"statfs":{"total":95995035648,"available":95961600000,"internally_reserved":0,"allocated":1576960,"data_stored":1053049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1588,"internal_metadata":31848908},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.53900000000000003},"min":{"1min":0.41299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.56599999999999995,"15min":0.55500000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.34000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40600000000000003,"15min":0.41799999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.53100000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.54600000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.61699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53800000000000003,"15min":0.52500000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.68400000000000005,"5min":0.878,"15min":0.878},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54400000000000004,"15min":0.53600000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76600000000000001,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65100000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77600000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.60499999999999998,"15min":0.60399999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.751,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.78400000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46500000000000002,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64000000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.45200000000000001,"15min":0.45800000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65500000000000003,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.76600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79000000000000004,"5min":0.874,"15min":0.874},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.61099999999999999,"15min":0.627},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68700000000000006,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66900000000000004,"15min":0.67500000000000004},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82799999999999996,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.65400000000000003,"15min":0.65500000000000003},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81299999999999994,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81799999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.63,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82799999999999996,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.51400000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.72299999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.83199999999999996}]},{"osd":9,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.85099999999999998,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.83999999999999997,"5min":1.022,"15min":1.022},"last":0.88900000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83799999999999997,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.64300000000000002,"15min":0.65100000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.80100000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.86799999999999999}]},{"osd":11,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.94699999999999995}]}]},{"osd":6,"up_from":47,"seq":201863462967,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":459551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54200000000000004,"15min":0.53600000000000003},"min":{"1min":0.375,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.436},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.57899999999999996,"15min":0.54700000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.9489999999999998,"5min":3.9489999999999998,"15min":3.9489999999999998},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.70399999999999996,"15min":0.65800000000000003},"min":{"1min":0.502,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":4.3499999999999996,"5min":4.3499999999999996,"15min":4.3499999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.45600000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.091,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.749,"15min":0.71599999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":4.5819999999999999,"5min":4.5819999999999999,"15min":4.5819999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.77000000000000002,"15min":0.73599999999999999},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.71899999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.68500000000000005,"15min":0.65000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":4.3070000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.72299999999999998,"15min":0.70999999999999996},"min":{"1min":0.41399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.1749999999999998,"5min":4.1749999999999998,"15min":4.1749999999999998},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.78800000000000003,"15min":0.75800000000000001},"min":{"1min":0.5,"5min":0.436,"15min":0.436},"max":{"1min":4.423,"5min":4.423,"15min":4.423},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.53800000000000003,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.1379999999999999,"5min":1.587,"15min":1.587},"last":0.75}]},{"osd":5,"last update":"Fri Sep 13 18:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.78300000000000003,"15min":0.77500000000000002},"min":{"1min":0.53100000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.81999999999999995,"15min":0.79500000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":4.5350000000000001,"5min":4.5350000000000001,"15min":4.5350000000000001},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.86199999999999999,"15min":0.84699999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":4.46,"5min":4.46,"15min":4.46},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.81499999999999995,"15min":0.82799999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.206,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.81599999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":0.85499999999999998,"15min":0.82699999999999996},"min":{"1min":0.55000000000000004,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":4.6210000000000004,"5min":4.6210000000000004,"15min":4.6210000000000004},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.073,"5min":0.91200000000000003,"15min":0.89500000000000002},"min":{"1min":0.55500000000000005,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":4.391,"5min":4.391,"15min":4.391},"last":0.82299999999999995}]},{"osd":9,"last update":"Fri Sep 13 18:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.93999999999999995,"15min":0.91600000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":4.5019999999999998,"5min":4.5019999999999998,"15min":4.5019999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.91400000000000003,"15min":0.92300000000000004},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.85699999999999998}]},{"osd":10,"last update":"Fri Sep 13 18:02:38 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.89400000000000002,"15min":0.86899999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.6769999999999996,"5min":4.6769999999999996,"15min":4.6769999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.89500000000000002,"15min":0.89700000000000002},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"last":0.83799999999999997}]}]},{"osd":5,"up_from":39,"seq":167503724605,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32660,"kb_used_data":1548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93712492,"statfs":{"total":95995035648,"available":95961591808,"internally_reserved":0,"allocated":1585152,"data_stored":1052492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.39000000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.67000000000000004,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.66500000000000004,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.63400000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73099999999999998,"5min":0.745,"15min":0.745},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.53800000000000003,"15min":0.51600000000000001},"min":{"1min":0.42599999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73199999999999998,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.505}]},{"osd":2,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.374,"15min":0.36899999999999999},"min":{"1min":0.27900000000000003,"5min":0.25,"15min":0.25},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.374,"15min":0.36799999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.32800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57599999999999996,"15min":0.60199999999999998},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73699999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.40999999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70499999999999996,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.73299999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.73099999999999998,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55400000000000005,"15min":0.54800000000000004},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.88800000000000001,"15min":1.1379999999999999},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89000000000000001,"5min":16.655999999999999,"15min":16.655999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.45100000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.141,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:02:21 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.44,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60299999999999998,"15min":0.59999999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.77000000000000002,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.47499999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.376,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.33700000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.747,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53800000000000003}]},{"osd":9,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.80300000000000005,"5min":0.872,"15min":0.872},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70799999999999996,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.87,"5min":1.026,"15min":1.026},"last":0.69099999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.441,"5min":0.433,"15min":0.433},"max":{"1min":0.81799999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.55800000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.61599999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888130,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36160,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708992,"statfs":{"total":95995035648,"available":95958007808,"internally_reserved":0,"allocated":974848,"data_stored":460807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.49199999999999999,"15min":0.47099999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.74299999999999999,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.497},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.51400000000000001,"15min":0.48899999999999999},"min":{"1min":0.38300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.61099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.34300000000000003,"15min":0.33800000000000002},"min":{"1min":0.26700000000000002,"5min":0.214,"15min":0.214},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.34899999999999998},"min":{"1min":0.253,"5min":0.218,"15min":0.218},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.42299999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.55600000000000005,"15min":0.53200000000000003},"min":{"1min":0.371,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.83699999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.624},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.52900000000000003,"15min":0.50600000000000001},"min":{"1min":0.45300000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80500000000000005,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:03:10 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56599999999999995,"15min":0.52200000000000002},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72899999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58199999999999996,"15min":0.56200000000000006},"min":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.48199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.54900000000000004},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.80600000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:03:01 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64100000000000001,"15min":0.628},"min":{"1min":0.40400000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85699999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79000000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46300000000000002,"15min":0.45500000000000002},"min":{"1min":0.40799999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71999999999999997,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.47499999999999998,"15min":0.47299999999999998},"min":{"1min":0.34000000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70499999999999996,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.41099999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.624},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63300000000000001,"15min":0.628},"min":{"1min":0.52200000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.747}]},{"osd":9,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.53400000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.89200000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.73299999999999998}]},{"osd":10,"last update":"Fri Sep 13 18:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.60199999999999998},"min":{"1min":0.433,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86199999999999999,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.59799999999999998}]},{"osd":11,"last update":"Fri Sep 13 18:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.76900000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36164,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708988,"statfs":{"total":95995035648,"available":95958003712,"internally_reserved":0,"allocated":978944,"data_stored":459366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":36043208},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45800000000000002,"15min":0.41099999999999998},"min":{"1min":0.313,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.46800000000000003,"15min":0.41999999999999998},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71899999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60999999999999999,"15min":0.55400000000000005},"min":{"1min":0.39800000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.85699999999999998,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.621,"15min":0.59799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.96699999999999997,"5min":1.2490000000000001,"15min":1.2490000000000001},"last":0.58199999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64400000000000002,"15min":0.60599999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84999999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72999999999999998,"15min":0.64200000000000002},"min":{"1min":0.51500000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.996,"5min":6.8520000000000003,"15min":6.8520000000000003},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89600000000000002,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.52700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0169999999999999,"5min":1.048,"15min":1.048},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70899999999999996,"15min":0.69899999999999995},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.012,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.46100000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.78900000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:02:55 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65600000000000003,"15min":0.61199999999999999},"min":{"1min":0.435,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.089,"5min":1.135,"15min":1.135},"last":0.749},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.65500000000000003,"15min":0.60399999999999998},"min":{"1min":0.45600000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88900000000000001,"5min":1.302,"15min":1.302},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72599999999999998,"15min":0.69799999999999995},"min":{"1min":0.58599999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90300000000000002,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.73999999999999999,"15min":0.71999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.88300000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.82299999999999995}]},{"osd":8,"last update":"Fri Sep 13 18:01:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.77800000000000002,"15min":0.78800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0580000000000001,"5min":1.421,"15min":1.421},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.57099999999999995,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.115,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.80200000000000005}]},{"osd":9,"last update":"Fri Sep 13 18:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.86799999999999999,"15min":0.88600000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.153,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.91300000000000003,"15min":0.93500000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.181,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.77300000000000002}]},{"osd":10,"last update":"Fri Sep 13 18:02:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.92600000000000005,"15min":0.94999999999999996},"min":{"1min":0.65400000000000003,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.94099999999999995,"5min":1.617,"15min":1.617},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.91700000000000004,"15min":0.93200000000000005},"min":{"1min":0.67600000000000005,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":0.93899999999999995,"5min":1.365,"15min":1.365},"last":0.90700000000000003}]},{"osd":11,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.97899999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411403,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":519288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53700000000000003,"15min":0.51700000000000002},"min":{"1min":0.40899999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.78000000000000003,"5min":1.296,"15min":1.296},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.53400000000000003,"15min":0.498},"min":{"1min":0.44600000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79900000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.505},"min":{"1min":0.38200000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.70699999999999996,"5min":1.077,"15min":1.077},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.44700000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78300000000000003,"5min":1.234,"15min":1.234},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.875,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.70199999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.41599999999999998,"15min":0.38800000000000001},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.5},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.40200000000000002},"min":{"1min":0.28599999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.66600000000000004,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.622},"min":{"1min":0.434,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.81699999999999995,"5min":3.778,"15min":3.778},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.63800000000000001,"15min":0.61099999999999999},"min":{"1min":0.45900000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82899999999999996,"5min":3.2120000000000002,"15min":3.2120000000000002},"last":0.71799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.44700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.443}]},{"osd":8,"last update":"Fri Sep 13 18:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.52600000000000002},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81299999999999994,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81000000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.80100000000000005}]},{"osd":9,"last update":"Fri Sep 13 18:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.71399999999999997,"15min":0.72499999999999998},"min":{"1min":0.47999999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85999999999999999,"5min":1.27,"15min":1.27},"last":0.749},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72699999999999998,"15min":0.72599999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":0.81899999999999995}]},{"osd":10,"last update":"Fri Sep 13 18:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64200000000000002,"15min":0.63200000000000001},"min":{"1min":0.497,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90700000000000003,"5min":1.212,"15min":1.212},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.85299999999999998}]},{"osd":11,"last update":"Fri Sep 13 18:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.82699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":520104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.629,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.312,"15min":0.30599999999999999},"max":{"1min":1.2669999999999999,"5min":10.179,"15min":10.179},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66300000000000003,"15min":0.56299999999999994},"min":{"1min":0.45600000000000002,"5min":0.33700000000000002,"15min":0.28899999999999998},"max":{"1min":0.80400000000000005,"5min":10.117000000000001,"15min":10.117000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.59899999999999998,"15min":0.497},"min":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.74199999999999999,"5min":8.593,"15min":8.593},"last":0.754},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52200000000000002,"15min":0.48099999999999998},"min":{"1min":0.36299999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82199999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.79900000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:02:52 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.60499999999999998,"15min":0.57799999999999996},"min":{"1min":0.46100000000000002,"5min":0.377,"15min":0.377},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.40400000000000003,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.621}]},{"osd":4,"last update":"Fri Sep 13 18:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.40999999999999998,"15min":0.38200000000000001},"min":{"1min":0.35999999999999999,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.69599999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.41199999999999998,"15min":0.38600000000000001},"min":{"1min":0.33800000000000002,"5min":0.248,"15min":0.248},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.37}]},{"osd":5,"last update":"Fri Sep 13 18:02:27 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.55700000000000005,"15min":0.53100000000000003},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.876,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.439,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91600000000000004,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:03:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75,"15min":0.64800000000000002},"min":{"1min":0.57799999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.6739999999999999,"5min":10.161,"15min":10.161},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.70599999999999996,"15min":0.64400000000000002},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":6.8339999999999996,"5min":6.8339999999999996,"15min":6.8339999999999996},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.51400000000000001,"15min":0.498},"min":{"1min":0.34300000000000003,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.76200000000000001,"5min":1.012,"15min":1.012},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.33800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60699999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.85699999999999998,"15min":0.97399999999999998},"min":{"1min":0.42499999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84999999999999998,"5min":10.141,"15min":10.141},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.67900000000000005,"15min":0.66600000000000004},"min":{"1min":0.54400000000000004,"5min":0.435,"15min":0.435},"max":{"1min":0.95699999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.81799999999999995}]},{"osd":9,"last update":"Fri Sep 13 18:03:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.71699999999999997,"15min":0.69999999999999996},"min":{"1min":0.57899999999999996,"5min":0.37,"15min":0.37},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.68100000000000005},"min":{"1min":0.47099999999999997,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.56200000000000006}]},{"osd":10,"last update":"Fri Sep 13 18:02:40 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.40899999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69399999999999995,"15min":0.69599999999999995},"min":{"1min":0.39400000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.93400000000000005,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.57599999999999996}]},{"osd":11,"last update":"Fri Sep 13 18:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":983040,"data_stored":460890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59499999999999997,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.91100000000000003,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":1.1970000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57199999999999995,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85399999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":5.54}]},{"osd":2,"last update":"Fri Sep 13 18:02:18 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59699999999999998,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.88200000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.61199999999999999,"15min":0.58199999999999996},"min":{"1min":0.433,"5min":0.373,"15min":0.373},"max":{"1min":0.85099999999999998,"5min":1.012,"15min":1.012},"last":1.288}]},{"osd":3,"last update":"Fri Sep 13 18:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58299999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:03:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65900000000000003,"15min":0.61799999999999999},"min":{"1min":0.44700000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":1.242},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63900000000000001,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85599999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70699999999999996,"15min":0.67300000000000004},"min":{"1min":0.50900000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.67100000000000004,"15min":0.621},"min":{"1min":0.46000000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.93600000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.77700000000000002,"5min":1.165,"15min":1.165},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.72199999999999998,"15min":0.72099999999999997},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.022,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.41299999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79400000000000004,"15min":0.78200000000000003},"min":{"1min":0.64200000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.73299999999999998}]},{"osd":8,"last update":"Fri Sep 13 18:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.85199999999999998,"15min":0.88400000000000001},"min":{"1min":0.57999999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.087,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":5.5270000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78300000000000003,"15min":0.79300000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.006,"5min":1.04,"15min":1.04},"last":0.60499999999999998}]},{"osd":9,"last update":"Fri Sep 13 18:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.85299999999999998,"15min":0.874},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0009999999999999,"5min":1.103,"15min":1.103},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81399999999999995,"15min":0.83199999999999996},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.073,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.3140000000000001}]},{"osd":10,"last update":"Fri Sep 13 18:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.86199999999999999,"15min":0.88},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0669999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.327},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.90200000000000002,"15min":0.92000000000000004},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.026,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.755}]},{"osd":11,"last update":"Fri Sep 13 18:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0229999999999999,"5min":1.129,"15min":1.129},"last":5.5620000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.875,"15min":0.877},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.048,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.72599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":61344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":60255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:03:15.016 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T18:03:15.017 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:03:15.017 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:03:15.017 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T18:03:15.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:14 smithi122 ceph-mon[35310]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-13T18:03:15.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:14 smithi122 ceph-mon[35310]: from='client.24880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:03:15.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:14 smithi143 ceph-mon[38210]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-13T18:03:15.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:14 smithi143 ceph-mon[38210]: from='client.24880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:03:15.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:14 smithi027 ceph-mon[30611]: pgmap v337: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 426 B/s wr, 12 op/s 2024-09-13T18:03:15.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:14 smithi027 ceph-mon[30611]: from='client.24880 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T18:03:15.343 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:17.122 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:16 smithi027 ceph-mon[30611]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-13T18:03:17.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:16 smithi122 ceph-mon[35310]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-13T18:03:17.236 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.234+0000 7fabe3200640 1 -- 172.21.15.27:0/2599639864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabdc107330 msgr2=0x7fabdc10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:17.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.234+0000 7fabe3200640 1 --2- 172.21.15.27:0/2599639864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabdc107330 0x7fabdc10eeb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fabd4009cd0 tx=0x7fabd402a8e0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.234+0000 7fabe3200640 1 -- 172.21.15.27:0/2599639864 shutdown_connections 2024-09-13T18:03:17.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.234+0000 7fabe3200640 1 --2- 172.21.15.27:0/2599639864 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabdc107330 0x7fabdc10eeb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.234+0000 7fabe3200640 1 --2- 172.21.15.27:0/2599639864 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabdc102bb0 0x7fabdc106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.234+0000 7fabe3200640 1 --2- 172.21.15.27:0/2599639864 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabdc102200 0x7fabdc1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.234+0000 7fabe3200640 1 -- 172.21.15.27:0/2599639864 >> 172.21.15.27:0/2599639864 conn(0x7fabdc0fdc60 msgr2=0x7fabdc100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:17.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.234+0000 7fabe3200640 1 -- 172.21.15.27:0/2599639864 shutdown_connections 2024-09-13T18:03:17.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.234+0000 7fabe3200640 1 -- 172.21.15.27:0/2599639864 wait complete. 2024-09-13T18:03:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.235+0000 7fabe3200640 1 Processor -- start 2024-09-13T18:03:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabe3200640 1 -- start start 2024-09-13T18:03:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabe3200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabdc102200 0x7fabdc198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:17.239 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabe3200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabdc102bb0 0x7fabdc198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabe3200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabdc107330 0x7fabdc19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabe3200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc19d480 con 0x7fabdc107330 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabe3200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc19d5f0 con 0x7fabdc102bb0 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabe3200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabdc19d760 con 0x7fabdc102200 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabdb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabdc102bb0 0x7fabdc198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabdbe00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabdc102200 0x7fabdc198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabdb400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabdc102bb0 0x7fabdc198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:33044/0 (socket says 172.21.15.27:33044) 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabdb400640 1 -- 172.21.15.27:0/3735623206 learned_addr learned my addr 172.21.15.27:0/3735623206 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.236+0000 7fabe1200640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabdc107330 0x7fabdc19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabdb400640 1 -- 172.21.15.27:0/3735623206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabdc102200 msgr2=0x7fabdc198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:17.240 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabdb400640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabdc102200 0x7fabdc198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabdb400640 1 -- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabdc107330 msgr2=0x7fabdc19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabdb400640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabdc107330 0x7fabdc19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabdb400640 1 -- 172.21.15.27:0/3735623206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd4009900 con 0x7fabdc102bb0 2024-09-13T18:03:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabdb400640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabdc102bb0 0x7fabdc198a80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fabc800e9f0 tx=0x7fabc800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabd8c00640 1 -- 172.21.15.27:0/3735623206 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8009720 con 0x7fabdc102bb0 2024-09-13T18:03:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc19da40 con 0x7fabdc102bb0 2024-09-13T18:03:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabd8c00640 1 -- 172.21.15.27:0/3735623206 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fabc800cd80 con 0x7fabdc102bb0 2024-09-13T18:03:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabd8c00640 1 -- 172.21.15.27:0/3735623206 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8010690 con 0x7fabdc102bb0 2024-09-13T18:03:17.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.237+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabdc1a5300 con 0x7fabdc102bb0 2024-09-13T18:03:17.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.239+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc1036e0 con 0x7fabdc102bb0 2024-09-13T18:03:17.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.241+0000 7fabd8c00640 1 -- 172.21.15.27:0/3735623206 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fabc80046c0 con 0x7fabdc102bb0 2024-09-13T18:03:17.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.243+0000 7fabd8c00640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fabc00a1100 0x7fabc00a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:17.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.243+0000 7fabd8c00640 1 -- 172.21.15.27:0/3735623206 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fabc8014070 con 0x7fabdc102bb0 2024-09-13T18:03:17.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.243+0000 7fabdbe00640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fabc00a1100 0x7fabc00a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:17.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.243+0000 7fabdbe00640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fabc00a1100 0x7fabc00a35c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009bd0 tx=0x7fabcc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:17.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.244+0000 7fabd8c00640 1 -- 172.21.15.27:0/3735623206 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fabc8096530 con 0x7fabdc102bb0 2024-09-13T18:03:17.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:16 smithi143 ceph-mon[38210]: pgmap v338: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-13T18:03:17.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.460+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fabdc1025e0 con 0x7fabdc102bb0 2024-09-13T18:03:17.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.461+0000 7fabd8c00640 1 -- 172.21.15.27:0/3735623206 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fabc8099b50 con 0x7fabdc102bb0 2024-09-13T18:03:17.463 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:17.463 INFO:teuthology.orchestra.run.smithi027.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:03:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fabc00a1100 msgr2=0x7fabc00a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fabc00a1100 0x7fabc00a35c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fabcc009bd0 tx=0x7fabcc005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabdc102bb0 msgr2=0x7fabdc198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabdc102bb0 0x7fabdc198a80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fabc800e9f0 tx=0x7fabc800edf0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 shutdown_connections 2024-09-13T18:03:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fabc00a1100 0x7fabc00a35c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fabdc107330 0x7fabdc19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fabdc102bb0 0x7fabdc198a80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.466 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 --2- 172.21.15.27:0/3735623206 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fabdc102200 0x7fabdc198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:17.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 >> 172.21.15.27:0/3735623206 conn(0x7fabdc0fdc60 msgr2=0x7fabdc0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:17.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.464+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 shutdown_connections 2024-09-13T18:03:17.467 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:17.465+0000 7fabe3200640 1 -- 172.21.15.27:0/3735623206 wait complete. 2024-09-13T18:03:18.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:17 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3735623206' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T18:03:18.174 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:03:18.174 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:03:18.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:17 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3735623206' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T18:03:18.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:17 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3735623206' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T18:03:18.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.335+0000 7f9c68e00640 1 -- 172.21.15.27:0/1337630079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c64100820 msgr2=0x7f9c64102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.335+0000 7f9c68e00640 1 --2- 172.21.15.27:0/1337630079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c64100820 0x7f9c64102c10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9c54009860 tx=0x7f9c5402a340 comp rx=0 tx=0).stop 2024-09-13T18:03:18.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.336+0000 7f9c68e00640 1 -- 172.21.15.27:0/1337630079 shutdown_connections 2024-09-13T18:03:18.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.336+0000 7f9c68e00640 1 --2- 172.21.15.27:0/1337630079 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c64105a80 0x7f9c64107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.336+0000 7f9c68e00640 1 --2- 172.21.15.27:0/1337630079 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c64103150 0x7f9c64105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.336+0000 7f9c68e00640 1 --2- 172.21.15.27:0/1337630079 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c64100820 0x7f9c64102c10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.338 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.336+0000 7f9c68e00640 1 -- 172.21.15.27:0/1337630079 >> 172.21.15.27:0/1337630079 conn(0x7f9c640fa420 msgr2=0x7f9c640fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:18.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.336+0000 7f9c68e00640 1 -- 172.21.15.27:0/1337630079 shutdown_connections 2024-09-13T18:03:18.339 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.336+0000 7f9c68e00640 1 -- 172.21.15.27:0/1337630079 wait complete. 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c68e00640 1 Processor -- start 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c68e00640 1 -- start start 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c68e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c64100820 0x7f9c64198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c68e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c64103150 0x7f9c641986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c68e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c64105a80 0x7f9c6419f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c68e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6419fc50 con 0x7f9c64100820 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c68e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6419fdc0 con 0x7f9c64105a80 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c68e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6419ff80 con 0x7f9c64103150 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c61e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c64100820 0x7f9c64198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c61e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c64100820 0x7f9c64198160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49048/0 (socket says 172.21.15.27:49048) 2024-09-13T18:03:18.341 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.337+0000 7f9c61e00640 1 -- 172.21.15.27:0/2763662897 learned_addr learned my addr 172.21.15.27:0/2763662897 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c62800640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c64105a80 0x7f9c6419f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c61400640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c64103150 0x7f9c641986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c61e00640 1 -- 172.21.15.27:0/2763662897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c64103150 msgr2=0x7f9c641986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c61e00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c64103150 0x7f9c641986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c61e00640 1 -- 172.21.15.27:0/2763662897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c64105a80 msgr2=0x7f9c6419f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c61e00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c64105a80 0x7f9c6419f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c61e00640 1 -- 172.21.15.27:0/2763662897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c54009490 con 0x7f9c64100820 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c62800640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c64105a80 0x7f9c6419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c61e00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c64100820 0x7f9c64198160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9c54035040 tx=0x7f9c54032440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c5aa00640 1 -- 172.21.15.27:0/2763662897 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5403f070 con 0x7f9c64100820 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c641a0200 con 0x7f9c64100820 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.338+0000 7f9c5aa00640 1 -- 172.21.15.27:0/2763662897 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9c54004050 con 0x7f9c64100820 2024-09-13T18:03:18.342 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.339+0000 7f9c5aa00640 1 -- 172.21.15.27:0/2763662897 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540046c0 con 0x7f9c64100820 2024-09-13T18:03:18.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.339+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c641a06a0 con 0x7f9c64100820 2024-09-13T18:03:18.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.340+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c641075f0 con 0x7f9c64100820 2024-09-13T18:03:18.343 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.342+0000 7f9c5aa00640 1 -- 172.21.15.27:0/2763662897 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9c54039040 con 0x7f9c64100820 2024-09-13T18:03:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.343+0000 7f9c5aa00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c480a1110 0x7f9c480a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.343+0000 7f9c5aa00640 1 -- 172.21.15.27:0/2763662897 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9c540ec7c0 con 0x7f9c64100820 2024-09-13T18:03:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.343+0000 7f9c61400640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c480a1110 0x7f9c480a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:18.345 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.344+0000 7f9c61400640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c480a1110 0x7f9c480a35d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9c64199670 tx=0x7f9c50009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:18.348 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.347+0000 7f9c5aa00640 1 -- 172.21.15.27:0/2763662897 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f9c540b5f00 con 0x7f9c64100820 2024-09-13T18:03:18.533 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.532+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c64107060 con 0x7f9c64100820 2024-09-13T18:03:18.535 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.533+0000 7f9c5aa00640 1 -- 172.21.15.27:0/2763662897 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f9c54037090 con 0x7f9c64100820 2024-09-13T18:03:18.535 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:18.536 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":88,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:02:37.160677+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.535+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c480a1110 msgr2=0x7f9c480a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.535+0000 7f9c68e00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c480a1110 0x7f9c480a35d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9c64199670 tx=0x7f9c50009260 comp rx=0 tx=0).stop 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.535+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c64100820 msgr2=0x7f9c64198160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.535+0000 7f9c68e00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c64100820 0x7f9c64198160 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9c54035040 tx=0x7f9c54032440 comp rx=0 tx=0).stop 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.536+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 shutdown_connections 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.536+0000 7f9c68e00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f9c480a1110 0x7f9c480a35d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.536+0000 7f9c68e00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f9c64105a80 0x7f9c6419f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.536+0000 7f9c68e00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f9c64103150 0x7f9c641986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.536+0000 7f9c68e00640 1 --2- 172.21.15.27:0/2763662897 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f9c64100820 0x7f9c64198160 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.536+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 >> 172.21.15.27:0/2763662897 conn(0x7f9c640fa420 msgr2=0x7f9c64100020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.536+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 shutdown_connections 2024-09-13T18:03:18.538 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.536+0000 7f9c68e00640 1 -- 172.21.15.27:0/2763662897 wait complete. 2024-09-13T18:03:18.554 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:57:10.088488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:01:44.492835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:01:45.883650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:03:18.554 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:03:18.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.715+0000 7f98ff200640 1 -- 172.21.15.27:0/2191762987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8101f20 msgr2=0x7f98f8102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.715+0000 7f98ff200640 1 --2- 172.21.15.27:0/2191762987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8101f20 0x7f98f8102340 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009900 tx=0x7f98e802a410 comp rx=0 tx=0).stop 2024-09-13T18:03:18.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.715+0000 7f98ff200640 1 -- 172.21.15.27:0/2191762987 shutdown_connections 2024-09-13T18:03:18.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.715+0000 7f98ff200640 1 --2- 172.21.15.27:0/2191762987 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f8103ab0 0x7f98f810a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.717 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.715+0000 7f98ff200640 1 --2- 172.21.15.27:0/2191762987 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f81030f0 0x7f98f8103570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.715+0000 7f98ff200640 1 --2- 172.21.15.27:0/2191762987 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8101f20 0x7f98f8102340 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.715+0000 7f98ff200640 1 -- 172.21.15.27:0/2191762987 >> 172.21.15.27:0/2191762987 conn(0x7f98f80fd6f0 msgr2=0x7f98f80ffb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:18.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.715+0000 7f98ff200640 1 -- 172.21.15.27:0/2191762987 shutdown_connections 2024-09-13T18:03:18.718 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.715+0000 7f98ff200640 1 -- 172.21.15.27:0/2191762987 wait complete. 2024-09-13T18:03:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.716+0000 7f98ff200640 1 Processor -- start 2024-09-13T18:03:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.716+0000 7f98ff200640 1 -- start start 2024-09-13T18:03:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.716+0000 7f98ff200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f8101f20 0x7f98f8198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.716+0000 7f98ff200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f81030f0 0x7f98f81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.716+0000 7f98ff200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8103ab0 0x7f98f819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.716+0000 7f98ff200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f819fb60 con 0x7f98f8103ab0 2024-09-13T18:03:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.716+0000 7f98ff200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f819fcd0 con 0x7f98f8101f20 2024-09-13T18:03:18.720 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.716+0000 7f98ff200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f819fe90 con 0x7f98f81030f0 2024-09-13T18:03:18.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98fd200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8103ab0 0x7f98f819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:18.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98fd200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8103ab0 0x7f98f819f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49078/0 (socket says 172.21.15.27:49078) 2024-09-13T18:03:18.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98fd200640 1 -- 172.21.15.27:0/3603576714 learned_addr learned my addr 172.21.15.27:0/3603576714 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:18.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98f7e00640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f8101f20 0x7f98f8198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:18.721 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98efe00640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f81030f0 0x7f98f81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:18.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98fd200640 1 -- 172.21.15.27:0/3603576714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f81030f0 msgr2=0x7f98f81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98fd200640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f81030f0 0x7f98f81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98fd200640 1 -- 172.21.15.27:0/3603576714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f8101f20 msgr2=0x7f98f8198070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.722 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98fd200640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f8101f20 0x7f98f8198070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98fd200640 1 -- 172.21.15.27:0/3603576714 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e8009560 con 0x7f98f8103ab0 2024-09-13T18:03:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98f7e00640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f8101f20 0x7f98f8198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.717+0000 7f98fd200640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8103ab0 0x7f98f819f620 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f98f000eb10 tx=0x7f98f000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.718+0000 7f98f5600640 1 -- 172.21.15.27:0/3603576714 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0004b20 con 0x7f98f8103ab0 2024-09-13T18:03:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.718+0000 7f98f5600640 1 -- 172.21.15.27:0/3603576714 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f98f0004c80 con 0x7f98f8103ab0 2024-09-13T18:03:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.718+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f81a0170 con 0x7f98f8103ab0 2024-09-13T18:03:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.718+0000 7f98f5600640 1 -- 172.21.15.27:0/3603576714 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0010650 con 0x7f98f8103ab0 2024-09-13T18:03:18.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.718+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f81a06d0 con 0x7f98f8103ab0 2024-09-13T18:03:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.719+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f8109420 con 0x7f98f8103ab0 2024-09-13T18:03:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.721+0000 7f98f5600640 1 -- 172.21.15.27:0/3603576714 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f98f0005020 con 0x7f98f8103ab0 2024-09-13T18:03:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.722+0000 7f98f5600640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f98dc0a1110 0x7f98dc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.722+0000 7f98f5600640 1 -- 172.21.15.27:0/3603576714 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f98f0014070 con 0x7f98f8103ab0 2024-09-13T18:03:18.724 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.722+0000 7f98f7e00640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f98dc0a1110 0x7f98dc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:18.725 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.723+0000 7f98f7e00640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f98dc0a1110 0x7f98dc0a35d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009230 tx=0x7f98e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:18.728 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.726+0000 7f98f5600640 1 -- 172.21.15.27:0/3603576714 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f98f0096570 con 0x7f98f8103ab0 2024-09-13T18:03:18.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.907+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98f802c3e0 con 0x7f98f8103ab0 2024-09-13T18:03:18.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.907+0000 7f98f5600640 1 -- 172.21.15.27:0/3603576714 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f98f0099b90 con 0x7f98f8103ab0 2024-09-13T18:03:18.909 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-13T18:03:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f98dc0a1110 msgr2=0x7f98dc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f98dc0a1110 0x7f98dc0a35d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009230 tx=0x7f98e8005a20 comp rx=0 tx=0).stop 2024-09-13T18:03:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8103ab0 msgr2=0x7f98f819f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8103ab0 0x7f98f819f620 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f98f000eb10 tx=0x7f98f000c2d0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 shutdown_connections 2024-09-13T18:03:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f98dc0a1110 0x7f98dc0a35d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f98f8103ab0 0x7f98f819f620 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f98f81030f0 0x7f98f81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 --2- 172.21.15.27:0/3603576714 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f98f8101f20 0x7f98f8198070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 >> 172.21.15.27:0/3603576714 conn(0x7f98f80fd6f0 msgr2=0x7f98f81065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 shutdown_connections 2024-09-13T18:03:18.914 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:18.910+0000 7f98ff200640 1 -- 172.21.15.27:0/3603576714 wait complete. 2024-09-13T18:03:18.930 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.093+0000 7effa2600640 1 -- 172.21.15.27:0/726505795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff9c103080 msgr2=0x7eff9c103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.093+0000 7effa2600640 1 --2- 172.21.15.27:0/726505795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff9c103080 0x7eff9c103500 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff88009860 tx=0x7eff8802a340 comp rx=0 tx=0).stop 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.093+0000 7effa2600640 1 -- 172.21.15.27:0/726505795 shutdown_connections 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.093+0000 7effa2600640 1 --2- 172.21.15.27:0/726505795 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff9c103a40 0x7eff9c10a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.093+0000 7effa2600640 1 --2- 172.21.15.27:0/726505795 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff9c103080 0x7eff9c103500 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.093+0000 7effa2600640 1 --2- 172.21.15.27:0/726505795 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff9c101ea0 0x7eff9c1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.093+0000 7effa2600640 1 -- 172.21.15.27:0/726505795 >> 172.21.15.27:0/726505795 conn(0x7eff9c0fd670 msgr2=0x7eff9c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.093+0000 7effa2600640 1 -- 172.21.15.27:0/726505795 shutdown_connections 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.093+0000 7effa2600640 1 -- 172.21.15.27:0/726505795 wait complete. 2024-09-13T18:03:19.098 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa2600640 1 Processor -- start 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa2600640 1 -- start start 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa2600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff9c101ea0 0x7eff9c197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa2600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff9c103080 0x7eff9c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa2600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff9c103a40 0x7eff9c19f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa2600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c19fac0 con 0x7eff9c101ea0 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa2600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c19fc30 con 0x7eff9c103a40 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa2600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c19fdf0 con 0x7eff9c103080 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa1200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff9c101ea0 0x7eff9c197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa1200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff9c101ea0 0x7eff9c197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49094/0 (socket says 172.21.15.27:49094) 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7effa1200640 1 -- 172.21.15.27:0/1710090883 learned_addr learned my addr 172.21.15.27:0/1710090883 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.094+0000 7eff9be00640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff9c103080 0x7eff9c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa1c00640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff9c103a40 0x7eff9c19f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.099 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa1200640 1 -- 172.21.15.27:0/1710090883 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff9c103080 msgr2=0x7eff9c198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa1200640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff9c103080 0x7eff9c198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa1200640 1 -- 172.21.15.27:0/1710090883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff9c103a40 msgr2=0x7eff9c19f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa1200640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff9c103a40 0x7eff9c19f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa1200640 1 -- 172.21.15.27:0/1710090883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff88009490 con 0x7eff9c101ea0 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa1c00640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff9c103a40 0x7eff9c19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa1200640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff9c101ea0 0x7eff9c197fd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7eff9000e9c0 tx=0x7eff9000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7eff99600640 1 -- 172.21.15.27:0/1710090883 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff900096e0 con 0x7eff9c101ea0 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7eff99600640 1 -- 172.21.15.27:0/1710090883 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7eff9000cd80 con 0x7eff9c101ea0 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c1a00d0 con 0x7eff9c101ea0 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7eff99600640 1 -- 172.21.15.27:0/1710090883 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90010430 con 0x7eff9c101ea0 2024-09-13T18:03:19.100 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.095+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c1a05b0 con 0x7eff9c101ea0 2024-09-13T18:03:19.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.096+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c1093b0 con 0x7eff9c101ea0 2024-09-13T18:03:19.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.098+0000 7eff99600640 1 -- 172.21.15.27:0/1710090883 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7eff90003680 con 0x7eff9c101ea0 2024-09-13T18:03:19.101 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.099+0000 7eff99600640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7eff840a1110 0x7eff840a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.100+0000 7eff99600640 1 -- 172.21.15.27:0/1710090883 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7eff90014070 con 0x7eff9c101ea0 2024-09-13T18:03:19.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.100+0000 7eff9be00640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7eff840a1110 0x7eff840a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.101+0000 7eff9be00640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7eff840a1110 0x7eff840a35d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7eff88009830 tx=0x7eff88030660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:19.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.103+0000 7eff99600640 1 -- 172.21.15.27:0/1710090883 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7eff90096450 con 0x7eff9c101ea0 2024-09-13T18:03:19.177 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:18 smithi143 ceph-mon[38210]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-13T18:03:19.177 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:18 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2763662897' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:19.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:18 smithi122 ceph-mon[35310]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-13T18:03:19.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:18 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2763662897' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:19.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.285+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff9c108e20 con 0x7eff9c101ea0 2024-09-13T18:03:19.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.285+0000 7eff99600640 1 -- 172.21.15.27:0/1710090883 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff90099a70 con 0x7eff9c101ea0 2024-09-13T18:03:19.287 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-09-13T18:03:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7eff840a1110 msgr2=0x7eff840a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7eff840a1110 0x7eff840a35d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7eff88009830 tx=0x7eff88030660 comp rx=0 tx=0).stop 2024-09-13T18:03:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff9c101ea0 msgr2=0x7eff9c197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff9c101ea0 0x7eff9c197fd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7eff9000e9c0 tx=0x7eff9000ee80 comp rx=0 tx=0).stop 2024-09-13T18:03:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 shutdown_connections 2024-09-13T18:03:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7eff840a1110 0x7eff840a35d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.290 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7eff9c103a40 0x7eff9c19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7eff9c103080 0x7eff9c198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 --2- 172.21.15.27:0/1710090883 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7eff9c101ea0 0x7eff9c197fd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 >> 172.21.15.27:0/1710090883 conn(0x7eff9c0fd670 msgr2=0x7eff9c106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:19.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 shutdown_connections 2024-09-13T18:03:19.291 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.288+0000 7effa2600640 1 -- 172.21.15.27:0/1710090883 wait complete. 2024-09-13T18:03:19.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:18 smithi027 ceph-mon[30611]: pgmap v339: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-13T18:03:19.304 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:18 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2763662897' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:19.306 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:03:19.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.467+0000 7fe6fb000640 1 -- 172.21.15.27:0/1072980647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40ff8c0 msgr2=0x7fe6f40ffd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.467+0000 7fe6fb000640 1 --2- 172.21.15.27:0/1072980647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40ff8c0 0x7fe6f40ffd70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec009ca0 tx=0x7fe6ec02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.467+0000 7fe6fb000640 1 -- 172.21.15.27:0/1072980647 shutdown_connections 2024-09-13T18:03:19.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.467+0000 7fe6fb000640 1 --2- 172.21.15.27:0/1072980647 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40ff8c0 0x7fe6f40ffd70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.467+0000 7fe6fb000640 1 --2- 172.21.15.27:0/1072980647 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f40fef20 0x7fe6f40ff380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.467+0000 7fe6fb000640 1 --2- 172.21.15.27:0/1072980647 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6f40fe5e0 0x7fe6f40fe9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.467+0000 7fe6fb000640 1 -- 172.21.15.27:0/1072980647 >> 172.21.15.27:0/1072980647 conn(0x7fe6f40fa3d0 msgr2=0x7fe6f40fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:19.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.468+0000 7fe6fb000640 1 -- 172.21.15.27:0/1072980647 shutdown_connections 2024-09-13T18:03:19.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.468+0000 7fe6fb000640 1 -- 172.21.15.27:0/1072980647 wait complete. 2024-09-13T18:03:19.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.468+0000 7fe6fb000640 1 Processor -- start 2024-09-13T18:03:19.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6fb000640 1 -- start start 2024-09-13T18:03:19.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6fb000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40fe5e0 0x7fe6f4198010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6fb000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f40fef20 0x7fe6f4198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6fb000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6f40ff8c0 0x7fe6f419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6fb000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f419fb00 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6fb000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f419fc70 con 0x7fe6f40ff8c0 2024-09-13T18:03:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6fb000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f419fe30 con 0x7fe6f40fef20 2024-09-13T18:03:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6f3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40fe5e0 0x7fe6f4198010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6f9000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6f40ff8c0 0x7fe6f419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6f3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40fe5e0 0x7fe6f4198010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49108/0 (socket says 172.21.15.27:49108) 2024-09-13T18:03:19.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6f9000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6f40ff8c0 0x7fe6f419f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:33116/0 (socket says 172.21.15.27:33116) 2024-09-13T18:03:19.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6f3e00640 1 -- 172.21.15.27:0/4095242099 learned_addr learned my addr 172.21.15.27:0/4095242099 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:19.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.469+0000 7fe6f3400640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f40fef20 0x7fe6f4198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.477 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f3e00640 1 -- 172.21.15.27:0/4095242099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f40fef20 msgr2=0x7fe6f4198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f3e00640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f40fef20 0x7fe6f4198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f3e00640 1 -- 172.21.15.27:0/4095242099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6f40ff8c0 msgr2=0x7fe6f419f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f3e00640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6f40ff8c0 0x7fe6f419f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f3e00640 1 -- 172.21.15.27:0/4095242099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e4009490 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f3400640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f40fef20 0x7fe6f4198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:19.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f3e00640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40fe5e0 0x7fe6f4198010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400ea60 tx=0x7fe6e400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:19.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f0c00640 1 -- 172.21.15.27:0/4095242099 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e400cde0 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f0c00640 1 -- 172.21.15.27:0/4095242099 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe6e40035f0 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6ec009900 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6f0c00640 1 -- 172.21.15.27:0/4095242099 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4010690 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.470+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f41a0490 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.471+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f41094d0 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.473+0000 7fe6f0c00640 1 -- 172.21.15.27:0/4095242099 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe6e4003af0 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.474+0000 7fe6f0c00640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe6d80a1090 0x7fe6d80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.475+0000 7fe6f0c00640 1 -- 172.21.15.27:0/4095242099 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe6e4014070 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.475+0000 7fe6f3400640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe6d80a1090 0x7fe6d80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.482 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.475+0000 7fe6f3400640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe6d80a1090 0x7fe6d80a3550 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4199520 tx=0x7fe6e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:19.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.478+0000 7fe6f0c00640 1 -- 172.21.15.27:0/4095242099 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe6e40964e0 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.660+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6f410d980 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.660+0000 7fe6f0c00640 1 -- 172.21.15.27:0/4095242099 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6e4099b00 con 0x7fe6f40fe5e0 2024-09-13T18:03:19.662 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-09-13T18:03:19.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe6d80a1090 msgr2=0x7fe6d80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe6d80a1090 0x7fe6d80a3550 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4199520 tx=0x7fe6e0005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40fe5e0 msgr2=0x7fe6f4198010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40fe5e0 0x7fe6f4198010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400ea60 tx=0x7fe6e400ef20 comp rx=0 tx=0).stop 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 shutdown_connections 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe6d80a1090 0x7fe6d80a3550 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe6f40ff8c0 0x7fe6f419f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe6f40fef20 0x7fe6f4198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 --2- 172.21.15.27:0/4095242099 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe6f40fe5e0 0x7fe6f4198010 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.662+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 >> 172.21.15.27:0/4095242099 conn(0x7fe6f40fa3d0 msgr2=0x7fe6f40fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.663+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 shutdown_connections 2024-09-13T18:03:19.665 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.663+0000 7fe6fb000640 1 -- 172.21.15.27:0/4095242099 wait complete. 2024-09-13T18:03:19.680 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:03:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.837+0000 7fa1f8e00640 1 -- 172.21.15.27:0/3939581025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 msgr2=0x7fa1f4103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.837+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/3939581025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 0x7fa1f4103420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009900 tx=0x7fa1dc02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.838+0000 7fa1f8e00640 1 -- 172.21.15.27:0/3939581025 shutdown_connections 2024-09-13T18:03:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.838+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/3939581025 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1f4103960 0x7fa1f410a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.838+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/3939581025 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 0x7fa1f4103420 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.838+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/3939581025 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1f4101db0 0x7fa1f41021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.838+0000 7fa1f8e00640 1 -- 172.21.15.27:0/3939581025 >> 172.21.15.27:0/3939581025 conn(0x7fa1f40fd530 msgr2=0x7fa1f40ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.838+0000 7fa1f8e00640 1 -- 172.21.15.27:0/3939581025 shutdown_connections 2024-09-13T18:03:19.840 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.838+0000 7fa1f8e00640 1 -- 172.21.15.27:0/3939581025 wait complete. 2024-09-13T18:03:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f8e00640 1 Processor -- start 2024-09-13T18:03:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f8e00640 1 -- start start 2024-09-13T18:03:19.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f8e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1f4101db0 0x7fa1f4197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f8e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 0x7fa1f41983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f8e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1f4103960 0x7fa1f419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f8e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f419f960 con 0x7fa1f4102fa0 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f8e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f419fad0 con 0x7fa1f4103960 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f8e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f419fc90 con 0x7fa1f4101db0 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1ebe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 0x7fa1f41983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1ebe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 0x7fa1f41983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:49122/0 (socket says 172.21.15.27:49122) 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1ebe00640 1 -- 172.21.15.27:0/1425331442 learned_addr learned my addr 172.21.15.27:0/1425331442 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f3400640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1f4101db0 0x7fa1f4197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.839+0000 7fa1f3e00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1f4103960 0x7fa1f419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1ebe00640 1 -- 172.21.15.27:0/1425331442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1f4101db0 msgr2=0x7fa1f4197e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1ebe00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1f4101db0 0x7fa1f4197e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1ebe00640 1 -- 172.21.15.27:0/1425331442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1f4103960 msgr2=0x7fa1f419f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:19.843 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1ebe00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1f4103960 0x7fa1f419f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1ebe00640 1 -- 172.21.15.27:0/1425331442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc009560 con 0x7fa1f4102fa0 2024-09-13T18:03:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1f3400640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1f4101db0 0x7fa1f4197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1ebe00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 0x7fa1f41983b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc031510 tx=0x7fa1dc005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1f0c00640 1 -- 172.21.15.27:0/1425331442 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc004c50 con 0x7fa1f4102fa0 2024-09-13T18:03:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1f0c00640 1 -- 172.21.15.27:0/1425331442 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa1dc004db0 con 0x7fa1f4102fa0 2024-09-13T18:03:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1f0c00640 1 -- 172.21.15.27:0/1425331442 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc031cf0 con 0x7fa1f4102fa0 2024-09-13T18:03:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f419ff10 con 0x7fa1f4102fa0 2024-09-13T18:03:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.840+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f41a02e0 con 0x7fa1f4102fa0 2024-09-13T18:03:19.844 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.842+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f4109240 con 0x7fa1f4102fa0 2024-09-13T18:03:19.845 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.843+0000 7fa1f0c00640 1 -- 172.21.15.27:0/1425331442 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa1dc0035f0 con 0x7fa1f4102fa0 2024-09-13T18:03:19.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.845+0000 7fa1f0c00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1d80a1110 0x7fa1d80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:19.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.845+0000 7fa1f0c00640 1 -- 172.21.15.27:0/1425331442 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa1dc0ed860 con 0x7fa1f4102fa0 2024-09-13T18:03:19.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.845+0000 7fa1f3400640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1d80a1110 0x7fa1d80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:19.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.846+0000 7fa1f3400640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1d80a1110 0x7fa1d80a35d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40058c0 tx=0x7fa1e4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:19.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:19.849+0000 7fa1f0c00640 1 -- 172.21.15.27:0/1425331442 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa1dc0b6fa0 con 0x7fa1f4102fa0 2024-09-13T18:03:20.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:19 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3603576714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:20.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:19 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1710090883' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:20.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:19 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/4095242099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:20.067 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.065+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1f410d840 con 0x7fa1f4102fa0 2024-09-13T18:03:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.066+0000 7fa1f0c00640 1 -- 172.21.15.27:0/1425331442 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10916 (secure 0 0 0) 0x7fa1dc0ba5c0 con 0x7fa1f4102fa0 2024-09-13T18:03:20.068 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:20.068 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:01:46.320502+0000","modified":"2024-09-13T18:01:53.056677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24556,"mds_2":24533,"mds_3":24529,"mds_4":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24448":{"gid":24448,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24529":{"gid":24529,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24556":{"gid":24556,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/1102491877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1102491877},{"type":"v1","addr":"172.21.15.122:6839","nonce":1102491877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:03:20.068 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 26 2024-09-13T18:03:20.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1d80a1110 msgr2=0x7fa1d80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1d80a1110 0x7fa1d80a35d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40058c0 tx=0x7fa1e4005850 comp rx=0 tx=0).stop 2024-09-13T18:03:20.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 msgr2=0x7fa1f41983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 0x7fa1f41983b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc031510 tx=0x7fa1dc005690 comp rx=0 tx=0).stop 2024-09-13T18:03:20.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 shutdown_connections 2024-09-13T18:03:20.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1d80a1110 0x7fa1d80a35d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa1f4103960 0x7fa1f419f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.070 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa1f4102fa0 0x7fa1f41983b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 --2- 172.21.15.27:0/1425331442 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa1f4101db0 0x7fa1f4197e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 >> 172.21.15.27:0/1425331442 conn(0x7fa1f40fd530 msgr2=0x7fa1f4106410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:20.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 shutdown_connections 2024-09-13T18:03:20.071 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.068+0000 7fa1f8e00640 1 -- 172.21.15.27:0/1425331442 wait complete. 2024-09-13T18:03:20.087 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:03:20.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:19 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3603576714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:20.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:19 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1710090883' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:20.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:19 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/4095242099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:20.247 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.245+0000 7f0f62a00640 1 -- 172.21.15.27:0/462913353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 msgr2=0x7f0f5c1081c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.245+0000 7f0f62a00640 1 --2- 172.21.15.27:0/462913353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 0x7f0f5c1081c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009900 tx=0x7f0f5402a410 comp rx=0 tx=0).stop 2024-09-13T18:03:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.245+0000 7f0f62a00640 1 -- 172.21.15.27:0/462913353 shutdown_connections 2024-09-13T18:03:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.245+0000 7f0f62a00640 1 --2- 172.21.15.27:0/462913353 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 0x7f0f5c1081c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.245+0000 7f0f62a00640 1 --2- 172.21.15.27:0/462913353 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f5c100f70 0x7f0f5c1013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.245+0000 7f0f62a00640 1 --2- 172.21.15.27:0/462913353 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c0ffd80 0x7f0f5c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.245+0000 7f0f62a00640 1 -- 172.21.15.27:0/462913353 >> 172.21.15.27:0/462913353 conn(0x7f0f5c0fb500 msgr2=0x7f0f5c0fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.245+0000 7f0f62a00640 1 -- 172.21.15.27:0/462913353 shutdown_connections 2024-09-13T18:03:20.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.245+0000 7f0f62a00640 1 -- 172.21.15.27:0/462913353 wait complete. 2024-09-13T18:03:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.246+0000 7f0f62a00640 1 Processor -- start 2024-09-13T18:03:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.246+0000 7f0f62a00640 1 -- start start 2024-09-13T18:03:20.250 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f62a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c0ffd80 0x7f0f5c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f62a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f5c100f70 0x7f0f5c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f62a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 0x7f0f5c19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f62a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c19fb10 con 0x7f0f5c101930 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f62a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c19fc80 con 0x7f0f5c0ffd80 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f62a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c19fe40 con 0x7f0f5c100f70 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f60a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 0x7f0f5c19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f53400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f5c100f70 0x7f0f5c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f53400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f5c100f70 0x7f0f5c198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:44250/0 (socket says 172.21.15.27:44250) 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f60a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 0x7f0f5c19f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57854/0 (socket says 172.21.15.27:57854) 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f53400640 1 -- 172.21.15.27:0/3191896930 learned_addr learned my addr 172.21.15.27:0/3191896930 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f5be00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c0ffd80 0x7f0f5c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f53400640 1 -- 172.21.15.27:0/3191896930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c0ffd80 msgr2=0x7f0f5c198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f53400640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c0ffd80 0x7f0f5c198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f53400640 1 -- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 msgr2=0x7f0f5c19f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f53400640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 0x7f0f5c19f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f53400640 1 -- 172.21.15.27:0/3191896930 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f54009560 con 0x7f0f5c100f70 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.247+0000 7f0f60a00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 0x7f0f5c19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.248+0000 7f0f53400640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f5c100f70 0x7f0f5c198560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400e9f0 tx=0x7f0f4400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.248+0000 7f0f59600640 1 -- 172.21.15.27:0/3191896930 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44009700 con 0x7f0f5c100f70 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.248+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c1a0120 con 0x7f0f5c100f70 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.248+0000 7f0f59600640 1 -- 172.21.15.27:0/3191896930 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0f4400cd80 con 0x7f0f5c100f70 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.248+0000 7f0f59600640 1 -- 172.21.15.27:0/3191896930 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44018920 con 0x7f0f5c100f70 2024-09-13T18:03:20.252 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.248+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c1a0630 con 0x7f0f5c100f70 2024-09-13T18:03:20.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.249+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c10b810 con 0x7f0f5c100f70 2024-09-13T18:03:20.253 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.251+0000 7f0f59600640 1 -- 172.21.15.27:0/3191896930 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0f44018a80 con 0x7f0f5c100f70 2024-09-13T18:03:20.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.252+0000 7f0f59600640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0f400a1090 0x7f0f400a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:20.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.253+0000 7f0f59600640 1 -- 172.21.15.27:0/3191896930 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0f44014070 con 0x7f0f5c100f70 2024-09-13T18:03:20.254 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.253+0000 7f0f5be00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0f400a1090 0x7f0f400a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:20.255 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.253+0000 7f0f5be00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0f400a1090 0x7f0f400a3550 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c100dd0 tx=0x7f0f4c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:20.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.256+0000 7f0f59600640 1 -- 172.21.15.27:0/3191896930 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0f44052e20 con 0x7f0f5c100f70 2024-09-13T18:03:20.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:19 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3603576714' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:20.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:19 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1710090883' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:20.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:19 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/4095242099' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:20.443 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.441+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f5c10b9a0 con 0x7f0f5c100f70 2024-09-13T18:03:20.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.443+0000 7f0f59600640 1 -- 172.21.15.27:0/3191896930 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f0f440964e0 con 0x7f0f5c100f70 2024-09-13T18:03:20.445 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:20.445 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":88,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:02:37.160677+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:03:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0f400a1090 msgr2=0x7f0f400a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0f400a1090 0x7f0f400a3550 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c100dd0 tx=0x7f0f4c009500 comp rx=0 tx=0).stop 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f5c100f70 msgr2=0x7f0f5c198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f5c100f70 0x7f0f5c198560 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400e9f0 tx=0x7f0f4400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 shutdown_connections 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f0f400a1090 0x7f0f400a3550 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0f5c101930 0x7f0f5c19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0f5c100f70 0x7f0f5c198560 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 --2- 172.21.15.27:0/3191896930 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0f5c0ffd80 0x7f0f5c198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.445+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 >> 172.21.15.27:0/3191896930 conn(0x7f0f5c0fb500 msgr2=0x7f0f5c0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.446+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 shutdown_connections 2024-09-13T18:03:20.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.446+0000 7f0f62a00640 1 -- 172.21.15.27:0/3191896930 wait complete. 2024-09-13T18:03:20.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:57:10.088488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:01:44.492835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:01:45.883650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:03:20.465 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:03:20.626 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.624+0000 7fe203200640 1 -- 172.21.15.27:0/3255926252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204102f80 msgr2=0x7fe204103400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.624+0000 7fe203200640 1 --2- 172.21.15.27:0/3255926252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204102f80 0x7fe204103400 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009900 tx=0x7fe1ec02a400 comp rx=0 tx=0).stop 2024-09-13T18:03:20.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.624+0000 7fe203200640 1 -- 172.21.15.27:0/3255926252 shutdown_connections 2024-09-13T18:03:20.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.624+0000 7fe203200640 1 --2- 172.21.15.27:0/3255926252 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe204103940 0x7fe20410a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.624+0000 7fe203200640 1 --2- 172.21.15.27:0/3255926252 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204102f80 0x7fe204103400 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.624+0000 7fe203200640 1 --2- 172.21.15.27:0/3255926252 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe204101e30 0x7fe204102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.624+0000 7fe203200640 1 -- 172.21.15.27:0/3255926252 >> 172.21.15.27:0/3255926252 conn(0x7fe2040fd5b0 msgr2=0x7fe2040ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:20.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.624+0000 7fe203200640 1 -- 172.21.15.27:0/3255926252 shutdown_connections 2024-09-13T18:03:20.627 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.624+0000 7fe203200640 1 -- 172.21.15.27:0/3255926252 wait complete. 2024-09-13T18:03:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.625+0000 7fe203200640 1 Processor -- start 2024-09-13T18:03:20.630 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.625+0000 7fe203200640 1 -- start start 2024-09-13T18:03:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe203200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204101e30 0x7fe204197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe203200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe204102f80 0x7fe204198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe203200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe204103940 0x7fe20419f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe203200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20419fa10 con 0x7fe204101e30 2024-09-13T18:03:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe203200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20419fb80 con 0x7fe204102f80 2024-09-13T18:03:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe203200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20419fd40 con 0x7fe204103940 2024-09-13T18:03:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe201e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204101e30 0x7fe204197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:20.631 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe202800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe204103940 0x7fe20419f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe201e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204101e30 0x7fe204197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57874/0 (socket says 172.21.15.27:57874) 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe201e00640 1 -- 172.21.15.27:0/755156432 learned_addr learned my addr 172.21.15.27:0/755156432 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe1f9400640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe204102f80 0x7fe204198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe201e00640 1 -- 172.21.15.27:0/755156432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe204103940 msgr2=0x7fe20419f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe201e00640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe204103940 0x7fe20419f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe201e00640 1 -- 172.21.15.27:0/755156432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe204102f80 msgr2=0x7fe204198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe201e00640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe204102f80 0x7fe204198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe201e00640 1 -- 172.21.15.27:0/755156432 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ec009560 con 0x7fe204101e30 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.626+0000 7fe1f9400640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe204102f80 0x7fe204198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.627+0000 7fe201e00640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204101e30 0x7fe204197f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400e9f0 tx=0x7fe1f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.627+0000 7fe1fb400640 1 -- 172.21.15.27:0/755156432 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4009720 con 0x7fe204101e30 2024-09-13T18:03:20.632 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.627+0000 7fe1fb400640 1 -- 172.21.15.27:0/755156432 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe1f400cd80 con 0x7fe204101e30 2024-09-13T18:03:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.627+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20419ffc0 con 0x7fe204101e30 2024-09-13T18:03:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.627+0000 7fe1fb400640 1 -- 172.21.15.27:0/755156432 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4010690 con 0x7fe204101e30 2024-09-13T18:03:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.627+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2041a0440 con 0x7fe204101e30 2024-09-13T18:03:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.628+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2041091e0 con 0x7fe204101e30 2024-09-13T18:03:20.633 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.630+0000 7fe1fb400640 1 -- 172.21.15.27:0/755156432 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe1f40046c0 con 0x7fe204101e30 2024-09-13T18:03:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.631+0000 7fe1fb400640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe1e80a1110 0x7fe1e80a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.631+0000 7fe1fb400640 1 -- 172.21.15.27:0/755156432 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe1f4014070 con 0x7fe204101e30 2024-09-13T18:03:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.632+0000 7fe1f9400640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe1e80a1110 0x7fe1e80a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:20.634 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.632+0000 7fe1f9400640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe1e80a1110 0x7fe1e80a35d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009230 tx=0x7fe1ec005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:20.637 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.635+0000 7fe1fb400640 1 -- 172.21.15.27:0/755156432 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe1f4096440 con 0x7fe204101e30 2024-09-13T18:03:20.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.816+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe20402c410 con 0x7fe204101e30 2024-09-13T18:03:20.818 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.817+0000 7fe1fb400640 1 -- 172.21.15.27:0/755156432 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1f4099a60 con 0x7fe204101e30 2024-09-13T18:03:20.819 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-13T18:03:20.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe1e80a1110 msgr2=0x7fe1e80a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe1e80a1110 0x7fe1e80a35d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009230 tx=0x7fe1ec005fd0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204101e30 msgr2=0x7fe204197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:20.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204101e30 0x7fe204197f20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe1f400e9f0 tx=0x7fe1f400edf0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.821 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 shutdown_connections 2024-09-13T18:03:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe1e80a1110 0x7fe1e80a35d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe204103940 0x7fe20419f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe204102f80 0x7fe204198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 --2- 172.21.15.27:0/755156432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe204101e30 0x7fe204197f20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 >> 172.21.15.27:0/755156432 conn(0x7fe2040fd5b0 msgr2=0x7fe2041063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 shutdown_connections 2024-09-13T18:03:20.822 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.819+0000 7fe203200640 1 -- 172.21.15.27:0/755156432 wait complete. 2024-09-13T18:03:20.837 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:03:21.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.999+0000 7f5621600640 1 -- 172.21.15.27:0/2991771381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 msgr2=0x7f561c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.999+0000 7f5621600640 1 --2- 172.21.15.27:0/2991771381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 0x7f561c102380 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f560c009ca0 tx=0x7f560c02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.999+0000 7f5621600640 1 -- 172.21.15.27:0/2991771381 shutdown_connections 2024-09-13T18:03:21.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.999+0000 7f5621600640 1 --2- 172.21.15.27:0/2991771381 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c103b30 0x7f561c10a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.999+0000 7f5621600640 1 --2- 172.21.15.27:0/2991771381 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f561c103170 0x7f561c1035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.999+0000 7f5621600640 1 --2- 172.21.15.27:0/2991771381 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 0x7f561c102380 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.999+0000 7f5621600640 1 -- 172.21.15.27:0/2991771381 >> 172.21.15.27:0/2991771381 conn(0x7f561c0fd700 msgr2=0x7f561c0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.999+0000 7f5621600640 1 -- 172.21.15.27:0/2991771381 shutdown_connections 2024-09-13T18:03:21.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:20.999+0000 7f5621600640 1 -- 172.21.15.27:0/2991771381 wait complete. 2024-09-13T18:03:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.000+0000 7f5621600640 1 Processor -- start 2024-09-13T18:03:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.000+0000 7f5621600640 1 -- start start 2024-09-13T18:03:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.000+0000 7f5621600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 0x7f561c198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.000+0000 7f5621600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c103170 0x7f561c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.000+0000 7f5621600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f561c103b30 0x7f561c19f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.000+0000 7f5621600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c19fb10 con 0x7f561c101f80 2024-09-13T18:03:21.004 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.000+0000 7f5621600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c19fc80 con 0x7f561c103b30 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.000+0000 7f5621600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c19fe40 con 0x7f561c103170 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 0x7f561c198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 0x7f561c198020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57896/0 (socket says 172.21.15.27:57896) 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561aa00640 1 -- 172.21.15.27:0/1638903409 learned_addr learned my addr 172.21.15.27:0/1638903409 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f5612000640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c103170 0x7f561c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561b400640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f561c103b30 0x7f561c19f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561aa00640 1 -- 172.21.15.27:0/1638903409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c103170 msgr2=0x7f561c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561aa00640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c103170 0x7f561c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561aa00640 1 -- 172.21.15.27:0/1638903409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f561c103b30 msgr2=0x7f561c19f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561aa00640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f561c103b30 0x7f561c19f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561aa00640 1 -- 172.21.15.27:0/1638903409 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c009900 con 0x7f561c101f80 2024-09-13T18:03:21.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.001+0000 7f561aa00640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 0x7f561c198020 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f560c000f80 tx=0x7f560c003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.002+0000 7f5613e00640 1 -- 172.21.15.27:0/1638903409 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c031650 con 0x7f561c101f80 2024-09-13T18:03:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.002+0000 7f5613e00640 1 -- 172.21.15.27:0/1638903409 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f560c040070 con 0x7f561c101f80 2024-09-13T18:03:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.002+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c1a00c0 con 0x7f561c101f80 2024-09-13T18:03:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.002+0000 7f5613e00640 1 -- 172.21.15.27:0/1638903409 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c030820 con 0x7f561c101f80 2024-09-13T18:03:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.002+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c1a0620 con 0x7f561c101f80 2024-09-13T18:03:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.003+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c109410 con 0x7f561c101f80 2024-09-13T18:03:21.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.005+0000 7f5613e00640 1 -- 172.21.15.27:0/1638903409 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f560c042030 con 0x7f561c101f80 2024-09-13T18:03:21.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.006+0000 7f5613e00640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56000a1110 0x7f56000a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.006+0000 7f5613e00640 1 -- 172.21.15.27:0/1638903409 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f560c0edd60 con 0x7f561c101f80 2024-09-13T18:03:21.008 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.006+0000 7f5612000640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56000a1110 0x7f56000a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.007+0000 7f5612000640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56000a1110 0x7f56000a35d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f561c199530 tx=0x7f5604005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:21.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.010+0000 7f5613e00640 1 -- 172.21.15.27:0/1638903409 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f560c0b7620 con 0x7f561c101f80 2024-09-13T18:03:21.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.193+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f561c02c3e0 con 0x7f561c101f80 2024-09-13T18:03:21.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.194+0000 7f5613e00640 1 -- 172.21.15.27:0/1638903409 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f560c0bac40 con 0x7f561c101f80 2024-09-13T18:03:21.196 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-09-13T18:03:21.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56000a1110 msgr2=0x7f56000a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56000a1110 0x7f56000a35d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f561c199530 tx=0x7f5604005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:21.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 msgr2=0x7f561c198020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 0x7f561c198020 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f560c000f80 tx=0x7f560c003b80 comp rx=0 tx=0).stop 2024-09-13T18:03:21.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 shutdown_connections 2024-09-13T18:03:21.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56000a1110 0x7f56000a35d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f561c103b30 0x7f561c19f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f561c103170 0x7f561c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 --2- 172.21.15.27:0/1638903409 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f561c101f80 0x7f561c198020 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 >> 172.21.15.27:0/1638903409 conn(0x7f561c0fd700 msgr2=0x7f561c1065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:21.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 shutdown_connections 2024-09-13T18:03:21.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.196+0000 7f5621600640 1 -- 172.21.15.27:0/1638903409 wait complete. 2024-09-13T18:03:21.212 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:20 smithi027 ceph-mon[30611]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-13T18:03:21.212 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:20 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1425331442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:21.212 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:20 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3191896930' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:21.212 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:20 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/755156432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:21.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:20 smithi122 ceph-mon[35310]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-13T18:03:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:20 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1425331442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:20 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3191896930' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:20 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/755156432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:21.215 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:03:21.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:20 smithi143 ceph-mon[38210]: pgmap v340: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-13T18:03:21.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:20 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1425331442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:21.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:20 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3191896930' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:21.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:20 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/755156432' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.374+0000 7f31ab400640 1 -- 172.21.15.27:0/2960848466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a40ffd70 msgr2=0x7f31a4100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.374+0000 7f31ab400640 1 --2- 172.21.15.27:0/2960848466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a40ffd70 0x7f31a4100170 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3194009900 tx=0x7f319402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.375+0000 7f31ab400640 1 -- 172.21.15.27:0/2960848466 shutdown_connections 2024-09-13T18:03:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.375+0000 7f31ab400640 1 --2- 172.21.15.27:0/2960848466 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a4101920 0x7f31a41081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.375+0000 7f31ab400640 1 --2- 172.21.15.27:0/2960848466 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a4100f60 0x7f31a41013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.375+0000 7f31ab400640 1 --2- 172.21.15.27:0/2960848466 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a40ffd70 0x7f31a4100170 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.375+0000 7f31ab400640 1 -- 172.21.15.27:0/2960848466 >> 172.21.15.27:0/2960848466 conn(0x7f31a40fb4d0 msgr2=0x7f31a40fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.375+0000 7f31ab400640 1 -- 172.21.15.27:0/2960848466 shutdown_connections 2024-09-13T18:03:21.377 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.375+0000 7f31ab400640 1 -- 172.21.15.27:0/2960848466 wait complete. 2024-09-13T18:03:21.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31ab400640 1 Processor -- start 2024-09-13T18:03:21.379 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31ab400640 1 -- start start 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31ab400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a40ffd70 0x7f31a4198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31ab400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a4100f60 0x7f31a41985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31ab400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a4101920 0x7f31a419f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31ab400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a419fb80 con 0x7f31a4101920 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31ab400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a419fcf0 con 0x7f31a4100f60 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31ab400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a419feb0 con 0x7f31a40ffd70 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31a9400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a4101920 0x7f31a419f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31a9400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a4101920 0x7f31a419f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57916/0 (socket says 172.21.15.27:57916) 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31a9400640 1 -- 172.21.15.27:0/3985265617 learned_addr learned my addr 172.21.15.27:0/3985265617 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f319be00640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a4100f60 0x7f31a41985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.376+0000 7f31a8a00640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a40ffd70 0x7f31a4198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31a9400640 1 -- 172.21.15.27:0/3985265617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a40ffd70 msgr2=0x7f31a4198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31a9400640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a40ffd70 0x7f31a4198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.380 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31a9400640 1 -- 172.21.15.27:0/3985265617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a4100f60 msgr2=0x7f31a41985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31a9400640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a4100f60 0x7f31a41985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31a9400640 1 -- 172.21.15.27:0/3985265617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194009560 con 0x7f31a4101920 2024-09-13T18:03:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31a9400640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a4101920 0x7f31a419f640 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f319c00eb10 tx=0x7f319c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31a2000640 1 -- 172.21.15.27:0/3985265617 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c004b20 con 0x7f31a4101920 2024-09-13T18:03:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31a2000640 1 -- 172.21.15.27:0/3985265617 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f319c004c80 con 0x7f31a4101920 2024-09-13T18:03:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31a2000640 1 -- 172.21.15.27:0/3985265617 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319c010650 con 0x7f31a4101920 2024-09-13T18:03:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a41a0190 con 0x7f31a4101920 2024-09-13T18:03:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.377+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a41a0650 con 0x7f31a4101920 2024-09-13T18:03:21.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.379+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a410b800 con 0x7f31a4101920 2024-09-13T18:03:21.382 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.380+0000 7f31a2000640 1 -- 172.21.15.27:0/3985265617 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f319c005020 con 0x7f31a4101920 2024-09-13T18:03:21.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.382+0000 7f31a2000640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f31880a1110 0x7f31880a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.382+0000 7f31a2000640 1 -- 172.21.15.27:0/3985265617 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f319c014070 con 0x7f31a4101920 2024-09-13T18:03:21.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.382+0000 7f31a8a00640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f31880a1110 0x7f31880a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.383+0000 7f31a8a00640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f31880a1110 0x7f31880a35d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3194009230 tx=0x7f3194005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:21.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.386+0000 7f31a2000640 1 -- 172.21.15.27:0/3985265617 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f319c096570 con 0x7f31a4101920 2024-09-13T18:03:21.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.567+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31a41a08d0 con 0x7f31a4101920 2024-09-13T18:03:21.573 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.567+0000 7f31a2000640 1 -- 172.21.15.27:0/3985265617 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31a41a08d0 con 0x7f31a4101920 2024-09-13T18:03:21.573 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-09-13T18:03:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f31880a1110 msgr2=0x7f31880a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f31880a1110 0x7f31880a35d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3194009230 tx=0x7f3194005a20 comp rx=0 tx=0).stop 2024-09-13T18:03:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a4101920 msgr2=0x7f31a419f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a4101920 0x7f31a419f640 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f319c00eb10 tx=0x7f319c00c2d0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 shutdown_connections 2024-09-13T18:03:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f31880a1110 0x7f31880a35d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f31a4101920 0x7f31a419f640 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.574 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f31a4100f60 0x7f31a41985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 --2- 172.21.15.27:0/3985265617 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f31a40ffd70 0x7f31a4198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 >> 172.21.15.27:0/3985265617 conn(0x7f31a40fb4d0 msgr2=0x7f31a4106780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 shutdown_connections 2024-09-13T18:03:21.575 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.570+0000 7f31ab400640 1 -- 172.21.15.27:0/3985265617 wait complete. 2024-09-13T18:03:21.588 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:03:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.746+0000 7f4e81c00640 1 -- 172.21.15.27:0/1133559461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 msgr2=0x7f4e7c0fea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.746+0000 7f4e81c00640 1 --2- 172.21.15.27:0/1133559461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 0x7f4e7c0fea10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009900 tx=0x7f4e6c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.746+0000 7f4e81c00640 1 -- 172.21.15.27:0/1133559461 shutdown_connections 2024-09-13T18:03:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.746+0000 7f4e81c00640 1 --2- 172.21.15.27:0/1133559461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e7c0ff8f0 0x7f4e7c0ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.746+0000 7f4e81c00640 1 --2- 172.21.15.27:0/1133559461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e7c0fef50 0x7f4e7c0ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.746+0000 7f4e81c00640 1 --2- 172.21.15.27:0/1133559461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 0x7f4e7c0fea10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.746+0000 7f4e81c00640 1 -- 172.21.15.27:0/1133559461 >> 172.21.15.27:0/1133559461 conn(0x7f4e7c0fa420 msgr2=0x7f4e7c0fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.747+0000 7f4e81c00640 1 -- 172.21.15.27:0/1133559461 shutdown_connections 2024-09-13T18:03:21.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.747+0000 7f4e81c00640 1 -- 172.21.15.27:0/1133559461 wait complete. 2024-09-13T18:03:21.751 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.747+0000 7f4e81c00640 1 Processor -- start 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e81c00640 1 -- start start 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e81c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 0x7f4e7c198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e81c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e7c0fef50 0x7f4e7c1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e81c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e7c0ff8f0 0x7f4e7c19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e81c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c19fb80 con 0x7f4e7c0fe610 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e81c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c19fcf0 con 0x7f4e7c0ff8f0 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e81c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c19feb0 con 0x7f4e7c0fef50 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e7aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 0x7f4e7c198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e7aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 0x7f4e7c198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57934/0 (socket says 172.21.15.27:57934) 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e7aa00640 1 -- 172.21.15.27:0/954502070 learned_addr learned my addr 172.21.15.27:0/954502070 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e73e00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e7c0fef50 0x7f4e7c1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.748+0000 7f4e7b400640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e7c0ff8f0 0x7f4e7c19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.752 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e7aa00640 1 -- 172.21.15.27:0/954502070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e7c0fef50 msgr2=0x7f4e7c1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e7aa00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e7c0fef50 0x7f4e7c1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e7aa00640 1 -- 172.21.15.27:0/954502070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e7c0ff8f0 msgr2=0x7f4e7c19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e7aa00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e7c0ff8f0 0x7f4e7c19f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e7aa00640 1 -- 172.21.15.27:0/954502070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c009560 con 0x7f4e7c0fe610 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e7aa00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 0x7f4e7c198090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c005940 tx=0x7f4e6c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e73400640 1 -- 172.21.15.27:0/954502070 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c004520 con 0x7f4e7c0fe610 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e73400640 1 -- 172.21.15.27:0/954502070 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4e6c0046c0 con 0x7f4e7c0fe610 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7c1a0130 con 0x7f4e7c0fe610 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e73400640 1 -- 172.21.15.27:0/954502070 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c003970 con 0x7f4e7c0fe610 2024-09-13T18:03:21.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.749+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7c1a05e0 con 0x7f4e7c0fe610 2024-09-13T18:03:21.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.750+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7c109560 con 0x7f4e7c0fe610 2024-09-13T18:03:21.754 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.752+0000 7f4e73400640 1 -- 172.21.15.27:0/954502070 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4e6c004af0 con 0x7f4e7c0fe610 2024-09-13T18:03:21.755 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.754+0000 7f4e73400640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f4e600a1090 0x7f4e600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:21.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.754+0000 7f4e73400640 1 -- 172.21.15.27:0/954502070 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4e6c0ed450 con 0x7f4e7c0fe610 2024-09-13T18:03:21.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.754+0000 7f4e73e00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f4e600a1090 0x7f4e600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:21.756 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.755+0000 7f4e73e00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f4e600a1090 0x7f4e600a3550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c1995a0 tx=0x7f4e64005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:21.759 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.758+0000 7f4e73400640 1 -- 172.21.15.27:0/954502070 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f4e6c0b6c40 con 0x7f4e7c0fe610 2024-09-13T18:03:21.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.983+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e7c10d9a0 con 0x7f4e7c0fe610 2024-09-13T18:03:21.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.984+0000 7f4e73400640 1 -- 172.21.15.27:0/954502070 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10916 (secure 0 0 0) 0x7f4e6c0ba260 con 0x7f4e7c0fe610 2024-09-13T18:03:21.986 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:21.986 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:01:46.320502+0000","modified":"2024-09-13T18:01:53.056677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24556,"mds_2":24533,"mds_3":24529,"mds_4":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24448":{"gid":24448,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24529":{"gid":24529,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24556":{"gid":24556,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/1102491877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1102491877},{"type":"v1","addr":"172.21.15.122:6839","nonce":1102491877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:03:21.986 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 26 2024-09-13T18:03:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f4e600a1090 msgr2=0x7f4e600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f4e600a1090 0x7f4e600a3550 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4e7c1995a0 tx=0x7f4e64005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 msgr2=0x7f4e7c198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 0x7f4e7c198090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c005940 tx=0x7f4e6c004270 comp rx=0 tx=0).stop 2024-09-13T18:03:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 shutdown_connections 2024-09-13T18:03:21.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f4e600a1090 0x7f4e600a3550 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4e7c0ff8f0 0x7f4e7c19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4e7c0fef50 0x7f4e7c1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 --2- 172.21.15.27:0/954502070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4e7c0fe610 0x7f4e7c198090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 >> 172.21.15.27:0/954502070 conn(0x7f4e7c0fa420 msgr2=0x7f4e7c0fbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 shutdown_connections 2024-09-13T18:03:21.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:21.986+0000 7f4e81c00640 1 -- 172.21.15.27:0/954502070 wait complete. 2024-09-13T18:03:22.005 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:03:22.165 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.163+0000 7f000fa00640 1 -- 172.21.15.27:0/3267010249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 msgr2=0x7f0008073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.163+0000 7f000fa00640 1 --2- 172.21.15.27:0/3267010249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 0x7f0008073370 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efff4009900 tx=0x7efff402a410 comp rx=0 tx=0).stop 2024-09-13T18:03:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.163+0000 7f000fa00640 1 -- 172.21.15.27:0/3267010249 shutdown_connections 2024-09-13T18:03:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.163+0000 7f000fa00640 1 --2- 172.21.15.27:0/3267010249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0008107c10 0x7f000810a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.163+0000 7f000fa00640 1 --2- 172.21.15.27:0/3267010249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 0x7f0008073370 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.163+0000 7f000fa00640 1 --2- 172.21.15.27:0/3267010249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f00080744f0 0x7f0008072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.163+0000 7f000fa00640 1 -- 172.21.15.27:0/3267010249 >> 172.21.15.27:0/3267010249 conn(0x7f00080fb520 msgr2=0x7f00080fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.163+0000 7f000fa00640 1 -- 172.21.15.27:0/3267010249 shutdown_connections 2024-09-13T18:03:22.166 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.163+0000 7f000fa00640 1 -- 172.21.15.27:0/3267010249 wait complete. 2024-09-13T18:03:22.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.164+0000 7f000fa00640 1 Processor -- start 2024-09-13T18:03:22.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.164+0000 7f000fa00640 1 -- start start 2024-09-13T18:03:22.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000fa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 0x7f0008198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000fa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00080744f0 0x7f00081985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000fa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0008107c10 0x7f000819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000fa00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000819fb50 con 0x7f0008072f10 2024-09-13T18:03:22.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000fa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000819fcc0 con 0x7f00080744f0 2024-09-13T18:03:22.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000fa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000819fe80 con 0x7f0008107c10 2024-09-13T18:03:22.168 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000d000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 0x7f0008198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000d000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 0x7f0008198060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57944/0 (socket says 172.21.15.27:57944) 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000d000640 1 -- 172.21.15.27:0/3790905980 learned_addr learned my addr 172.21.15.27:0/3790905980 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f0007e00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00080744f0 0x7f00081985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000da00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0008107c10 0x7f000819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000d000640 1 -- 172.21.15.27:0/3790905980 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0008107c10 msgr2=0x7f000819f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000d000640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0008107c10 0x7f000819f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000d000640 1 -- 172.21.15.27:0/3790905980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00080744f0 msgr2=0x7f00081985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000d000640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00080744f0 0x7f00081985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000d000640 1 -- 172.21.15.27:0/3790905980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff4009560 con 0x7f0008072f10 2024-09-13T18:03:22.169 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.165+0000 7f000da00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0008107c10 0x7f000819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.166+0000 7f000d000640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 0x7f0008198060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efffc00e9f0 tx=0x7efffc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.166+0000 7f0005600640 1 -- 172.21.15.27:0/3790905980 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc009720 con 0x7f0008072f10 2024-09-13T18:03:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.166+0000 7f0005600640 1 -- 172.21.15.27:0/3790905980 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efffc00cd80 con 0x7f0008072f10 2024-09-13T18:03:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.166+0000 7f0005600640 1 -- 172.21.15.27:0/3790905980 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc010690 con 0x7f0008072f10 2024-09-13T18:03:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.166+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00081a0160 con 0x7f0008072f10 2024-09-13T18:03:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.166+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00081a05f0 con 0x7f0008072f10 2024-09-13T18:03:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.167+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0008106990 con 0x7f0008072f10 2024-09-13T18:03:22.170 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.169+0000 7f0005600640 1 -- 172.21.15.27:0/3790905980 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efffc0046c0 con 0x7f0008072f10 2024-09-13T18:03:22.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.171+0000 7f0005600640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efff00a1090 0x7efff00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.171+0000 7f0005600640 1 -- 172.21.15.27:0/3790905980 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efffc014070 con 0x7f0008072f10 2024-09-13T18:03:22.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.171+0000 7f0007e00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efff00a1090 0x7efff00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.172+0000 7f0007e00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efff00a1090 0x7efff00a3550 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efff4031510 tx=0x7efff40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:22.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.175+0000 7f0005600640 1 -- 172.21.15.27:0/3790905980 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7efffc0964b0 con 0x7f0008072f10 2024-09-13T18:03:22.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:21 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1638903409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:22.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:21 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3985265617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:22.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:21 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1638903409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:22.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:21 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3985265617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:22.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:21 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1638903409' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:22.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:21 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3985265617' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:22.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.363+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f000810d990 con 0x7f0008072f10 2024-09-13T18:03:22.366 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.364+0000 7f0005600640 1 -- 172.21.15.27:0/3790905980 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7efffc099ad0 con 0x7f0008072f10 2024-09-13T18:03:22.367 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:22.367 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":88,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:02:37.160677+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:03:22.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efff00a1090 msgr2=0x7efff00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efff00a1090 0x7efff00a3550 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efff4031510 tx=0x7efff40058d0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 msgr2=0x7f0008198060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 0x7f0008198060 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efffc00e9f0 tx=0x7efffc00edf0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 shutdown_connections 2024-09-13T18:03:22.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efff00a1090 0x7efff00a3550 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.369 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0008107c10 0x7f000819f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00080744f0 0x7f00081985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 --2- 172.21.15.27:0/3790905980 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0008072f10 0x7f0008198060 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 >> 172.21.15.27:0/3790905980 conn(0x7f00080fb520 msgr2=0x7f0008103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:22.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 shutdown_connections 2024-09-13T18:03:22.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.367+0000 7f000fa00640 1 -- 172.21.15.27:0/3790905980 wait complete. 2024-09-13T18:03:22.388 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:03:22.551 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.546+0000 7fa931e00640 1 -- 172.21.15.27:0/1339610221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c100820 msgr2=0x7fa92c102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.546+0000 7fa931e00640 1 --2- 172.21.15.27:0/1339610221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c100820 0x7fa92c102c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa91c009900 tx=0x7fa91c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.546+0000 7fa931e00640 1 -- 172.21.15.27:0/1339610221 shutdown_connections 2024-09-13T18:03:22.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.546+0000 7fa931e00640 1 --2- 172.21.15.27:0/1339610221 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92c105a80 0x7fa92c107ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.546+0000 7fa931e00640 1 --2- 172.21.15.27:0/1339610221 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa92c103150 0x7fa92c105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.546+0000 7fa931e00640 1 --2- 172.21.15.27:0/1339610221 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c100820 0x7fa92c102c10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.546+0000 7fa931e00640 1 -- 172.21.15.27:0/1339610221 >> 172.21.15.27:0/1339610221 conn(0x7fa92c0fa420 msgr2=0x7fa92c0fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.546+0000 7fa931e00640 1 -- 172.21.15.27:0/1339610221 shutdown_connections 2024-09-13T18:03:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.546+0000 7fa931e00640 1 -- 172.21.15.27:0/1339610221 wait complete. 2024-09-13T18:03:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.547+0000 7fa931e00640 1 Processor -- start 2024-09-13T18:03:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.547+0000 7fa931e00640 1 -- start start 2024-09-13T18:03:22.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.547+0000 7fa931e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa92c100820 0x7fa92c100190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.547+0000 7fa931e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c103150 0x7fa92c0fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.547+0000 7fa931e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92c105a80 0x7fa92c0fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa931e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0ff470 con 0x7fa92c103150 2024-09-13T18:03:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa931e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c0ff5e0 con 0x7fa92c100820 2024-09-13T18:03:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa931e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c19ffa0 con 0x7fa92c105a80 2024-09-13T18:03:22.554 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c103150 0x7fa92c0fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa92c100820 0x7fa92c100190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c103150 0x7fa92c0fe7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57964/0 (socket says 172.21.15.27:57964) 2024-09-13T18:03:22.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92a000640 1 -- 172.21.15.27:0/2310671278 learned_addr learned my addr 172.21.15.27:0/2310671278 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:22.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92b400640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92c105a80 0x7fa92c0fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92a000640 1 -- 172.21.15.27:0/2310671278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92c105a80 msgr2=0x7fa92c0fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92a000640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92c105a80 0x7fa92c0fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92a000640 1 -- 172.21.15.27:0/2310671278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa92c100820 msgr2=0x7fa92c100190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92a000640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa92c100820 0x7fa92c100190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92a000640 1 -- 172.21.15.27:0/2310671278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c009560 con 0x7fa92c103150 2024-09-13T18:03:22.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.548+0000 7fa92a000640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c103150 0x7fa92c0fe7d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa91800d7a0 tx=0x7fa91800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:22.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.549+0000 7fa930a00640 1 -- 172.21.15.27:0/2310671278 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa918009c30 con 0x7fa92c103150 2024-09-13T18:03:22.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.549+0000 7fa930a00640 1 -- 172.21.15.27:0/2310671278 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa91800deb0 con 0x7fa92c103150 2024-09-13T18:03:22.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.549+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92c1a0250 con 0x7fa92c103150 2024-09-13T18:03:22.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.549+0000 7fa930a00640 1 -- 172.21.15.27:0/2310671278 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91800f740 con 0x7fa92c103150 2024-09-13T18:03:22.557 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.549+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa92c1a0710 con 0x7fa92c103150 2024-09-13T18:03:22.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.550+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92c0fbf10 con 0x7fa92c103150 2024-09-13T18:03:22.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.552+0000 7fa930a00640 1 -- 172.21.15.27:0/2310671278 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa9180109d0 con 0x7fa92c103150 2024-09-13T18:03:22.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.553+0000 7fa930a00640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa9100a1090 0x7fa9100a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.553+0000 7fa930a00640 1 -- 172.21.15.27:0/2310671278 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa9180cc5d0 con 0x7fa92c103150 2024-09-13T18:03:22.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.553+0000 7fa92aa00640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa9100a1090 0x7fa9100a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.554+0000 7fa92aa00640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa9100a1090 0x7fa9100a3550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa91c031510 tx=0x7fa91c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:22.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.557+0000 7fa930a00640 1 -- 172.21.15.27:0/2310671278 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa918095e20 con 0x7fa92c103150 2024-09-13T18:03:22.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.778+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa92c0fb980 con 0x7fa92c103150 2024-09-13T18:03:22.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.779+0000 7fa930a00640 1 -- 172.21.15.27:0/2310671278 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10916 (secure 0 0 0) 0x7fa918099440 con 0x7fa92c103150 2024-09-13T18:03:22.782 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:22.782 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:01:46.320502+0000","modified":"2024-09-13T18:01:53.056677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24556,"mds_2":24533,"mds_3":24529,"mds_4":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24448":{"gid":24448,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24529":{"gid":24529,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24556":{"gid":24556,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/1102491877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1102491877},{"type":"v1","addr":"172.21.15.122:6839","nonce":1102491877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:03:22.782 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 26 2024-09-13T18:03:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.781+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa9100a1090 msgr2=0x7fa9100a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.781+0000 7fa931e00640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa9100a1090 0x7fa9100a3550 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa91c031510 tx=0x7fa91c005a20 comp rx=0 tx=0).stop 2024-09-13T18:03:22.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.781+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c103150 msgr2=0x7fa92c0fe7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.781+0000 7fa931e00640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c103150 0x7fa92c0fe7d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa91800d7a0 tx=0x7fa91800dc60 comp rx=0 tx=0).stop 2024-09-13T18:03:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.782+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 shutdown_connections 2024-09-13T18:03:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.782+0000 7fa931e00640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa9100a1090 0x7fa9100a3550 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.782+0000 7fa931e00640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa92c105a80 0x7fa92c0fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.782+0000 7fa931e00640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa92c103150 0x7fa92c0fe7d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.782+0000 7fa931e00640 1 --2- 172.21.15.27:0/2310671278 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa92c100820 0x7fa92c100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.782+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 >> 172.21.15.27:0/2310671278 conn(0x7fa92c0fa420 msgr2=0x7fa92c101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:22.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.782+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 shutdown_connections 2024-09-13T18:03:22.786 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.782+0000 7fa931e00640 1 -- 172.21.15.27:0/2310671278 wait complete. 2024-09-13T18:03:22.800 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T18:01:46.320502+0000', 'modified': '2024-09-13T18:01:53.056677+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24584, 'mds_1': 24556, 'mds_2': 24533, 'mds_3': 24529, 'mds_4': 24448}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14505': {'gid': 14505, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.27:6839/91312549', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6838', 'nonce': 91312549}, {'type': 'v1', 'addr': '172.21.15.27:6839', 'nonce': 91312549}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24448': {'gid': 24448, 'name': 'l', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.143:6833/2820864881', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6832', 'nonce': 2820864881}, {'type': 'v1', 'addr': '172.21.15.143:6833', 'nonce': 2820864881}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24455': {'gid': 24455, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/1100066007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 1100066007}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 1100066007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6835/1011366471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 1011366471}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 1011366471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24499': {'gid': 24499, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.143:6835/1530941636', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6834', 'nonce': 1530941636}, {'type': 'v1', 'addr': '172.21.15.143:6835', 'nonce': 1530941636}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24511': {'gid': 24511, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.143:6837/3738799013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6836', 'nonce': 3738799013}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 3738799013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.143:6839/1150747117', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6838', 'nonce': 1150747117}, {'type': 'v1', 'addr': '172.21.15.143:6839', 'nonce': 1150747117}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.122:6837/65111779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 65111779}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 65111779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24556': {'gid': 24556, 'name': 'a', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.27:6841/3673158651', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6840', 'nonce': 3673158651}, {'type': 'v1', 'addr': '172.21.15.27:6841', 'nonce': 3673158651}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24584': {'gid': 24584, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6839/1102491877', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 1102491877}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 1102491877}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:03:22.801 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-13T18:03:22.801 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-09-13T18:03:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.961+0000 7f5280a00640 1 -- 172.21.15.27:0/1377164911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c074490 msgr2=0x7f527c0728e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.961+0000 7f5280a00640 1 --2- 172.21.15.27:0/1377164911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c074490 0x7f527c0728e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f526c009900 tx=0x7f526c02a490 comp rx=0 tx=0).stop 2024-09-13T18:03:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.961+0000 7f5280a00640 1 -- 172.21.15.27:0/1377164911 shutdown_connections 2024-09-13T18:03:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.961+0000 7f5280a00640 1 --2- 172.21.15.27:0/1377164911 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f527c107a40 0x7f527c109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.963 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.961+0000 7f5280a00640 1 --2- 172.21.15.27:0/1377164911 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f527c072eb0 0x7f527c073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.961+0000 7f5280a00640 1 --2- 172.21.15.27:0/1377164911 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c074490 0x7f527c0728e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.961+0000 7f5280a00640 1 -- 172.21.15.27:0/1377164911 >> 172.21.15.27:0/1377164911 conn(0x7f527c0fb330 msgr2=0x7f527c0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.961+0000 7f5280a00640 1 -- 172.21.15.27:0/1377164911 shutdown_connections 2024-09-13T18:03:22.964 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.961+0000 7f5280a00640 1 -- 172.21.15.27:0/1377164911 wait complete. 2024-09-13T18:03:22.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f5280a00640 1 Processor -- start 2024-09-13T18:03:22.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f5280a00640 1 -- start start 2024-09-13T18:03:22.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f5280a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c072eb0 0x7f527c197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f5280a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f527c074490 0x7f527c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f5280a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f527c107a40 0x7f527c19f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.966 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f5280a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c19f960 con 0x7f527c072eb0 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f5280a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c19fad0 con 0x7f527c107a40 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f5280a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c19fc90 con 0x7f527c074490 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f527a800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c072eb0 0x7f527c197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.962+0000 7f527a800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c072eb0 0x7f527c197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57988/0 (socket says 172.21.15.27:57988) 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f5273e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f527c074490 0x7f527c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f527a800640 1 -- 172.21.15.27:0/62086816 learned_addr learned my addr 172.21.15.27:0/62086816 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f527b200640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f527c107a40 0x7f527c19f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f527a800640 1 -- 172.21.15.27:0/62086816 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f527c074490 msgr2=0x7f527c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f527a800640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f527c074490 0x7f527c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f527a800640 1 -- 172.21.15.27:0/62086816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f527c107a40 msgr2=0x7f527c19f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f527a800640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f527c107a40 0x7f527c19f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f527a800640 1 -- 172.21.15.27:0/62086816 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526c009560 con 0x7f527c072eb0 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f5273e00640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f527c074490 0x7f527c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:22.967 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f527b200640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f527c107a40 0x7f527c19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.963+0000 7f527a800640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c072eb0 0x7f527c197e70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f526c031510 tx=0x7f526c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.964+0000 7f5273400640 1 -- 172.21.15.27:0/62086816 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c005000 con 0x7f527c072eb0 2024-09-13T18:03:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.964+0000 7f5273400640 1 -- 172.21.15.27:0/62086816 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f526c0046c0 con 0x7f527c072eb0 2024-09-13T18:03:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.964+0000 7f5280a00640 1 -- 172.21.15.27:0/62086816 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c19ff10 con 0x7f527c072eb0 2024-09-13T18:03:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.964+0000 7f5273400640 1 -- 172.21.15.27:0/62086816 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c003a10 con 0x7f527c072eb0 2024-09-13T18:03:22.968 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.964+0000 7f5280a00640 1 -- 172.21.15.27:0/62086816 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c1a02d0 con 0x7f527c072eb0 2024-09-13T18:03:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5284228740 1 Processor -- start 2024-09-13T18:03:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5273400640 1 -- 172.21.15.27:0/62086816 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f526c004bc0 con 0x7f527c072eb0 2024-09-13T18:03:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5284228740 1 -- start start 2024-09-13T18:03:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5284228740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.969 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5284228740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee75e0 0x55c4efeec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5284228740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efeec670 0x55c4efeeeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5284228740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efe50ab0 con 0x55c4efee6ca0 2024-09-13T18:03:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5284228740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efe4e240 con 0x55c4efee75e0 2024-09-13T18:03:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5284228740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efe49b30 con 0x55c4efeec670 2024-09-13T18:03:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f527b200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f527b200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58000/0 (socket says 172.21.15.27:58000) 2024-09-13T18:03:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f527a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee75e0 0x55c4efeec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f527b200640 1 -- 172.21.15.27:0/4174367148 learned_addr learned my addr 172.21.15.27:0/4174367148 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:22.970 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.967+0000 7f5273e00640 1 --2- 172.21.15.27:0/4174367148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efeec670 0x55c4efeeeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f527b200640 1 -- 172.21.15.27:0/4174367148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efeec670 msgr2=0x55c4efeeeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:22.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f527b200640 1 --2- 172.21.15.27:0/4174367148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efeec670 0x55c4efeeeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f527b200640 1 -- 172.21.15.27:0/4174367148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee75e0 msgr2=0x55c4efeec0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:22.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f527b200640 1 --2- 172.21.15.27:0/4174367148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee75e0 0x55c4efeec0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f527b200640 1 -- 172.21.15.27:0/4174367148 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4efe14bd0 con 0x55c4efee6ca0 2024-09-13T18:03:22.975 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f527b200640 1 --2- 172.21.15.27:0/4174367148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee70a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f52740117e0 tx=0x7f5274011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba51712f887c280 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f5273400640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f52600a1090 0x7f52600a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f526be00640 1 -- 172.21.15.27:0/4174367148 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274011310 con 0x55c4efee6ca0 2024-09-13T18:03:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f526be00640 1 -- 172.21.15.27:0/4174367148 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5274003e50 con 0x55c4efee6ca0 2024-09-13T18:03:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f526be00640 1 -- 172.21.15.27:0/4174367148 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274004620 con 0x55c4efee6ca0 2024-09-13T18:03:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.968+0000 7f5273400640 1 -- 172.21.15.27:0/62086816 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f526c0ed7b0 con 0x7f527c072eb0 2024-09-13T18:03:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f527a800640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f52600a1090 0x7f52600a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f5284228740 1 -- 172.21.15.27:0/4174367148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 msgr2=0x55c4efee70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.976 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f5284228740 1 --2- 172.21.15.27:0/4174367148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee70a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f52740117e0 tx=0x7f5274011ca0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f5284228740 1 -- 172.21.15.27:0/4174367148 shutdown_connections 2024-09-13T18:03:22.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f5284228740 1 --2- 172.21.15.27:0/4174367148 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efeec670 0x55c4efeeeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f5284228740 1 --2- 172.21.15.27:0/4174367148 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee75e0 0x55c4efeec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f5284228740 1 --2- 172.21.15.27:0/4174367148 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee70a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f5284228740 1 -- 172.21.15.27:0/4174367148 >> 172.21.15.27:0/4174367148 conn(0x55c4efee2310 msgr2=0x55c4efee2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:22.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f527a800640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f52600a1090 0x7f52600a3550 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f526c0b76d0 tx=0x7f526c0f3530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:22.977 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f5284228740 1 -- 172.21.15.27:0/4174367148 shutdown_connections 2024-09-13T18:03:22.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.969+0000 7f5284228740 1 -- 172.21.15.27:0/4174367148 wait complete. 2024-09-13T18:03:22.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.970+0000 7f5284228740 1 -- start start 2024-09-13T18:03:22.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.970+0000 7f5284228740 1 Processor -- start 2024-09-13T18:03:22.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.970+0000 7f5284228740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efee6ca0 0x55c4efef0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.970+0000 7f5284228740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee75e0 0x55c4efef0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.970+0000 7f5284228740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 0x55c4efef7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.970+0000 7f5284228740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efdeb260 con 0x55c4efee75e0 2024-09-13T18:03:22.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.970+0000 7f5284228740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efdeaf00 con 0x55c4efeec670 2024-09-13T18:03:22.978 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.970+0000 7f5284228740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efbb0f20 con 0x55c4efee6ca0 2024-09-13T18:03:22.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.970+0000 7f5284228740 10 client.0 _ll_register_callbacks cb 0x55c4efe431a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:22.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5273e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee75e0 0x55c4efef0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f527b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efee6ca0 0x55c4efef0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5273e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee75e0 0x55c4efef0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58008/0 (socket says 172.21.15.27:58008) 2024-09-13T18:03:22.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5273e00640 1 -- 172.21.15.27:0/1578866059 learned_addr learned my addr 172.21.15.27:0/1578866059 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:22.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f527b200640 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 0x55c4efef7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5273e00640 1 -- 172.21.15.27:0/1578866059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efee6ca0 msgr2=0x55c4efef0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:22.979 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5273e00640 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efee6ca0 0x55c4efef0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5273e00640 1 -- 172.21.15.27:0/1578866059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 msgr2=0x55c4efef7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:22.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5273e00640 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 0x55c4efef7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5273e00640 1 -- 172.21.15.27:0/1578866059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52740114c0 con 0x55c4efee75e0 2024-09-13T18:03:22.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f527b200640 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efee6ca0 0x55c4efef0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:22.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5273e00640 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee75e0 0x55c4efef0ea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5264012d20 tx=0x7f526400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c60ea910c0cc225 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:22.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5268c00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:22.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5268c00640 1 -- 172.21.15.27:0/1578866059 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264017070 con 0x55c4efee75e0 2024-09-13T18:03:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5268c00640 1 -- 172.21.15.27:0/1578866059 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5264012110 con 0x55c4efee75e0 2024-09-13T18:03:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.971+0000 7f5284228740 1 -- 172.21.15.27:0/1578866059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4efe73cd0 con 0x55c4efee75e0 2024-09-13T18:03:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5268c00640 1 -- 172.21.15.27:0/1578866059 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5264004050 con 0x55c4efee75e0 2024-09-13T18:03:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5284228740 10 client.14937 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5284228740 1 -- 172.21.15.27:0/1578866059 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c4efe481b0 con 0x55c4efee75e0 2024-09-13T18:03:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5268c00640 1 -- 172.21.15.27:0/1578866059 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55c4efe73cd0 con 0x55c4efee75e0 2024-09-13T18:03:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5268c00640 1 -- 172.21.15.27:0/1578866059 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5264025070 con 0x55c4efee75e0 2024-09-13T18:03:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5284228740 10 client.14937 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:22.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5284228740 10 client.14937 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-13T18:03:22.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5284228740 20 client.14937 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:22.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5284228740 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x55c4efefcf10 0x55c4eff01070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5284228740 4 client.14937 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:22.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.972+0000 7f5284228740 1 -- 172.21.15.27:0/1578866059 --> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4efb3d3c0 con 0x55c4efefcf10 2024-09-13T18:03:22.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.973+0000 7f527b200640 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x55c4efefcf10 0x55c4eff01070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.973+0000 7f527b200640 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x55c4efefcf10 0x55c4eff01070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=74ca997aef1c0e99 server_cookie=7b8146bb5a922ba1 in_seq=0 out_seq=0 2024-09-13T18:03:22.982 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.973+0000 7f5268c00640 10 client.14937 ms_handle_connect on v2:172.21.15.143:6832/2820864881 2024-09-13T18:03:22.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5268c00640 1 -- 172.21.15.27:0/1578866059 <== mds.4 v2:172.21.15.143:6832/2820864881 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55c4efb3d3c0 con 0x55c4efefcf10 2024-09-13T18:03:22.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5268c00640 10 client.14937 handle_command_reply: tid=0 2024-09-13T18:03:22.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 client.14937 shutdown 2024-09-13T18:03:22.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 -- 172.21.15.27:0/1578866059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee75e0 msgr2=0x55c4efef0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee75e0 0x55c4efef0ea0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5264012d20 tx=0x7f526400f790 comp rx=0 tx=0).stop 2024-09-13T18:03:22.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 -- 172.21.15.27:0/1578866059 shutdown_connections 2024-09-13T18:03:22.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x55c4efefcf10 0x55c4eff01070 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 0x55c4efef7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee75e0 0x55c4efef0ea0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 --2- 172.21.15.27:0/1578866059 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efee6ca0 0x55c4efef0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 -- 172.21.15.27:0/1578866059 >> 172.21.15.27:0/1578866059 conn(0x55c4efee2310 msgr2=0x55c4efee1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:22.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5268c00640 0 client.14937 ms_handle_reset on v2:172.21.15.143:6832/2820864881 2024-09-13T18:03:22.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 -- 172.21.15.27:0/1578866059 shutdown_connections 2024-09-13T18:03:22.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.974+0000 7f5284228740 1 -- 172.21.15.27:0/1578866059 wait complete. 2024-09-13T18:03:22.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.975+0000 7f5284228740 20 client.14937 trim_cache size 0 max 16384 2024-09-13T18:03:22.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f5284228740 1 Processor -- start 2024-09-13T18:03:22.992 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f5284228740 1 -- start start 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f5284228740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f5284228740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 0x55c4efef7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f5284228740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 0x55c4efee3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f5284228740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efb3d3c0 con 0x55c4efee6ca0 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f5284228740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efe73cd0 con 0x55c4efeec670 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f5284228740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efede140 con 0x55c4efefda70 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f527b200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f527b200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58024/0 (socket says 172.21.15.27:58024) 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f527b200640 1 -- 172.21.15.27:0/2511689582 learned_addr learned my addr 172.21.15.27:0/2511689582 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.990+0000 7f5273e00640 1 --2- 172.21.15.27:0/2511689582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 0x55c4efef7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f527b200640 1 --2- 172.21.15.27:0/2511689582 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 0x55c4efee3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f527b200640 1 -- 172.21.15.27:0/2511689582 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 msgr2=0x55c4efee3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:22.993 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f527b200640 1 --2- 172.21.15.27:0/2511689582 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 0x55c4efee3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f527b200640 1 -- 172.21.15.27:0/2511689582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 msgr2=0x55c4efef7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:22.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f527b200640 1 --2- 172.21.15.27:0/2511689582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 0x55c4efef7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f527b200640 1 -- 172.21.15.27:0/2511689582 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4efdea470 con 0x55c4efee6ca0 2024-09-13T18:03:22.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f527b200640 1 --2- 172.21.15.27:0/2511689582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee3700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5274000f80 tx=0x7f5274011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71805bbafe0cf1b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:22.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f5270c00640 1 -- 172.21.15.27:0/2511689582 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274003af0 con 0x55c4efee6ca0 2024-09-13T18:03:22.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f5270c00640 1 -- 172.21.15.27:0/2511689582 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5274031030 con 0x55c4efee6ca0 2024-09-13T18:03:22.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.991+0000 7f5270c00640 1 -- 172.21.15.27:0/2511689582 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527402b8a0 con 0x55c4efee6ca0 2024-09-13T18:03:22.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 -- 172.21.15.27:0/2511689582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 msgr2=0x55c4efee3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:22.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 --2- 172.21.15.27:0/2511689582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee3700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5274000f80 tx=0x7f5274011ca0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 -- 172.21.15.27:0/2511689582 shutdown_connections 2024-09-13T18:03:22.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 --2- 172.21.15.27:0/2511689582 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 0x55c4efee3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 --2- 172.21.15.27:0/2511689582 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efeec670 0x55c4efef7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 --2- 172.21.15.27:0/2511689582 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efee6ca0 0x55c4efee3700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 -- 172.21.15.27:0/2511689582 >> 172.21.15.27:0/2511689582 conn(0x55c4efee2310 msgr2=0x55c4efef0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 -- 172.21.15.27:0/2511689582 shutdown_connections 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 -- 172.21.15.27:0/2511689582 wait complete. 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 -- start start 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.992+0000 7f5284228740 1 Processor -- start 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5284228740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee6ca0 0x55c4efef52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5284228740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efeec670 0x55c4efef5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5284228740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 0x55c4efef67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5284228740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efef6d30 con 0x55c4efeec670 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5284228740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efef6ea0 con 0x55c4efee6ca0 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5284228740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4efef7060 con 0x55c4efefda70 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5284228740 10 client.0 _ll_register_callbacks cb 0x7f5264009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:22.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5273e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efeec670 0x55c4efef5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5273e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efeec670 0x55c4efef5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58026/0 (socket says 172.21.15.27:58026) 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5273e00640 1 -- 172.21.15.27:0/2850540581 learned_addr learned my addr 172.21.15.27:0/2850540581 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f527b200640 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 0x55c4efef67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f527b200640 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee6ca0 0x55c4efef52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5273e00640 1 -- 172.21.15.27:0/2850540581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 msgr2=0x55c4efef67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5273e00640 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 0x55c4efef67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5273e00640 1 -- 172.21.15.27:0/2850540581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee6ca0 msgr2=0x55c4efef52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5273e00640 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee6ca0 0x55c4efef52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f5273e00640 1 -- 172.21.15.27:0/2850540581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5274021040 con 0x55c4efeec670 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.993+0000 7f527b200640 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee6ca0 0x55c4efef52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.994+0000 7f5273e00640 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efeec670 0x55c4efef5830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5264012cf0 tx=0x7f5264012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e34e9214e97e8d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.000 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.994+0000 7f5268c00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.994+0000 7f5268c00640 1 -- 172.21.15.27:0/2850540581 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264017040 con 0x55c4efeec670 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.994+0000 7f5268c00640 1 -- 172.21.15.27:0/2850540581 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5264010a60 con 0x55c4efeec670 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.994+0000 7f5284228740 1 -- 172.21.15.27:0/2850540581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5274003e50 con 0x55c4efeec670 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.994+0000 7f5268c00640 1 -- 172.21.15.27:0/2850540581 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5264010c40 con 0x55c4efeec670 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.994+0000 7f5284228740 10 client.14943 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.994+0000 7f5284228740 1 -- 172.21.15.27:0/2850540581 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c4efe0f980 con 0x55c4efeec670 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.994+0000 7f5268c00640 1 -- 172.21.15.27:0/2850540581 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5274003e50 con 0x55c4efeec670 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f5268c00640 1 -- 172.21.15.27:0/2850540581 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5264039070 con 0x55c4efeec670 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f5284228740 10 client.14943 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f5284228740 10 client.14943 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f5284228740 20 client.14943 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f5284228740 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x55c4eff58760 0x55c4eff55050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.001 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f5284228740 4 client.14943 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f5284228740 1 -- 172.21.15.27:0/2850540581 --> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c4efb4e6c0 con 0x55c4eff58760 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f527b200640 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x55c4eff58760 0x55c4eff55050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f527b200640 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x55c4eff58760 0x55c4eff55050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=33b23320a1ad2138 server_cookie=bb40cdb1ca0058b8 in_seq=0 out_seq=0 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.995+0000 7f5268c00640 10 client.14943 ms_handle_connect on v2:172.21.15.143:6832/2820864881 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5268c00640 1 -- 172.21.15.27:0/2850540581 <== mds.4 v2:172.21.15.143:6832/2820864881 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x55c4efb4e6c0 con 0x55c4eff58760 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5268c00640 10 client.14943 handle_command_reply: tid=0 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 client.14943 shutdown 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 -- 172.21.15.27:0/2850540581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efeec670 msgr2=0x55c4efef5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efeec670 0x55c4efef5830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5264012cf0 tx=0x7f5264012a00 comp rx=0 tx=0).stop 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 -- 172.21.15.27:0/2850540581 shutdown_connections 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x55c4eff58760 0x55c4eff55050 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c4efefda70 0x55c4efef67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c4efeec670 0x55c4efef5830 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.002 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5268c00640 0 client.14943 ms_handle_reset on v2:172.21.15.143:6832/2820864881 2024-09-13T18:03:23.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 --2- 172.21.15.27:0/2850540581 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c4efee6ca0 0x55c4efef52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 -- 172.21.15.27:0/2850540581 >> 172.21.15.27:0/2850540581 conn(0x55c4efee2310 msgr2=0x55c4eff05090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 -- 172.21.15.27:0/2850540581 shutdown_connections 2024-09-13T18:03:23.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 1 -- 172.21.15.27:0/2850540581 wait complete. 2024-09-13T18:03:23.003 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.996+0000 7f5284228740 20 client.14943 trim_cache size 0 max 16384 2024-09-13T18:03:23.003 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:23.003 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:23.003 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 4, 2024-09-13T18:03:23.003 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24448, 2024-09-13T18:03:23.004 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:23.004 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:23.004 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:23.004 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 90.943216346, 2024-09-13T18:03:23.004 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:23.004 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:23.004 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:23.004 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 133.988294602 2024-09-13T18:03:23.004 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:23.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 -- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f52600a1090 msgr2=0x7f52600a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f52600a1090 0x7f52600a3550 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f526c0b76d0 tx=0x7f526c0f3530 comp rx=0 tx=0).stop 2024-09-13T18:03:23.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 -- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c072eb0 msgr2=0x7f527c197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c072eb0 0x7f527c197e70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f526c031510 tx=0x7f526c004270 comp rx=0 tx=0).stop 2024-09-13T18:03:23.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 -- 172.21.15.27:0/62086816 shutdown_connections 2024-09-13T18:03:23.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f52600a1090 0x7f52600a3550 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f527c107a40 0x7f527c19f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f527c074490 0x7f527c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.005 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 --2- 172.21.15.27:0/62086816 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f527c072eb0 0x7f527c197e70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 -- 172.21.15.27:0/62086816 >> 172.21.15.27:0/62086816 conn(0x7f527c0fb330 msgr2=0x7f527c1039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 -- 172.21.15.27:0/62086816 shutdown_connections 2024-09-13T18:03:23.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:22.997+0000 7f5280a00640 1 -- 172.21.15.27:0/62086816 wait complete. 2024-09-13T18:03:23.014 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T18:03:23.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:22 smithi027 ceph-mon[30611]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T18:03:23.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:22 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/954502070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:23.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:22 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3790905980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:23.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:22 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2310671278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:23.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.174+0000 7faf15e00640 1 -- 172.21.15.27:0/1019925602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf100ffd70 msgr2=0x7faf10100170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.174+0000 7faf15e00640 1 --2- 172.21.15.27:0/1019925602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf100ffd70 0x7faf10100170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faf00009be0 tx=0x7faf0002a6c0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.174+0000 7faf15e00640 1 -- 172.21.15.27:0/1019925602 shutdown_connections 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.174+0000 7faf15e00640 1 --2- 172.21.15.27:0/1019925602 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf10101920 0x7faf101081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.174+0000 7faf15e00640 1 --2- 172.21.15.27:0/1019925602 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf10100f60 0x7faf101013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.174+0000 7faf15e00640 1 --2- 172.21.15.27:0/1019925602 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf100ffd70 0x7faf10100170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.174+0000 7faf15e00640 1 -- 172.21.15.27:0/1019925602 >> 172.21.15.27:0/1019925602 conn(0x7faf100fb4d0 msgr2=0x7faf100fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.174+0000 7faf15e00640 1 -- 172.21.15.27:0/1019925602 shutdown_connections 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.174+0000 7faf15e00640 1 -- 172.21.15.27:0/1019925602 wait complete. 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf15e00640 1 Processor -- start 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf15e00640 1 -- start start 2024-09-13T18:03:23.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf15e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf100ffd70 0x7faf10074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf15e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf10100f60 0x7faf100728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf15e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf10101920 0x7faf10072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf15e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10073540 con 0x7faf10100f60 2024-09-13T18:03:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf15e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100736b0 con 0x7faf10101920 2024-09-13T18:03:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf15e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1019fea0 con 0x7faf100ffd70 2024-09-13T18:03:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf06000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf10100f60 0x7faf100728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf100ffd70 0x7faf10074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf100ffd70 0x7faf10074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:44422/0 (socket says 172.21.15.27:44422) 2024-09-13T18:03:23.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.175+0000 7faf0ea00640 1 -- 172.21.15.27:0/1150404239 learned_addr learned my addr 172.21.15.27:0/1150404239 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf0f400640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf10101920 0x7faf10072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf06000640 1 -- 172.21.15.27:0/1150404239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf100ffd70 msgr2=0x7faf10074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf06000640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf100ffd70 0x7faf10074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf06000640 1 -- 172.21.15.27:0/1150404239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf10101920 msgr2=0x7faf10072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf06000640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf10101920 0x7faf10072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf06000640 1 -- 172.21.15.27:0/1150404239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf00009840 con 0x7faf10100f60 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf06000640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf10100f60 0x7faf100728a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faef800e7c0 tx=0x7faef800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf14a00640 1 -- 172.21.15.27:0/1150404239 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef800ccc0 con 0x7faf10100f60 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf15e00640 1 -- 172.21.15.27:0/1150404239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf101a0150 con 0x7faf10100f60 2024-09-13T18:03:23.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf14a00640 1 -- 172.21.15.27:0/1150404239 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faef800eed0 con 0x7faf10100f60 2024-09-13T18:03:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf14a00640 1 -- 172.21.15.27:0/1150404239 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef8018710 con 0x7faf10100f60 2024-09-13T18:03:23.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.176+0000 7faf15e00640 1 -- 172.21.15.27:0/1150404239 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf101a06b0 con 0x7faf10100f60 2024-09-13T18:03:23.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.180+0000 7faf18c59740 1 Processor -- start 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.180+0000 7faf18c59740 1 -- start start 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf18c59740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd89b30 0x55657fd89f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf18c59740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd8a470 0x55657fd8ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf18c59740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8f500 0x55657fd919c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf18c59740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fcf3ab0 con 0x55657fd8a470 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf18c59740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fcf1240 con 0x55657fd89b30 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf18c59740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fcecb30 con 0x55657fd8f500 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf14a00640 1 -- 172.21.15.27:0/1150404239 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7faef80109a0 con 0x7faf10100f60 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf0f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd89b30 0x55657fd89f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf0f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd89b30 0x55657fd89f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:59330/0 (socket says 172.21.15.27:59330) 2024-09-13T18:03:23.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf0f400640 1 -- 172.21.15.27:0/2196513310 learned_addr learned my addr 172.21.15.27:0/2196513310 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf0ea00640 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd8a470 0x55657fd8ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf06000640 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8f500 0x55657fd919c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.181+0000 7faf0f400640 1 -- 172.21.15.27:0/2196513310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8f500 msgr2=0x55657fd919c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf0f400640 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8f500 0x55657fd919c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf0f400640 1 -- 172.21.15.27:0/2196513310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd8a470 msgr2=0x55657fd8ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf0f400640 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd8a470 0x55657fd8ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf0f400640 1 -- 172.21.15.27:0/2196513310 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55657fcb7bd0 con 0x55657fd89b30 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf06000640 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8f500 0x55657fd919c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf0ea00640 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd8a470 0x55657fd8ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:23.185 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf0f400640 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd89b30 0x55657fd89f30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf08009ca0 tx=0x7faf08011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2fe942de36cd208 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf04c00640 1 -- 172.21.15.27:0/2196513310 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf08019630 con 0x55657fd89b30 2024-09-13T18:03:23.189 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf04c00640 1 -- 172.21.15.27:0/2196513310 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf08009e50 con 0x55657fd89b30 2024-09-13T18:03:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.182+0000 7faf04c00640 1 -- 172.21.15.27:0/2196513310 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0800ebe0 con 0x55657fd89b30 2024-09-13T18:03:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf14a00640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faef40a1090 0x7faef40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 -- 172.21.15.27:0/2196513310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd89b30 msgr2=0x55657fd89f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd89b30 0x55657fd89f30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf08009ca0 tx=0x7faf08011810 comp rx=0 tx=0).stop 2024-09-13T18:03:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 -- 172.21.15.27:0/2196513310 shutdown_connections 2024-09-13T18:03:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8f500 0x55657fd919c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd8a470 0x55657fd8ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 --2- 172.21.15.27:0/2196513310 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd89b30 0x55657fd89f30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 -- 172.21.15.27:0/2196513310 >> 172.21.15.27:0/2196513310 conn(0x55657fd851a0 msgr2=0x55657fd855a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf14a00640 1 -- 172.21.15.27:0/1150404239 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faef8014070 con 0x7faf10100f60 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf0ea00640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faef40a1090 0x7faef40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 -- 172.21.15.27:0/2196513310 shutdown_connections 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 -- 172.21.15.27:0/2196513310 wait complete. 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.183+0000 7faf18c59740 1 -- start start 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf0ea00640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faef40a1090 0x7faef40a3550 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55657fd8aea0 tx=0x7faf000309a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf18c59740 1 Processor -- start 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf18c59740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf18c59740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd93cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf18c59740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fd9acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf18c59740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fc8e260 con 0x55657fd89b30 2024-09-13T18:03:23.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf18c59740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fc8df00 con 0x55657fd8f500 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf18c59740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fa53f20 con 0x55657fd8a470 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf18c59740 10 client.0 _ll_register_callbacks cb 0x55657fce61a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf06000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd93cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58056/0 (socket says 172.21.15.27:58056) 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.184+0000 7faf0ea00640 1 -- 172.21.15.27:0/3810917977 learned_addr learned my addr 172.21.15.27:0/3810917977 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.185+0000 7faf0f400640 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fd9acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.185+0000 7faf0ea00640 1 -- 172.21.15.27:0/3810917977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 msgr2=0x55657fd93cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.185+0000 7faf0ea00640 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd93cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.185+0000 7faf0ea00640 1 -- 172.21.15.27:0/3810917977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 msgr2=0x55657fd9acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.185+0000 7faf0ea00640 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fd9acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.185+0000 7faf0ea00640 1 -- 172.21.15.27:0/3810917977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf08009950 con 0x55657fd89b30 2024-09-13T18:03:23.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.185+0000 7faf0ea00640 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf00034040 tx=0x7faf0002a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b9dcc1b9b116d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.185+0000 7faefd600640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.185+0000 7faefd600640 1 -- 172.21.15.27:0/3810917977 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00041070 con 0x55657fd89b30 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faf18c59740 1 -- 172.21.15.27:0/3810917977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55657fd16cd0 con 0x55657fd89b30 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faefd600640 1 -- 172.21.15.27:0/3810917977 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faf00004040 con 0x55657fd89b30 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faefd600640 1 -- 172.21.15.27:0/3810917977 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf00059030 con 0x55657fd89b30 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faf18c59740 10 client.14955 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faf18c59740 1 -- 172.21.15.27:0/3810917977 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55657fceb1b0 con 0x55657fd89b30 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faefd600640 1 -- 172.21.15.27:0/3810917977 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55657fd16cd0 con 0x55657fd89b30 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faefd600640 1 -- 172.21.15.27:0/3810917977 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf00053960 con 0x55657fd89b30 2024-09-13T18:03:23.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faf18c59740 10 client.14955 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:23.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faf18c59740 10 client.14955 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T18:03:23.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faf18c59740 20 client.14955 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:23.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.186+0000 7faf18c59740 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55657fd9fc20 0x55657fda3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.187+0000 7faf18c59740 4 client.14955 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:23.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.187+0000 7faf18c59740 1 -- 172.21.15.27:0/3810917977 --> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55657f9e03c0 con 0x55657fd9fc20 2024-09-13T18:03:23.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.187+0000 7faf06000640 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55657fd9fc20 0x55657fda3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.187+0000 7faf06000640 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55657fd9fc20 0x55657fda3dc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2f00f08f115f69d9 server_cookie=5013bc68bf1f4871 in_seq=0 out_seq=0 2024-09-13T18:03:23.194 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.187+0000 7faefd600640 10 client.14955 ms_handle_connect on v2:172.21.15.143:6838/1150747117 2024-09-13T18:03:23.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.188+0000 7faefd600640 1 -- 172.21.15.27:0/3810917977 <== mds.3 v2:172.21.15.143:6838/1150747117 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55657f9e03c0 con 0x55657fd9fc20 2024-09-13T18:03:23.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.188+0000 7faefd600640 10 client.14955 handle_command_reply: tid=0 2024-09-13T18:03:23.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.188+0000 7faf18c59740 1 client.14955 shutdown 2024-09-13T18:03:23.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.188+0000 7faf18c59740 1 -- 172.21.15.27:0/3810917977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 msgr2=0x55657fd93790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.188+0000 7faf18c59740 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf00034040 tx=0x7faf0002a6c0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faf18c59740 1 -- 172.21.15.27:0/3810917977 shutdown_connections 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faf18c59740 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fd9acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faf18c59740 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55657fd9fc20 0x55657fda3dc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faf18c59740 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd93cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faf18c59740 1 --2- 172.21.15.27:0/3810917977 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faefd600640 0 client.14955 ms_handle_reset on v2:172.21.15.143:6838/1150747117 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faf18c59740 1 -- 172.21.15.27:0/3810917977 >> 172.21.15.27:0/3810917977 conn(0x55657fd851a0 msgr2=0x55657fd869b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faf18c59740 1 -- 172.21.15.27:0/3810917977 shutdown_connections 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faf18c59740 1 -- 172.21.15.27:0/3810917977 wait complete. 2024-09-13T18:03:23.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.189+0000 7faf18c59740 20 client.14955 trim_cache size 0 max 16384 2024-09-13T18:03:23.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.204+0000 7faf18c59740 1 Processor -- start 2024-09-13T18:03:23.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.204+0000 7faf18c59740 1 -- start start 2024-09-13T18:03:23.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf18c59740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf18c59740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd9abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf18c59740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fda7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf18c59740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fd16d00 con 0x55657fd89b30 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf18c59740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fd8ad60 con 0x55657fd8f500 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf18c59740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fce58d0 con 0x55657fd8a470 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58064/0 (socket says 172.21.15.27:58064) 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0ea00640 1 -- 172.21.15.27:0/3871194387 learned_addr learned my addr 172.21.15.27:0/3871194387 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf06000640 1 --2- 172.21.15.27:0/3871194387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd9abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0f400640 1 --2- 172.21.15.27:0/3871194387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fda7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0ea00640 1 -- 172.21.15.27:0/3871194387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 msgr2=0x55657fd9abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0ea00640 1 --2- 172.21.15.27:0/3871194387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd9abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0ea00640 1 -- 172.21.15.27:0/3871194387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 msgr2=0x55657fda7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0ea00640 1 --2- 172.21.15.27:0/3871194387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fda7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0ea00640 1 -- 172.21.15.27:0/3871194387 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55657fc8d470 con 0x55657fd89b30 2024-09-13T18:03:23.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.205+0000 7faf0ea00640 1 --2- 172.21.15.27:0/3871194387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faf00009370 tx=0x7faf00030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e65dce5a97c4fca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf05600640 1 -- 172.21.15.27:0/3871194387 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00059040 con 0x55657fd89b30 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf05600640 1 -- 172.21.15.27:0/3871194387 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf000315e0 con 0x55657fd89b30 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf05600640 1 -- 172.21.15.27:0/3871194387 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0004a690 con 0x55657fd89b30 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf18c59740 1 -- 172.21.15.27:0/3871194387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 msgr2=0x55657fd93c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf18c59740 1 --2- 172.21.15.27:0/3871194387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93c50 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faf00009370 tx=0x7faf00030ec0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf18c59740 1 -- 172.21.15.27:0/3871194387 shutdown_connections 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf18c59740 1 --2- 172.21.15.27:0/3871194387 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fda7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf18c59740 1 --2- 172.21.15.27:0/3871194387 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd9abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf18c59740 1 --2- 172.21.15.27:0/3871194387 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd93c50 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf18c59740 1 -- 172.21.15.27:0/3871194387 >> 172.21.15.27:0/3871194387 conn(0x55657fd851a0 msgr2=0x55657fd93540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.206+0000 7faf18c59740 1 -- 172.21.15.27:0/3871194387 shutdown_connections 2024-09-13T18:03:23.214 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 1 -- 172.21.15.27:0/3871194387 wait complete. 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 1 -- start start 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 1 Processor -- start 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd9a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd974e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fd97a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fd97f60 con 0x55657fd89b30 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fd980d0 con 0x55657fd8f500 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55657fdf5a80 con 0x55657fd8a470 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.207+0000 7faf18c59740 10 client.0 _ll_register_callbacks cb 0x7faf08005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd9a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0ea00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd9a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58070/0 (socket says 172.21.15.27:58070) 2024-09-13T18:03:23.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0ea00640 1 -- 172.21.15.27:0/3821451223 learned_addr learned my addr 172.21.15.27:0/3821451223 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0f400640 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fd97a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf06000640 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0ea00640 1 -- 172.21.15.27:0/3821451223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 msgr2=0x55657fd974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0ea00640 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0ea00640 1 -- 172.21.15.27:0/3821451223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 msgr2=0x55657fd97a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0ea00640 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fd97a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0ea00640 1 -- 172.21.15.27:0/3821451223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55657fceb1b0 con 0x55657fd89b30 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faf0ea00640 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd9a9a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faf00053d10 tx=0x7faf00031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd463b5046cddbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faefd600640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.208+0000 7faefd600640 1 -- 172.21.15.27:0/3821451223 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf00059040 con 0x55657fd89b30 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faefd600640 1 -- 172.21.15.27:0/3821451223 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faf0005a070 con 0x55657fd89b30 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faf18c59740 1 -- 172.21.15.27:0/3821451223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf08009e50 con 0x55657fd89b30 2024-09-13T18:03:23.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faefd600640 1 -- 172.21.15.27:0/3821451223 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf000539c0 con 0x55657fd89b30 2024-09-13T18:03:23.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faf18c59740 10 client.14961 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:23.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faf18c59740 1 -- 172.21.15.27:0/3821451223 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55657fcb2980 con 0x55657fd89b30 2024-09-13T18:03:23.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faefd600640 1 -- 172.21.15.27:0/3821451223 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf08009e50 con 0x55657fd89b30 2024-09-13T18:03:23.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faefd600640 1 -- 172.21.15.27:0/3821451223 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf000665c0 con 0x55657fd89b30 2024-09-13T18:03:23.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faf18c59740 10 client.14961 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:23.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faf18c59740 10 client.14961 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T18:03:23.217 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faf18c59740 20 client.14961 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faf18c59740 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55657fdfa2f0 0x55657fdf6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faf18c59740 4 client.14961 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.209+0000 7faf18c59740 1 -- 172.21.15.27:0/3821451223 --> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55657f9f16c0 con 0x55657fdfa2f0 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.210+0000 7faf06000640 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55657fdfa2f0 0x55657fdf6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.210+0000 7faf06000640 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55657fdfa2f0 0x55657fdf6c60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f341497a397cb891 server_cookie=7ff579ec9a5b5102 in_seq=0 out_seq=0 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.210+0000 7faefd600640 10 client.14961 ms_handle_connect on v2:172.21.15.143:6838/1150747117 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.210+0000 7faefd600640 1 -- 172.21.15.27:0/3821451223 <== mds.3 v2:172.21.15.143:6838/1150747117 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55657f9f16c0 con 0x55657fdfa2f0 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.210+0000 7faefd600640 10 client.14961 handle_command_reply: tid=0 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.210+0000 7faf18c59740 1 client.14961 shutdown 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.210+0000 7faf18c59740 1 -- 172.21.15.27:0/3821451223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 msgr2=0x55657fd9a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.210+0000 7faf18c59740 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd9a9a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7faf00053d10 tx=0x7faf00031de0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf18c59740 1 -- 172.21.15.27:0/3821451223 shutdown_connections 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf18c59740 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55657fd8f500 0x55657fd97a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.218 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf18c59740 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55657fdfa2f0 0x55657fdf6c60 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf18c59740 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55657fd8a470 0x55657fd974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faefd600640 0 client.14961 ms_handle_reset on v2:172.21.15.143:6838/1150747117 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf18c59740 1 --2- 172.21.15.27:0/3821451223 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55657fd89b30 0x55657fd9a9a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf18c59740 1 -- 172.21.15.27:0/3821451223 >> 172.21.15.27:0/3821451223 conn(0x55657fd851a0 msgr2=0x55657fda7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf18c59740 1 -- 172.21.15.27:0/3821451223 shutdown_connections 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf18c59740 1 -- 172.21.15.27:0/3821451223 wait complete. 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf18c59740 20 client.14961 trim_cache size 0 max 16384 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:23.219 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 3, 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24529, 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 91.844005421000006, 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 112.544918404 2024-09-13T18:03:23.220 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:23.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 -- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faef40a1090 msgr2=0x7faef40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faef40a1090 0x7faef40a3550 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55657fd8aea0 tx=0x7faf000309a0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 -- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf10100f60 msgr2=0x7faf100728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf10100f60 0x7faf100728a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faef800e7c0 tx=0x7faef800ec80 comp rx=0 tx=0).stop 2024-09-13T18:03:23.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 -- 172.21.15.27:0/1150404239 shutdown_connections 2024-09-13T18:03:23.221 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faef40a1090 0x7faef40a3550 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf10101920 0x7faf10072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf10100f60 0x7faf100728a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 --2- 172.21.15.27:0/1150404239 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf100ffd70 0x7faf10074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.211+0000 7faf15e00640 1 -- 172.21.15.27:0/1150404239 >> 172.21.15.27:0/1150404239 conn(0x7faf100fb4d0 msgr2=0x7faf10104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.212+0000 7faf15e00640 1 -- 172.21.15.27:0/1150404239 shutdown_connections 2024-09-13T18:03:23.222 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.212+0000 7faf15e00640 1 -- 172.21.15.27:0/1150404239 wait complete. 2024-09-13T18:03:23.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:22 smithi122 ceph-mon[35310]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T18:03:23.222 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:22 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/954502070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:23.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:22 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3790905980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:23.223 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:22 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2310671278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:23.230 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-09-13T18:03:23.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:22 smithi143 ceph-mon[38210]: pgmap v341: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T18:03:23.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:22 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/954502070' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:23.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:22 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3790905980' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:23.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:22 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2310671278' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.430+0000 7f1329400640 1 -- 172.21.15.27:0/2402018551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 msgr2=0x7f1324102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.430+0000 7f1329400640 1 --2- 172.21.15.27:0/2402018551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 0x7f1324102390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1314009860 tx=0x7f131402a340 comp rx=0 tx=0).stop 2024-09-13T18:03:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.430+0000 7f1329400640 1 -- 172.21.15.27:0/2402018551 shutdown_connections 2024-09-13T18:03:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.430+0000 7f1329400640 1 --2- 172.21.15.27:0/2402018551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1324103b40 0x7f132410a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.432 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.430+0000 7f1329400640 1 --2- 172.21.15.27:0/2402018551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1324103180 0x7f1324103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.430+0000 7f1329400640 1 --2- 172.21.15.27:0/2402018551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 0x7f1324102390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.430+0000 7f1329400640 1 -- 172.21.15.27:0/2402018551 >> 172.21.15.27:0/2402018551 conn(0x7f13240fd6d0 msgr2=0x7f13240ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.430+0000 7f1329400640 1 -- 172.21.15.27:0/2402018551 shutdown_connections 2024-09-13T18:03:23.433 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.430+0000 7f1329400640 1 -- 172.21.15.27:0/2402018551 wait complete. 2024-09-13T18:03:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.431+0000 7f1329400640 1 Processor -- start 2024-09-13T18:03:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.431+0000 7f1329400640 1 -- start start 2024-09-13T18:03:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.431+0000 7f1329400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 0x7f1324198070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.431+0000 7f1329400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1324103180 0x7f13241985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.431+0000 7f1329400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1324103b40 0x7f132419f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.431+0000 7f1329400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132419fb60 con 0x7f1324103b40 2024-09-13T18:03:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.431+0000 7f1329400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132419fcd0 con 0x7f1324101f90 2024-09-13T18:03:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.431+0000 7f1329400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132419fe90 con 0x7f1324103180 2024-09-13T18:03:23.435 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1322800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 0x7f1324198070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1322800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 0x7f1324198070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:59378/0 (socket says 172.21.15.27:59378) 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1322800640 1 -- 172.21.15.27:0/4079533974 learned_addr learned my addr 172.21.15.27:0/4079533974 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1323200640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1324103b40 0x7f132419f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1321e00640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1324103180 0x7f13241985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1322800640 1 -- 172.21.15.27:0/4079533974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1324103180 msgr2=0x7f13241985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1322800640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1324103180 0x7f13241985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1322800640 1 -- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1324103b40 msgr2=0x7f132419f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1322800640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1324103b40 0x7f132419f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1322800640 1 -- 172.21.15.27:0/4079533974 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1314009490 con 0x7f1324101f90 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.432+0000 7f1322800640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 0x7f1324198070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f131402a860 tx=0x7f13140326f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.433+0000 7f131b400640 1 -- 172.21.15.27:0/4079533974 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314032ea0 con 0x7f1324101f90 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.433+0000 7f131b400640 1 -- 172.21.15.27:0/4079533974 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f13140303b0 con 0x7f1324101f90 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.433+0000 7f131b400640 1 -- 172.21.15.27:0/4079533974 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131403b430 con 0x7f1324101f90 2024-09-13T18:03:23.436 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.433+0000 7f1329400640 1 -- 172.21.15.27:0/4079533974 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13241a0110 con 0x7f1324101f90 2024-09-13T18:03:23.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.433+0000 7f1329400640 1 -- 172.21.15.27:0/4079533974 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13241a0510 con 0x7f1324101f90 2024-09-13T18:03:23.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f132c267740 1 Processor -- start 2024-09-13T18:03:23.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f132c267740 1 -- start start 2024-09-13T18:03:23.437 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f131b400640 1 -- 172.21.15.27:0/4079533974 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1314039040 con 0x7f1324101f90 2024-09-13T18:03:23.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f132c267740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb505f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f132c267740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb50af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f132c267740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb50d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.439 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f132c267740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb46fab0 con 0x55c7bb506470 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f132c267740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb46d240 con 0x55c7bb505b30 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f132c267740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb468b30 con 0x55c7bb50b500 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f1323200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb505f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f1323200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb505f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:59390/0 (socket says 172.21.15.27:59390) 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f1323200640 1 -- 172.21.15.27:0/1545767267 learned_addr learned my addr 172.21.15.27:0/1545767267 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.436+0000 7f1322800640 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb50af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f1321e00640 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb50d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f1323200640 1 -- 172.21.15.27:0/1545767267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 msgr2=0x55c7bb50d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f1323200640 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb50d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f1323200640 1 -- 172.21.15.27:0/1545767267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 msgr2=0x55c7bb50af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f1323200640 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb50af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f1323200640 1 -- 172.21.15.27:0/1545767267 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7bb433bd0 con 0x55c7bb505b30 2024-09-13T18:03:23.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f1321e00640 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb50d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:23.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f1322800640 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb50af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:23.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f1323200640 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb505f30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f131c010370 tx=0x7f131c010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322b2ee7197c7a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f131b400640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13080a1090 0x7f13080a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f130fe00640 1 -- 172.21.15.27:0/1545767267 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c004d20 con 0x55c7bb505b30 2024-09-13T18:03:23.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.437+0000 7f131b400640 1 -- 172.21.15.27:0/4079533974 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f13140ecd90 con 0x7f1324101f90 2024-09-13T18:03:23.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f130fe00640 1 -- 172.21.15.27:0/1545767267 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f131c004e80 con 0x55c7bb505b30 2024-09-13T18:03:23.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f1322800640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13080a1090 0x7f13080a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f130fe00640 1 -- 172.21.15.27:0/1545767267 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c005560 con 0x55c7bb505b30 2024-09-13T18:03:23.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f132c267740 1 -- 172.21.15.27:0/1545767267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 msgr2=0x55c7bb505f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f1322800640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13080a1090 0x7f13080a3550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1314005d20 tx=0x7f1314005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f132c267740 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb505f30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f131c010370 tx=0x7f131c010830 comp rx=0 tx=0).stop 2024-09-13T18:03:23.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f132c267740 1 -- 172.21.15.27:0/1545767267 shutdown_connections 2024-09-13T18:03:23.444 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f132c267740 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb50d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f132c267740 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb50af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f132c267740 1 --2- 172.21.15.27:0/1545767267 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb505f30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f132c267740 1 -- 172.21.15.27:0/1545767267 >> 172.21.15.27:0/1545767267 conn(0x55c7bb5011a0 msgr2=0x55c7bb5015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f132c267740 1 -- 172.21.15.27:0/1545767267 shutdown_connections 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.438+0000 7f132c267740 1 -- 172.21.15.27:0/1545767267 wait complete. 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.439+0000 7f132c267740 1 -- start start 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.439+0000 7f132c267740 1 Processor -- start 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.439+0000 7f132c267740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb505b30 0x55c7bb50f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.439+0000 7f132c267740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb50fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.439+0000 7f132c267740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb50b500 0x55c7bb516d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.439+0000 7f132c267740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb40a260 con 0x55c7bb50b500 2024-09-13T18:03:23.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.439+0000 7f132c267740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb409f00 con 0x55c7bb506470 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.439+0000 7f132c267740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb1cff20 con 0x55c7bb505b30 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.439+0000 7f132c267740 10 client.0 _ll_register_callbacks cb 0x55c7bb4621a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1321e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb50fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1323200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb50b500 0x55c7bb516d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1321e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb50fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:59394/0 (socket says 172.21.15.27:59394) 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1321e00640 1 -- 172.21.15.27:0/2810756110 learned_addr learned my addr 172.21.15.27:0/2810756110 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1323200640 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb505b30 0x55c7bb50f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1321e00640 1 -- 172.21.15.27:0/2810756110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb505b30 msgr2=0x55c7bb50f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1321e00640 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb505b30 0x55c7bb50f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1321e00640 1 -- 172.21.15.27:0/2810756110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb50b500 msgr2=0x55c7bb516d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1321e00640 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb50b500 0x55c7bb516d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1321e00640 1 -- 172.21.15.27:0/2810756110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131c009c50 con 0x55c7bb506470 2024-09-13T18:03:23.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1323200640 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb505b30 0x55c7bb50f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f1321e00640 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb50fd30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13100116f0 tx=0x7f1310011bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3761aa87fc7f9f6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.440+0000 7f130cc00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.441+0000 7f130cc00640 1 -- 172.21.15.27:0/2810756110 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310016070 con 0x55c7bb506470 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.441+0000 7f130cc00640 1 -- 172.21.15.27:0/2810756110 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1310004300 con 0x55c7bb506470 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.441+0000 7f132c267740 1 -- 172.21.15.27:0/2810756110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7bb15c3c0 con 0x55c7bb506470 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.441+0000 7f130cc00640 1 -- 172.21.15.27:0/2810756110 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13100044c0 con 0x55c7bb506470 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.441+0000 7f132c267740 10 client.25025 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.441+0000 7f132c267740 1 -- 172.21.15.27:0/2810756110 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c7bb4671b0 con 0x55c7bb506470 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.441+0000 7f130cc00640 1 -- 172.21.15.27:0/2810756110 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55c7bb15c3c0 con 0x55c7bb506470 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.441+0000 7f130cc00640 1 -- 172.21.15.27:0/2810756110 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f13100253d0 con 0x55c7bb506470 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.442+0000 7f132c267740 10 client.25025 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.442+0000 7f132c267740 10 client.25025 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.442+0000 7f132c267740 20 client.25025 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:23.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.442+0000 7f132c267740 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55c7bb51bc20 0x55c7bb51fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.442+0000 7f132c267740 4 client.25025 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:23.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.442+0000 7f132c267740 1 -- 172.21.15.27:0/2810756110 --> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7bb16d6c0 con 0x55c7bb51bc20 2024-09-13T18:03:23.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.442+0000 7f1323200640 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55c7bb51bc20 0x55c7bb51fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.442+0000 7f1323200640 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55c7bb51bc20 0x55c7bb51fd60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93157adc02167a02 server_cookie=497ab8bc0a02ec50 in_seq=0 out_seq=0 2024-09-13T18:03:23.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.442+0000 7f130cc00640 10 client.25025 ms_handle_connect on v2:172.21.15.122:6836/65111779 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.443+0000 7f130cc00640 1 -- 172.21.15.27:0/2810756110 <== mds.2 v2:172.21.15.122:6836/65111779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55c7bb16d6c0 con 0x55c7bb51bc20 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.443+0000 7f130cc00640 10 client.25025 handle_command_reply: tid=0 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 client.25025 shutdown 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 -- 172.21.15.27:0/2810756110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 msgr2=0x55c7bb50fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb50fd30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f13100116f0 tx=0x7f1310011bb0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 -- 172.21.15.27:0/2810756110 shutdown_connections 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55c7bb51bc20 0x55c7bb51fd60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb50b500 0x55c7bb516d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb50fd30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 --2- 172.21.15.27:0/2810756110 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb505b30 0x55c7bb50f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 -- 172.21.15.27:0/2810756110 >> 172.21.15.27:0/2810756110 conn(0x55c7bb5011a0 msgr2=0x55c7bb5029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f130cc00640 0 client.25025 ms_handle_reset on v2:172.21.15.122:6836/65111779 2024-09-13T18:03:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 -- 172.21.15.27:0/2810756110 shutdown_connections 2024-09-13T18:03:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 1 -- 172.21.15.27:0/2810756110 wait complete. 2024-09-13T18:03:23.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.444+0000 7f132c267740 20 client.25025 trim_cache size 0 max 16384 2024-09-13T18:03:23.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.459+0000 7f132c267740 1 Processor -- start 2024-09-13T18:03:23.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.459+0000 7f132c267740 1 -- start start 2024-09-13T18:03:23.461 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f132c267740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb505b30 0x55c7bb50ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f132c267740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb516d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f132c267740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb50f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f132c267740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb15c3c0 con 0x55c7bb505b30 2024-09-13T18:03:23.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f132c267740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb506d30 con 0x55c7bb506470 2024-09-13T18:03:23.462 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f132c267740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb4267e0 con 0x55c7bb50b500 2024-09-13T18:03:23.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1323200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb505b30 0x55c7bb50ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1323200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb505b30 0x55c7bb50ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58128/0 (socket says 172.21.15.27:58128) 2024-09-13T18:03:23.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1323200640 1 -- 172.21.15.27:0/3429526269 learned_addr learned my addr 172.21.15.27:0/3429526269 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.463 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1321e00640 1 --2- 172.21.15.27:0/3429526269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb516d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1323200640 1 --2- 172.21.15.27:0/3429526269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb50f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1323200640 1 -- 172.21.15.27:0/3429526269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 msgr2=0x55c7bb50f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1323200640 1 --2- 172.21.15.27:0/3429526269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb50f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1323200640 1 -- 172.21.15.27:0/3429526269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 msgr2=0x55c7bb516d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1323200640 1 --2- 172.21.15.27:0/3429526269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb516d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.460+0000 7f1323200640 1 -- 172.21.15.27:0/3429526269 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7bb409470 con 0x55c7bb505b30 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f1323200640 1 --2- 172.21.15.27:0/3429526269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb505b30 0x55c7bb50ee30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f131c005cc0 tx=0x7f131c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d368e3b248d99271 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f1318c00640 1 -- 172.21.15.27:0/3429526269 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c02b570 con 0x55c7bb505b30 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f1318c00640 1 -- 172.21.15.27:0/3429526269 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f131c02b6d0 con 0x55c7bb505b30 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f1318c00640 1 -- 172.21.15.27:0/3429526269 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c0129b0 con 0x55c7bb505b30 2024-09-13T18:03:23.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f132c267740 1 -- 172.21.15.27:0/3429526269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb505b30 msgr2=0x55c7bb50ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f132c267740 1 --2- 172.21.15.27:0/3429526269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb505b30 0x55c7bb50ee30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f131c005cc0 tx=0x7f131c009bb0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f132c267740 1 -- 172.21.15.27:0/3429526269 shutdown_connections 2024-09-13T18:03:23.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f132c267740 1 --2- 172.21.15.27:0/3429526269 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb50f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f132c267740 1 --2- 172.21.15.27:0/3429526269 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb506470 0x55c7bb516d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f132c267740 1 --2- 172.21.15.27:0/3429526269 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb505b30 0x55c7bb50ee30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.461+0000 7f132c267740 1 -- 172.21.15.27:0/3429526269 >> 172.21.15.27:0/3429526269 conn(0x55c7bb5011a0 msgr2=0x55c7bb50e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.462+0000 7f132c267740 1 -- 172.21.15.27:0/3429526269 shutdown_connections 2024-09-13T18:03:23.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.462+0000 7f132c267740 1 -- 172.21.15.27:0/3429526269 wait complete. 2024-09-13T18:03:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.462+0000 7f132c267740 1 -- start start 2024-09-13T18:03:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.462+0000 7f132c267740 1 Processor -- start 2024-09-13T18:03:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.462+0000 7f132c267740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb511820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.462+0000 7f132c267740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb516cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f132c267740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb511ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f132c267740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb571a20 con 0x55c7bb506470 2024-09-13T18:03:23.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f132c267740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb571b60 con 0x55c7bb505b30 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f132c267740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7bb571cf0 con 0x55c7bb50b500 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f132c267740 10 client.0 _ll_register_callbacks cb 0x7f1310009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1321e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb516cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1321e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb516cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58132/0 (socket says 172.21.15.27:58132) 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1321e00640 1 -- 172.21.15.27:0/803996497 learned_addr learned my addr 172.21.15.27:0/803996497 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1323200640 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb511820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1323200640 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb511ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1321e00640 1 -- 172.21.15.27:0/803996497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 msgr2=0x55c7bb511ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1321e00640 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb511ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1321e00640 1 -- 172.21.15.27:0/803996497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 msgr2=0x55c7bb511820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1321e00640 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb511820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1321e00640 1 -- 172.21.15.27:0/803996497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7bb433bd0 con 0x55c7bb506470 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1323200640 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb511ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f1321e00640 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb516cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f13100116f0 tx=0x7f1310025600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8889f464101e85b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.463+0000 7f130cc00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f130cc00640 1 -- 172.21.15.27:0/803996497 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310016040 con 0x55c7bb506470 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f130cc00640 1 -- 172.21.15.27:0/803996497 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1310000e40 con 0x55c7bb506470 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f132c267740 1 -- 172.21.15.27:0/803996497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7bb492cd0 con 0x55c7bb506470 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f130cc00640 1 -- 172.21.15.27:0/803996497 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1310025ee0 con 0x55c7bb506470 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f132c267740 10 client.14979 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f132c267740 1 -- 172.21.15.27:0/803996497 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c7bb42e980 con 0x55c7bb506470 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f130cc00640 1 -- 172.21.15.27:0/803996497 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f131003e020 con 0x55c7bb506470 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f130cc00640 1 -- 172.21.15.27:0/803996497 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1310003710 con 0x55c7bb506470 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f132c267740 10 client.14979 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f132c267740 10 client.14979 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.464+0000 7f132c267740 20 client.14979 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.465+0000 7f132c267740 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55c7bb576a80 0x55c7bb5733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.471 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.465+0000 7f132c267740 4 client.14979 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.465+0000 7f132c267740 1 -- 172.21.15.27:0/803996497 --> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c7bb1c0d10 con 0x55c7bb576a80 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.465+0000 7f1323200640 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55c7bb576a80 0x55c7bb5733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.465+0000 7f1323200640 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55c7bb576a80 0x55c7bb5733f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=59bda6b6fd23388c server_cookie=447dbc4823b291aa in_seq=0 out_seq=0 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.465+0000 7f130cc00640 10 client.14979 ms_handle_connect on v2:172.21.15.122:6836/65111779 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f130cc00640 1 -- 172.21.15.27:0/803996497 <== mds.2 v2:172.21.15.122:6836/65111779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55c7bb1c0d10 con 0x55c7bb576a80 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f130cc00640 10 client.14979 handle_command_reply: tid=0 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 client.14979 shutdown 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 -- 172.21.15.27:0/803996497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 msgr2=0x55c7bb516cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb516cf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f13100116f0 tx=0x7f1310025600 comp rx=0 tx=0).stop 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 -- 172.21.15.27:0/803996497 shutdown_connections 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55c7bb576a80 0x55c7bb5733f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55c7bb50b500 0x55c7bb511ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55c7bb506470 0x55c7bb516cf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.472 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f130cc00640 0 client.14979 ms_handle_reset on v2:172.21.15.122:6836/65111779 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 --2- 172.21.15.27:0/803996497 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55c7bb505b30 0x55c7bb511820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 -- 172.21.15.27:0/803996497 >> 172.21.15.27:0/803996497 conn(0x55c7bb5011a0 msgr2=0x55c7bb50f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 -- 172.21.15.27:0/803996497 shutdown_connections 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 1 -- 172.21.15.27:0/803996497 wait complete. 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.466+0000 7f132c267740 20 client.14979 trim_cache size 0 max 16384 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 2, 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24533, 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:23.473 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:23.474 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 93.107514644000005, 2024-09-13T18:03:23.474 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:23.474 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:23.474 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:23.474 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 115.351070495 2024-09-13T18:03:23.474 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:23.474 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 -- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13080a1090 msgr2=0x7f13080a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13080a1090 0x7f13080a3550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1314005d20 tx=0x7f1314005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 -- 172.21.15.27:0/4079533974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 msgr2=0x7f1324198070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 0x7f1324198070 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f131402a860 tx=0x7f13140326f0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 -- 172.21.15.27:0/4079533974 shutdown_connections 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f13080a1090 0x7f13080a3550 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1324103b40 0x7f132419f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1324103180 0x7f13241985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 --2- 172.21.15.27:0/4079533974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1324101f90 0x7f1324198070 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 -- 172.21.15.27:0/4079533974 >> 172.21.15.27:0/4079533974 conn(0x7f13240fd6d0 msgr2=0x7f1324106640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 -- 172.21.15.27:0/4079533974 shutdown_connections 2024-09-13T18:03:23.475 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.467+0000 7f1329400640 1 -- 172.21.15.27:0/4079533974 wait complete. 2024-09-13T18:03:23.484 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:03:23.645 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.643+0000 7f63a3c00640 1 -- 172.21.15.27:0/3159210486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c103130 msgr2=0x7f639c105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.643+0000 7f63a3c00640 1 --2- 172.21.15.27:0/3159210486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c103130 0x7f639c105520 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6388009900 tx=0x7f638802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.643+0000 7f63a3c00640 1 -- 172.21.15.27:0/3159210486 shutdown_connections 2024-09-13T18:03:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.643+0000 7f63a3c00640 1 --2- 172.21.15.27:0/3159210486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f639c105a60 0x7f639c107ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.643+0000 7f63a3c00640 1 --2- 172.21.15.27:0/3159210486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c103130 0x7f639c105520 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.643+0000 7f63a3c00640 1 --2- 172.21.15.27:0/3159210486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f639c100800 0x7f639c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.643+0000 7f63a3c00640 1 -- 172.21.15.27:0/3159210486 >> 172.21.15.27:0/3159210486 conn(0x7f639c0fa3e0 msgr2=0x7f639c0fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.643+0000 7f63a3c00640 1 -- 172.21.15.27:0/3159210486 shutdown_connections 2024-09-13T18:03:23.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.643+0000 7f63a3c00640 1 -- 172.21.15.27:0/3159210486 wait complete. 2024-09-13T18:03:23.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.644+0000 7f63a3c00640 1 Processor -- start 2024-09-13T18:03:23.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.644+0000 7f63a3c00640 1 -- start start 2024-09-13T18:03:23.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.644+0000 7f63a3c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f639c100800 0x7f639c1980c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.644+0000 7f63a3c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f639c103130 0x7f639c198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.644+0000 7f63a3c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c105a60 0x7f639c19f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.644+0000 7f63a3c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c19fbb0 con 0x7f639c105a60 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.644+0000 7f63a3c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c19fd20 con 0x7f639c100800 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.644+0000 7f63a3c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c19fee0 con 0x7f639c103130 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c105a60 0x7f639c19f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c105a60 0x7f639c19f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58158/0 (socket says 172.21.15.27:58158) 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1c00640 1 -- 172.21.15.27:0/4056900579 learned_addr learned my addr 172.21.15.27:0/4056900579 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1200640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f639c100800 0x7f639c1980c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f639be00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f639c103130 0x7f639c198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1c00640 1 -- 172.21.15.27:0/4056900579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f639c103130 msgr2=0x7f639c198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1c00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f639c103130 0x7f639c198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1c00640 1 -- 172.21.15.27:0/4056900579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f639c100800 msgr2=0x7f639c1980c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.649 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1c00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f639c100800 0x7f639c1980c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1c00640 1 -- 172.21.15.27:0/4056900579 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6388009560 con 0x7f639c105a60 2024-09-13T18:03:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f639be00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f639c103130 0x7f639c198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.645+0000 7f63a1c00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c105a60 0x7f639c19f670 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f639400e9d0 tx=0x7f639400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.646+0000 7f6399600640 1 -- 172.21.15.27:0/4056900579 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639400cd80 con 0x7f639c105a60 2024-09-13T18:03:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.646+0000 7f6399600640 1 -- 172.21.15.27:0/4056900579 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6394005020 con 0x7f639c105a60 2024-09-13T18:03:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.646+0000 7f6399600640 1 -- 172.21.15.27:0/4056900579 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63940116d0 con 0x7f639c105a60 2024-09-13T18:03:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.646+0000 7f63a3c00640 1 -- 172.21.15.27:0/4056900579 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639c1a01c0 con 0x7f639c105a60 2024-09-13T18:03:23.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.646+0000 7f63a3c00640 1 -- 172.21.15.27:0/4056900579 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639c1a0650 con 0x7f639c105a60 2024-09-13T18:03:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.649+0000 7f63a6a3c740 1 Processor -- start 2024-09-13T18:03:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.649+0000 7f6399600640 1 -- 172.21.15.27:0/4056900579 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6394005500 con 0x7f639c105a60 2024-09-13T18:03:23.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.649+0000 7f63a6a3c740 1 -- start start 2024-09-13T18:03:23.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab712ab0 con 0x55b4ab7a9470 2024-09-13T18:03:23.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab710240 con 0x55b4ab7ae500 2024-09-13T18:03:23.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab70bb30 con 0x55b4ab7a8b30 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f639be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f639be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7a8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:44546/0 (socket says 172.21.15.27:44546) 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f639be00640 1 -- 172.21.15.27:0/614882232 learned_addr learned my addr 172.21.15.27:0/614882232 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f63a1200640 1 --2- 172.21.15.27:0/614882232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f639be00640 1 --2- 172.21.15.27:0/614882232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f639be00640 1 -- 172.21.15.27:0/614882232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 msgr2=0x55b4ab7a8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f639be00640 1 --2- 172.21.15.27:0/614882232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7a8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f639be00640 1 -- 172.21.15.27:0/614882232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 msgr2=0x55b4ab7adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f639be00640 1 --2- 172.21.15.27:0/614882232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.650+0000 7f639be00640 1 -- 172.21.15.27:0/614882232 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4ab6d6bd0 con 0x55b4ab7ae500 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.651+0000 7f6399600640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f63840a1110 0x7f63840a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.651+0000 7f639be00640 1 --2- 172.21.15.27:0/614882232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b09c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6388005ab0 tx=0x7f6388005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=605ba4483f8fffe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.654 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.651+0000 7f638e000640 1 -- 172.21.15.27:0/614882232 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388003c00 con 0x55b4ab7ae500 2024-09-13T18:03:23.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.651+0000 7f6399600640 1 -- 172.21.15.27:0/4056900579 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f63940cca00 con 0x7f639c105a60 2024-09-13T18:03:23.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.651+0000 7f638e000640 1 -- 172.21.15.27:0/614882232 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6388005510 con 0x55b4ab7ae500 2024-09-13T18:03:23.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.651+0000 7f638e000640 1 -- 172.21.15.27:0/614882232 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388004db0 con 0x55b4ab7ae500 2024-09-13T18:03:23.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.651+0000 7f63a1200640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f63840a1110 0x7f63840a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 -- 172.21.15.27:0/614882232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 msgr2=0x55b4ab7b09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/614882232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b09c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6388005ab0 tx=0x7f6388005a20 comp rx=0 tx=0).stop 2024-09-13T18:03:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a1200640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f63840a1110 0x7f63840a35d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55b4ab7a9ea0 tx=0x7f639000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.658 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 -- 172.21.15.27:0/614882232 shutdown_connections 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/614882232 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b09c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/614882232 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/614882232 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7a8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 -- 172.21.15.27:0/614882232 >> 172.21.15.27:0/614882232 conn(0x55b4ab7a41a0 msgr2=0x55b4ab7a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 -- 172.21.15.27:0/614882232 shutdown_connections 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 -- 172.21.15.27:0/614882232 wait complete. 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.652+0000 7f63a6a3c740 1 -- start start 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a6a3c740 1 Processor -- start 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab6ad260 con 0x55b4ab7ae500 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab6acf00 con 0x55b4ab7a8b30 2024-09-13T18:03:23.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab472f20 con 0x55b4ab7a9470 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a6a3c740 10 client.0 _ll_register_callbacks cb 0x55b4ab7051a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a1c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a1200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a1c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58186/0 (socket says 172.21.15.27:58186) 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f63a1c00640 1 -- 172.21.15.27:0/3770004632 learned_addr learned my addr 172.21.15.27:0/3770004632 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.653+0000 7f639be00640 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f63a1c00640 1 -- 172.21.15.27:0/3770004632 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a9470 msgr2=0x55b4ab7b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f63a1c00640 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f63a1c00640 1 -- 172.21.15.27:0/3770004632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7a8b30 msgr2=0x55b4ab7b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f63a1c00640 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f63a1c00640 1 -- 172.21.15.27:0/3770004632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6388045040 con 0x55b4ab7ae500 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f63a1200640 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:23.660 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f63a1c00640 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9d10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6394099e40 tx=0x7f63940052c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00040f1815222a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f6382a00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f6382a00640 1 -- 172.21.15.27:0/3770004632 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63940a1ff0 con 0x55b4ab7ae500 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f63a6a3c740 1 -- 172.21.15.27:0/3770004632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4ab735cd0 con 0x55b4ab7ae500 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f6382a00640 1 -- 172.21.15.27:0/3770004632 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6394095ca0 con 0x55b4ab7ae500 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.654+0000 7f6382a00640 1 -- 172.21.15.27:0/3770004632 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63940b81a0 con 0x55b4ab7ae500 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f63a6a3c740 10 client.14991 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f63a6a3c740 1 -- 172.21.15.27:0/3770004632 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b4ab70a1b0 con 0x55b4ab7ae500 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f6382a00640 1 -- 172.21.15.27:0/3770004632 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55b4ab735cd0 con 0x55b4ab7ae500 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f6382a00640 1 -- 172.21.15.27:0/3770004632 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6394018030 con 0x55b4ab7ae500 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f63a6a3c740 10 client.14991 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f63a6a3c740 10 client.14991 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f63a6a3c740 20 client.14991 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:23.661 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x55b4ab7bec00 0x55b4ab7c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f63a6a3c740 4 client.14991 mds_command: new command op to 24556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f63a6a3c740 1 -- 172.21.15.27:0/3770004632 --> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4ab3ff3c0 con 0x55b4ab7bec00 2024-09-13T18:03:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.655+0000 7f63a1200640 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x55b4ab7bec00 0x55b4ab7c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.656+0000 7f63a1200640 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x55b4ab7bec00 0x55b4ab7c2da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=737393d78411c176 server_cookie=30dc29a7c8f5b7fb in_seq=0 out_seq=0 2024-09-13T18:03:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.656+0000 7f6382a00640 10 client.14991 ms_handle_connect on v2:172.21.15.27:6840/3673158651 2024-09-13T18:03:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f6382a00640 1 -- 172.21.15.27:0/3770004632 <== mds.1 v2:172.21.15.27:6840/3673158651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b4ab3ff3c0 con 0x55b4ab7bec00 2024-09-13T18:03:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f6382a00640 10 client.14991 handle_command_reply: tid=0 2024-09-13T18:03:23.662 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 client.14991 shutdown 2024-09-13T18:03:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 -- 172.21.15.27:0/3770004632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7ae500 msgr2=0x55b4ab7b9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9d10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6394099e40 tx=0x7f63940052c0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 -- 172.21.15.27:0/3770004632 shutdown_connections 2024-09-13T18:03:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9d10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.663 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x55b4ab7bec00 0x55b4ab7c2da0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/3770004632 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f6382a00640 0 client.14991 ms_handle_reset on v2:172.21.15.27:6840/3673158651 2024-09-13T18:03:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 -- 172.21.15.27:0/3770004632 >> 172.21.15.27:0/3770004632 conn(0x55b4ab7a41a0 msgr2=0x55b4ab7a59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 -- 172.21.15.27:0/3770004632 shutdown_connections 2024-09-13T18:03:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 1 -- 172.21.15.27:0/3770004632 wait complete. 2024-09-13T18:03:23.664 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.657+0000 7f63a6a3c740 20 client.14991 trim_cache size 0 max 16384 2024-09-13T18:03:23.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.673+0000 7f63a6a3c740 1 Processor -- start 2024-09-13T18:03:23.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.673+0000 7f63a6a3c740 1 -- start start 2024-09-13T18:03:23.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.673+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.676 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.673+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.673+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.673+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab7048d0 con 0x55b4ab7a9470 2024-09-13T18:03:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.673+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab708790 con 0x55b4ab7ae500 2024-09-13T18:03:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.673+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab7bcdd0 con 0x55b4ab7a8b30 2024-09-13T18:03:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.673+0000 7f639be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f639be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7aa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58200/0 (socket says 172.21.15.27:58200) 2024-09-13T18:03:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f639be00640 1 -- 172.21.15.27:0/1179918839 learned_addr learned my addr 172.21.15.27:0/1179918839 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.677 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f63a1c00640 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f63a1200640 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f639be00640 1 -- 172.21.15.27:0/1179918839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 msgr2=0x55b4ab7aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f639be00640 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f639be00640 1 -- 172.21.15.27:0/1179918839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 msgr2=0x55b4ab7b9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f639be00640 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f639be00640 1 -- 172.21.15.27:0/1179918839 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4ab6ac470 con 0x55b4ab7a9470 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f63a1c00640 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f639be00640 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7aa910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6388040040 tx=0x7f63880039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4651d0edb1913be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.674+0000 7f638ea00640 1 -- 172.21.15.27:0/1179918839 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388003c00 con 0x55b4ab7a9470 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f638ea00640 1 -- 172.21.15.27:0/1179918839 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6388003d60 con 0x55b4ab7a9470 2024-09-13T18:03:23.678 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f638ea00640 1 -- 172.21.15.27:0/1179918839 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638803d820 con 0x55b4ab7a9470 2024-09-13T18:03:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f63a6a3c740 1 -- 172.21.15.27:0/1179918839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 msgr2=0x55b4ab7aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7aa910 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6388040040 tx=0x7f63880039e0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f63a6a3c740 1 -- 172.21.15.27:0/1179918839 shutdown_connections 2024-09-13T18:03:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7aa910 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/1179918839 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f63a6a3c740 1 -- 172.21.15.27:0/1179918839 >> 172.21.15.27:0/1179918839 conn(0x55b4ab7a41a0 msgr2=0x55b4ab7ad9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f63a6a3c740 1 -- 172.21.15.27:0/1179918839 shutdown_connections 2024-09-13T18:03:23.684 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.675+0000 7f63a6a3c740 1 -- 172.21.15.27:0/1179918839 wait complete. 2024-09-13T18:03:23.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.676+0000 7f63a6a3c740 1 -- start start 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.676+0000 7f63a6a3c740 1 Processor -- start 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.676+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.676+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.676+0000 7f63a6a3c740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.676+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab7b5220 con 0x55b4ab7a9470 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.676+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab814a90 con 0x55b4ab7ae500 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.676+0000 7f63a6a3c740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ab814c50 con 0x55b4ab7a8b30 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.676+0000 7f63a6a3c740 10 client.0 _ll_register_callbacks cb 0x7f63940961f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f639be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f639be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58214/0 (socket says 172.21.15.27:58214) 2024-09-13T18:03:23.687 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f639be00640 1 -- 172.21.15.27:0/2517934693 learned_addr learned my addr 172.21.15.27:0/2517934693 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f63a1200640 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f63a1c00640 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f639be00640 1 -- 172.21.15.27:0/2517934693 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 msgr2=0x55b4ab7b45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f639be00640 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7b45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f639be00640 1 -- 172.21.15.27:0/2517934693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 msgr2=0x55b4ab7b4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f639be00640 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f639be00640 1 -- 172.21.15.27:0/2517934693 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b4ab70a1b0 con 0x55b4ab7a9470 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f639be00640 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b9b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f638802a910 tx=0x7f63880317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f080055807c15c44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f6382a00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.677+0000 7f6382a00640 1 -- 172.21.15.27:0/2517934693 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638805a070 con 0x55b4ab7a9470 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f6382a00640 1 -- 172.21.15.27:0/2517934693 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6388000e40 con 0x55b4ab7a9470 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f63a6a3c740 1 -- 172.21.15.27:0/2517934693 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6388005510 con 0x55b4ab7a9470 2024-09-13T18:03:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f6382a00640 1 -- 172.21.15.27:0/2517934693 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6388065030 con 0x55b4ab7a9470 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f63a6a3c740 10 client.14997 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f63a6a3c740 1 -- 172.21.15.27:0/2517934693 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b4ab6d6bd0 con 0x55b4ab7a9470 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f6382a00640 1 -- 172.21.15.27:0/2517934693 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6388005510 con 0x55b4ab7a9470 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f6382a00640 1 -- 172.21.15.27:0/2517934693 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f638803dca0 con 0x55b4ab7a9470 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f63a6a3c740 10 client.14997 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f63a6a3c740 10 client.14997 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f63a6a3c740 20 client.14997 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x55b4ab8194e0 0x55b4ab815f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f63a6a3c740 4 client.14997 mds_command: new command op to 24556 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.678+0000 7f63a6a3c740 1 -- 172.21.15.27:0/2517934693 --> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b4ab4106c0 con 0x55b4ab8194e0 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.679+0000 7f63a1200640 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x55b4ab8194e0 0x55b4ab815f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.679+0000 7f63a1200640 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x55b4ab8194e0 0x55b4ab815f20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d1bfb769bc49aa48 server_cookie=2357183d4894e02e in_seq=0 out_seq=0 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.679+0000 7f6382a00640 10 client.14997 ms_handle_connect on v2:172.21.15.27:6840/3673158651 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.679+0000 7f6382a00640 1 -- 172.21.15.27:0/2517934693 <== mds.1 v2:172.21.15.27:6840/3673158651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55b4ab4106c0 con 0x55b4ab8194e0 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.679+0000 7f6382a00640 10 client.14997 handle_command_reply: tid=0 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.679+0000 7f63a6a3c740 1 client.14997 shutdown 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 -- 172.21.15.27:0/2517934693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 msgr2=0x55b4ab7b9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b9b30 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f638802a910 tx=0x7f63880317e0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 -- 172.21.15.27:0/2517934693 shutdown_connections 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x55b4ab8194e0 0x55b4ab815f20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b4ab7ae500 0x55b4ab7b4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b4ab7a9470 0x55b4ab7b9b30 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 --2- 172.21.15.27:0/2517934693 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b4ab7a8b30 0x55b4ab7b45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f6382a00640 0 client.14997 ms_handle_reset on v2:172.21.15.27:6840/3673158651 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 -- 172.21.15.27:0/2517934693 >> 172.21.15.27:0/2517934693 conn(0x55b4ab7a41a0 msgr2=0x55b4ab7b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 -- 172.21.15.27:0/2517934693 shutdown_connections 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 1 -- 172.21.15.27:0/2517934693 wait complete. 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.680+0000 7f63a6a3c740 20 client.14997 trim_cache size 0 max 16384 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 1, 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24556, 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:23.691 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 94.335634959999993, 2024-09-13T18:03:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:23.692 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 106.22290327499999 2024-09-13T18:03:23.692 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:23.692 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 -- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f63840a1110 msgr2=0x7f63840a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f63840a1110 0x7f63840a35d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55b4ab7a9ea0 tx=0x7f639000b410 comp rx=0 tx=0).stop 2024-09-13T18:03:23.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 -- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c105a60 msgr2=0x7f639c19f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c105a60 0x7f639c19f670 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f639400e9d0 tx=0x7f639400ee90 comp rx=0 tx=0).stop 2024-09-13T18:03:23.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 -- 172.21.15.27:0/4056900579 shutdown_connections 2024-09-13T18:03:23.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f63840a1110 0x7f63840a35d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f639c105a60 0x7f639c19f670 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f639c103130 0x7f639c198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 --2- 172.21.15.27:0/4056900579 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f639c100800 0x7f639c1980c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 -- 172.21.15.27:0/4056900579 >> 172.21.15.27:0/4056900579 conn(0x7f639c0fa3e0 msgr2=0x7f639c0fff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 -- 172.21.15.27:0/4056900579 shutdown_connections 2024-09-13T18:03:23.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.681+0000 7f63a3c00640 1 -- 172.21.15.27:0/4056900579 wait complete. 2024-09-13T18:03:23.699 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T18:03:23.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.856+0000 7f5f5b200640 1 -- 172.21.15.27:0/3341859138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 msgr2=0x7f5f541033f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.856+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3341859138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 0x7f5f541033f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009900 tx=0x7f5f4402a410 comp rx=0 tx=0).stop 2024-09-13T18:03:23.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.856+0000 7f5f5b200640 1 -- 172.21.15.27:0/3341859138 shutdown_connections 2024-09-13T18:03:23.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.856+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3341859138 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103930 0x7f5f5410a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.856+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3341859138 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 0x7f5f541033f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.856+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3341859138 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f54101d80 0x7f5f54102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.856+0000 7f5f5b200640 1 -- 172.21.15.27:0/3341859138 >> 172.21.15.27:0/3341859138 conn(0x7f5f540fd500 msgr2=0x7f5f540ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.857+0000 7f5f5b200640 1 -- 172.21.15.27:0/3341859138 shutdown_connections 2024-09-13T18:03:23.859 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.857+0000 7f5f5b200640 1 -- 172.21.15.27:0/3341859138 wait complete. 2024-09-13T18:03:23.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.857+0000 7f5f5b200640 1 Processor -- start 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f5b200640 1 -- start start 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f5b200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f54101d80 0x7f5f54197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f5b200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 0x7f5f54198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f5b200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103930 0x7f5f5419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f5b200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5419f910 con 0x7f5f54102f70 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f5b200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5419fa80 con 0x7f5f54103930 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f5b200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5419fc40 con 0x7f5f54101d80 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f59400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 0x7f5f54198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f59400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 0x7f5f54198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58236/0 (socket says 172.21.15.27:58236) 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f59400640 1 -- 172.21.15.27:0/3027240598 learned_addr learned my addr 172.21.15.27:0/3027240598 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f5a800640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103930 0x7f5f5419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.858+0000 7f5f59e00640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f54101d80 0x7f5f54197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f59400640 1 -- 172.21.15.27:0/3027240598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f54101d80 msgr2=0x7f5f54197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.862 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f59400640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f54101d80 0x7f5f54197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f59400640 1 -- 172.21.15.27:0/3027240598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103930 msgr2=0x7f5f5419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f59400640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103930 0x7f5f5419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f59400640 1 -- 172.21.15.27:0/3027240598 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44009560 con 0x7f5f54102f70 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f5a800640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103930 0x7f5f5419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f59400640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 0x7f5f54198360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5f44031510 tx=0x7f5f44004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f4ea00640 1 -- 172.21.15.27:0/3027240598 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44005210 con 0x7f5f54102f70 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f4ea00640 1 -- 172.21.15.27:0/3027240598 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f44004ba0 con 0x7f5f54102f70 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f4ea00640 1 -- 172.21.15.27:0/3027240598 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44003b20 con 0x7f5f54102f70 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.859+0000 7f5f5b200640 1 -- 172.21.15.27:0/3027240598 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5419fec0 con 0x7f5f54102f70 2024-09-13T18:03:23.863 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.860+0000 7f5f5b200640 1 -- 172.21.15.27:0/3027240598 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f541a0290 con 0x7f5f54102f70 2024-09-13T18:03:23.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.862+0000 7f5f5f5ea740 1 Processor -- start 2024-09-13T18:03:23.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.862+0000 7f5f4ea00640 1 -- 172.21.15.27:0/3027240598 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5f44004d10 con 0x7f5f54102f70 2024-09-13T18:03:23.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.862+0000 7f5f5f5ea740 1 -- start start 2024-09-13T18:03:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef16c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef16c670 0x55b8ef16eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef0d0ab0 con 0x55b8ef1675e0 2024-09-13T18:03:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef0ce240 con 0x55b8ef166ca0 2024-09-13T18:03:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef0c9b30 con 0x55b8ef16c670 2024-09-13T18:03:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef16c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f5a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef16c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58246/0 (socket says 172.21.15.27:58246) 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f5a800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1670a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:59486/0 (socket says 172.21.15.27:59486) 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f59e00640 1 -- 172.21.15.27:0/3654379806 learned_addr learned my addr 172.21.15.27:0/3654379806 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.863+0000 7f5f59400640 1 --2- 172.21.15.27:0/3654379806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef16c670 0x55b8ef16eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f5a800640 1 -- 172.21.15.27:0/3654379806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef16c670 msgr2=0x55b8ef16eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f5a800640 1 --2- 172.21.15.27:0/3654379806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef16c670 0x55b8ef16eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f5a800640 1 -- 172.21.15.27:0/3654379806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 msgr2=0x55b8ef16c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f5a800640 1 --2- 172.21.15.27:0/3654379806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef16c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f5a800640 1 -- 172.21.15.27:0/3654379806 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8ef094bd0 con 0x55b8ef166ca0 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f59e00640 1 --2- 172.21.15.27:0/3654379806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef16c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f5a800640 1 --2- 172.21.15.27:0/3654379806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1670a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5f50005fd0 tx=0x7f5f50011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dccf737dfc37b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f4ea00640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5f3c0a1110 0x7f5f3c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.868 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f4ea00640 1 -- 172.21.15.27:0/3027240598 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5f440ed4c0 con 0x7f5f54102f70 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f43400640 1 -- 172.21.15.27:0/3654379806 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50004d20 con 0x55b8ef166ca0 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f59e00640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5f3c0a1110 0x7f5f3c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f43400640 1 -- 172.21.15.27:0/3654379806 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f50004e80 con 0x55b8ef166ca0 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.864+0000 7f5f43400640 1 -- 172.21.15.27:0/3654379806 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50004400 con 0x55b8ef166ca0 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f59e00640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5f3c0a1110 0x7f5f3c0a35d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55b8ef168010 tx=0x7f5f4800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3654379806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 msgr2=0x55b8ef1670a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3654379806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1670a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5f50005fd0 tx=0x7f5f50011bf0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3654379806 shutdown_connections 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3654379806 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef16c670 0x55b8ef16eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3654379806 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef16c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3654379806 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1670a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3654379806 >> 172.21.15.27:0/3654379806 conn(0x55b8ef162310 msgr2=0x55b8ef162710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3654379806 shutdown_connections 2024-09-13T18:03:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.865+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3654379806 wait complete. 2024-09-13T18:03:23.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.866+0000 7f5f5f5ea740 1 -- start start 2024-09-13T18:03:23.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.866+0000 7f5f5f5ea740 1 Processor -- start 2024-09-13T18:03:23.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.866+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef166ca0 0x55b8ef170900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.866+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef170e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.866+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 0x55b8ef177e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.866+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef06b260 con 0x55b8ef1675e0 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.866+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef06af00 con 0x55b8ef16c670 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.866+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8eee30f20 con 0x55b8ef166ca0 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.866+0000 7f5f5f5ea740 10 client.0 _ll_register_callbacks cb 0x55b8ef0c31a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef170e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef170e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58250/0 (socket says 172.21.15.27:58250) 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59400640 1 -- 172.21.15.27:0/481986331 learned_addr learned my addr 172.21.15.27:0/481986331 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f5a800640 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 0x55b8ef177e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59e00640 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef166ca0 0x55b8ef170900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59400640 1 -- 172.21.15.27:0/481986331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef166ca0 msgr2=0x55b8ef170900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59400640 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef166ca0 0x55b8ef170900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59400640 1 -- 172.21.15.27:0/481986331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 msgr2=0x55b8ef177e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59400640 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 0x55b8ef177e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.876 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59400640 1 -- 172.21.15.27:0/481986331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f50011440 con 0x55b8ef1675e0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f59400640 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef170e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5f44005940 tx=0x7f5f440f0b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88b78b2d717994b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f37e00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.867+0000 7f5f37e00640 1 -- 172.21.15.27:0/481986331 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f440ba510 con 0x55b8ef1675e0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f37e00640 1 -- 172.21.15.27:0/481986331 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5f440ba9d0 con 0x55b8ef1675e0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/481986331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8eedbd3c0 con 0x55b8ef1675e0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f37e00640 1 -- 172.21.15.27:0/481986331 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f440ba330 con 0x55b8ef1675e0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f5f5ea740 10 client.15009 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/481986331 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b8ef0c81b0 con 0x55b8ef1675e0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f37e00640 1 -- 172.21.15.27:0/481986331 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55b8eedbd3c0 con 0x55b8ef1675e0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f37e00640 1 -- 172.21.15.27:0/481986331 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5f44003c80 con 0x55b8ef1675e0 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f5f5ea740 10 client.15009 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f5f5ea740 10 client.15009 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f5f5ea740 20 client.15009 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:23.877 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x55b8ef17c9a0 0x55b8ef180ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f5f5ea740 4 client.15009 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.868+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/481986331 --> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8eedce6c0 con 0x55b8ef17c9a0 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.869+0000 7f5f59e00640 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x55b8ef17c9a0 0x55b8ef180ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.869+0000 7f5f59e00640 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x55b8ef17c9a0 0x55b8ef180ae0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4154a7173425f38 server_cookie=bfb2b9805e993278 in_seq=0 out_seq=0 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.869+0000 7f5f37e00640 10 client.15009 ms_handle_connect on v2:172.21.15.122:6838/1102491877 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f37e00640 1 -- 172.21.15.27:0/481986331 <== mds.0 v2:172.21.15.122:6838/1102491877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b8eedce6c0 con 0x55b8ef17c9a0 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f37e00640 10 client.15009 handle_command_reply: tid=0 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 client.15009 shutdown 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/481986331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 msgr2=0x55b8ef170e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef170e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5f44005940 tx=0x7f5f440f0b50 comp rx=0 tx=0).stop 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/481986331 shutdown_connections 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 0x55b8ef177e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x55b8ef17c9a0 0x55b8ef180ae0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef1675e0 0x55b8ef170e40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/481986331 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef166ca0 0x55b8ef170900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f37e00640 0 client.15009 ms_handle_reset on v2:172.21.15.122:6838/1102491877 2024-09-13T18:03:23.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/481986331 >> 172.21.15.27:0/481986331 conn(0x55b8ef162310 msgr2=0x55b8ef161650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/481986331 shutdown_connections 2024-09-13T18:03:23.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.870+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/481986331 wait complete. 2024-09-13T18:03:23.879 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.871+0000 7f5f5f5ea740 20 client.15009 trim_cache size 0 max 16384 2024-09-13T18:03:23.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5f5ea740 1 Processor -- start 2024-09-13T18:03:23.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5f5ea740 1 -- start start 2024-09-13T18:03:23.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef177df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.888 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef16c670 0x55b8ef170e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef156d80 con 0x55b8ef16c670 2024-09-13T18:03:23.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef162d70 con 0x55b8ef166ca0 2024-09-13T18:03:23.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8eedce6c0 con 0x55b8ef1675e0 2024-09-13T18:03:23.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5a800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef16c670 0x55b8ef170e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5a800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef16c670 0x55b8ef170e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58258/0 (socket says 172.21.15.27:58258) 2024-09-13T18:03:23.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.886+0000 7f5f5a800640 1 -- 172.21.15.27:0/896888587 learned_addr learned my addr 172.21.15.27:0/896888587 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.889 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f59400640 1 --2- 172.21.15.27:0/896888587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef177df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f5a800640 1 -- 172.21.15.27:0/896888587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 msgr2=0x55b8ef177df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f5a800640 1 --2- 172.21.15.27:0/896888587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef177df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f5a800640 1 -- 172.21.15.27:0/896888587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 msgr2=0x55b8ef1708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f5a800640 1 --2- 172.21.15.27:0/896888587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f5a800640 1 -- 172.21.15.27:0/896888587 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8ef06a470 con 0x55b8ef16c670 2024-09-13T18:03:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f59400640 1 --2- 172.21.15.27:0/896888587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef177df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f5a800640 1 --2- 172.21.15.27:0/896888587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef16c670 0x55b8ef170e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5f50011730 tx=0x7f5f5000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d63ea1affe1dae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.893 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f43e00640 1 -- 172.21.15.27:0/896888587 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50003a30 con 0x55b8ef16c670 2024-09-13T18:03:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f43e00640 1 -- 172.21.15.27:0/896888587 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f50003b90 con 0x55b8ef16c670 2024-09-13T18:03:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.887+0000 7f5f43e00640 1 -- 172.21.15.27:0/896888587 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50024670 con 0x55b8ef16c670 2024-09-13T18:03:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/896888587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef16c670 msgr2=0x55b8ef170e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/896888587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef16c670 0x55b8ef170e10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5f50011730 tx=0x7f5f5000fa00 comp rx=0 tx=0).stop 2024-09-13T18:03:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/896888587 shutdown_connections 2024-09-13T18:03:23.894 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/896888587 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef16c670 0x55b8ef170e10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/896888587 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef177df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/896888587 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef166ca0 0x55b8ef1708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/896888587 >> 172.21.15.27:0/896888587 conn(0x55b8ef162310 msgr2=0x55b8ef1684c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/896888587 shutdown_connections 2024-09-13T18:03:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/896888587 wait complete. 2024-09-13T18:03:23.895 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.888+0000 7f5f5f5ea740 1 -- start start 2024-09-13T18:03:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f5f5ea740 1 Processor -- start 2024-09-13T18:03:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef166ca0 0x55b8ef174d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef175250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f5f5ea740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 0x55b8ef1d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef175950 con 0x55b8ef166ca0 2024-09-13T18:03:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef1d2ce0 con 0x55b8ef16c670 2024-09-13T18:03:23.896 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f5f5ea740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8ef1d2e50 con 0x55b8ef1675e0 2024-09-13T18:03:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f5f5ea740 10 client.0 _ll_register_callbacks cb 0x7f5f440f0c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef166ca0 0x55b8ef174d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f59e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef166ca0 0x55b8ef174d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58264/0 (socket says 172.21.15.27:58264) 2024-09-13T18:03:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f59e00640 1 -- 172.21.15.27:0/3047501047 learned_addr learned my addr 172.21.15.27:0/3047501047 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.889+0000 7f5f5a800640 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 0x55b8ef1d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f59400640 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef175250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f59e00640 1 -- 172.21.15.27:0/3047501047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 msgr2=0x55b8ef175250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f59e00640 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef175250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f59e00640 1 -- 172.21.15.27:0/3047501047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 msgr2=0x55b8ef1d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:23.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f59e00640 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 0x55b8ef1d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f59e00640 1 -- 172.21.15.27:0/3047501047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5001d040 con 0x55b8ef166ca0 2024-09-13T18:03:23.898 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f59400640 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef175250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:03:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f5a800640 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 0x55b8ef1d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f59e00640 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef166ca0 0x55b8ef174d10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5f48003e30 tx=0x7f5f480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4350e7c5dbfe9cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f37e00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f37e00640 1 -- 172.21.15.27:0/3047501047 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48024040 con 0x55b8ef166ca0 2024-09-13T18:03:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f37e00640 1 -- 172.21.15.27:0/3047501047 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5f48032420 con 0x55b8ef166ca0 2024-09-13T18:03:23.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3047501047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8ef0f3cd0 con 0x55b8ef166ca0 2024-09-13T18:03:23.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f37e00640 1 -- 172.21.15.27:0/3047501047 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f48016070 con 0x55b8ef166ca0 2024-09-13T18:03:23.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f5f5ea740 10 client.15015 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:23.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.890+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3047501047 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b8ef08f980 con 0x55b8ef166ca0 2024-09-13T18:03:23.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.891+0000 7f5f37e00640 1 -- 172.21.15.27:0/3047501047 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55b8ef0f3cd0 con 0x55b8ef166ca0 2024-09-13T18:03:23.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.891+0000 7f5f37e00640 1 -- 172.21.15.27:0/3047501047 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5f4803b070 con 0x55b8ef166ca0 2024-09-13T18:03:23.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.891+0000 7f5f5f5ea740 10 client.15015 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.891+0000 7f5f5f5ea740 10 client.15015 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:03:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.891+0000 7f5f5f5ea740 20 client.15015 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.891+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x55b8ef1d7cf0 0x55b8ef1d45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.891+0000 7f5f5f5ea740 4 client.15015 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.891+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3047501047 --> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b8eee21d10 con 0x55b8ef1d7cf0 2024-09-13T18:03:23.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.891+0000 7f5f59400640 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x55b8ef1d7cf0 0x55b8ef1d45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.892+0000 7f5f59400640 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x55b8ef1d7cf0 0x55b8ef1d45d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6097e475a5f8d06 server_cookie=f1b4e6cff06af231 in_seq=0 out_seq=0 2024-09-13T18:03:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.892+0000 7f5f37e00640 10 client.15015 ms_handle_connect on v2:172.21.15.122:6838/1102491877 2024-09-13T18:03:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.892+0000 7f5f37e00640 1 -- 172.21.15.27:0/3047501047 <== mds.0 v2:172.21.15.122:6838/1102491877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b8eee21d10 con 0x55b8ef1d7cf0 2024-09-13T18:03:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.892+0000 7f5f37e00640 10 client.15015 handle_command_reply: tid=0 2024-09-13T18:03:23.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.892+0000 7f5f5f5ea740 1 client.15015 shutdown 2024-09-13T18:03:23.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.892+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3047501047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef166ca0 msgr2=0x55b8ef174d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.892+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef166ca0 0x55b8ef174d10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5f48003e30 tx=0x7f5f480046c0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3047501047 shutdown_connections 2024-09-13T18:03:23.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55b8ef16c670 0x55b8ef1d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55b8ef1675e0 0x55b8ef175250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x55b8ef1d7cf0 0x55b8ef1d45d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5f5ea740 1 --2- 172.21.15.27:0/3047501047 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55b8ef166ca0 0x55b8ef174d10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f37e00640 0 client.15015 ms_handle_reset on v2:172.21.15.122:6838/1102491877 2024-09-13T18:03:23.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3047501047 >> 172.21.15.27:0/3047501047 conn(0x55b8ef162310 msgr2=0x55b8ef16b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3047501047 shutdown_connections 2024-09-13T18:03:23.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5f5ea740 1 -- 172.21.15.27:0/3047501047 wait complete. 2024-09-13T18:03:23.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5f5ea740 20 client.15015 trim_cache size 0 max 16384 2024-09-13T18:03:23.907 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:23.907 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:23.907 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2024-09-13T18:03:23.908 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24584, 2024-09-13T18:03:23.908 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:23.908 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:23.908 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:23.908 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 97.568695504000004, 2024-09-13T18:03:23.908 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:23.909 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:23.909 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:23.909 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 103.830310686 2024-09-13T18:03:23.909 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:23.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5b200640 1 -- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5f3c0a1110 msgr2=0x7f5f3c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5f3c0a1110 0x7f5f3c0a35d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55b8ef168010 tx=0x7f5f4800b410 comp rx=0 tx=0).stop 2024-09-13T18:03:23.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5b200640 1 -- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 msgr2=0x7f5f54198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:23.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.893+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 0x7f5f54198360 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5f44031510 tx=0x7f5f44004360 comp rx=0 tx=0).stop 2024-09-13T18:03:23.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.894+0000 7f5f5b200640 1 -- 172.21.15.27:0/3027240598 shutdown_connections 2024-09-13T18:03:23.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.894+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5f3c0a1110 0x7f5f3c0a35d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.894+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5f54103930 0x7f5f5419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.894+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5f54102f70 0x7f5f54198360 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.894+0000 7f5f5b200640 1 --2- 172.21.15.27:0/3027240598 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5f54101d80 0x7f5f54197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:23.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.894+0000 7f5f5b200640 1 -- 172.21.15.27:0/3027240598 >> 172.21.15.27:0/3027240598 conn(0x7f5f540fd500 msgr2=0x7f5f541063e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:23.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.894+0000 7f5f5b200640 1 -- 172.21.15.27:0/3027240598 shutdown_connections 2024-09-13T18:03:23.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:23.894+0000 7f5f5b200640 1 -- 172.21.15.27:0/3027240598 wait complete. 2024-09-13T18:03:23.914 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T18:03:23.914 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:03:23.924 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-13T18:03:23.925 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T18:03:24.249 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:25.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:24 smithi122 ceph-mon[35310]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T18:03:25.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:24 smithi027 ceph-mon[30611]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T18:03:25.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:24 smithi143 ceph-mon[38210]: pgmap v342: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T18:03:26.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.277+0000 7f7ea3200640 1 -- 172.21.15.27:0/22250494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ea4100e30 msgr2=0x7f7ea41012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:26.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.277+0000 7f7ea3200640 1 --2- 172.21.15.27:0/22250494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ea4100e30 0x7f7ea41012b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7e90009900 tx=0x7f7e9002a410 comp rx=0 tx=0).stop 2024-09-13T18:03:26.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.277+0000 7f7ea3200640 1 -- 172.21.15.27:0/22250494 shutdown_connections 2024-09-13T18:03:26.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.277+0000 7f7ea3200640 1 --2- 172.21.15.27:0/22250494 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea41017f0 0x7f7ea4108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.277+0000 7f7ea3200640 1 --2- 172.21.15.27:0/22250494 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ea4100e30 0x7f7ea41012b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.277+0000 7f7ea3200640 1 --2- 172.21.15.27:0/22250494 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ea40ffc30 0x7f7ea4100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.277+0000 7f7ea3200640 1 -- 172.21.15.27:0/22250494 >> 172.21.15.27:0/22250494 conn(0x7f7ea40fb3c0 msgr2=0x7f7ea40fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:26.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.277+0000 7f7ea3200640 1 -- 172.21.15.27:0/22250494 shutdown_connections 2024-09-13T18:03:26.280 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.277+0000 7f7ea3200640 1 -- 172.21.15.27:0/22250494 wait complete. 2024-09-13T18:03:26.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.278+0000 7f7ea3200640 1 Processor -- start 2024-09-13T18:03:26.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.278+0000 7f7ea3200640 1 -- start start 2024-09-13T18:03:26.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea3200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ea40ffc30 0x7f7ea4074200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:26.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea3200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ea4100e30 0x7f7ea40728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:26.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea3200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea41017f0 0x7f7ea4072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:26.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea3200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea40734e0 con 0x7f7ea4100e30 2024-09-13T18:03:26.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea3200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea4073650 con 0x7f7ea40ffc30 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea3200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea419fd60 con 0x7f7ea41017f0 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea2800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea41017f0 0x7f7ea4072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea1e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ea40ffc30 0x7f7ea4074200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea2800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea41017f0 0x7f7ea4072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:44672/0 (socket says 172.21.15.27:44672) 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea1400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ea4100e30 0x7f7ea40728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea2800640 1 -- 172.21.15.27:0/4053205211 learned_addr learned my addr 172.21.15.27:0/4053205211 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea2800640 1 -- 172.21.15.27:0/4053205211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ea40ffc30 msgr2=0x7f7ea4074200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea2800640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ea40ffc30 0x7f7ea4074200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea2800640 1 -- 172.21.15.27:0/4053205211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ea4100e30 msgr2=0x7f7ea40728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.279+0000 7f7ea2800640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ea4100e30 0x7f7ea40728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.280+0000 7f7ea2800640 1 -- 172.21.15.27:0/4053205211 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90009560 con 0x7f7ea41017f0 2024-09-13T18:03:26.283 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.280+0000 7f7ea1e00640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ea40ffc30 0x7f7ea4074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:26.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.280+0000 7f7ea2800640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea41017f0 0x7f7ea4072de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00eb10 tx=0x7f7e9c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:26.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.280+0000 7f7e9aa00640 1 -- 172.21.15.27:0/4053205211 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c004b20 con 0x7f7ea41017f0 2024-09-13T18:03:26.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.280+0000 7f7e9aa00640 1 -- 172.21.15.27:0/4053205211 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7e9c004c80 con 0x7f7ea41017f0 2024-09-13T18:03:26.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.280+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea419ffc0 con 0x7f7ea41017f0 2024-09-13T18:03:26.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.280+0000 7f7e9aa00640 1 -- 172.21.15.27:0/4053205211 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c010650 con 0x7f7ea41017f0 2024-09-13T18:03:26.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.280+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea41a0430 con 0x7f7ea41017f0 2024-09-13T18:03:26.284 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.281+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea4107080 con 0x7f7ea41017f0 2024-09-13T18:03:26.285 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.283+0000 7f7e9aa00640 1 -- 172.21.15.27:0/4053205211 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7e9c0107f0 con 0x7f7ea41017f0 2024-09-13T18:03:26.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.285+0000 7f7e9aa00640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7e880a1070 0x7f7e880a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:26.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.285+0000 7f7e9aa00640 1 -- 172.21.15.27:0/4053205211 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7e9c014070 con 0x7f7ea41017f0 2024-09-13T18:03:26.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.285+0000 7f7ea1e00640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7e880a1070 0x7f7e880a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:26.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.286+0000 7f7ea1e00640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7e880a1070 0x7f7e880a3530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4100c90 tx=0x7f7e94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:26.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.287+0000 7f7e9aa00640 1 -- 172.21.15.27:0/4053205211 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f7e9c096d70 con 0x7f7ea41017f0 2024-09-13T18:03:26.489 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.487+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ea402c4f0 con 0x7f7e880a1070 2024-09-13T18:03:26.490 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.488+0000 7f7e9aa00640 1 -- 172.21.15.27:0/4053205211 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f7ea402c4f0 con 0x7f7e880a1070 2024-09-13T18:03:26.490 INFO:teuthology.orchestra.run.smithi027.stdout:Backend: cephadm 2024-09-13T18:03:26.490 INFO:teuthology.orchestra.run.smithi027.stdout:Available: Yes 2024-09-13T18:03:26.490 INFO:teuthology.orchestra.run.smithi027.stdout:Paused: No 2024-09-13T18:03:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.490+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7e880a1070 msgr2=0x7f7e880a3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.490+0000 7f7ea3200640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7e880a1070 0x7f7e880a3530 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4100c90 tx=0x7f7e94005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.490+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea41017f0 msgr2=0x7f7ea4072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.490+0000 7f7ea3200640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea41017f0 0x7f7ea4072de0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00eb10 tx=0x7f7e9c00c2d0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.491+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 shutdown_connections 2024-09-13T18:03:26.493 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.491+0000 7f7ea3200640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f7e880a1070 0x7f7e880a3530 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.491+0000 7f7ea3200640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7ea41017f0 0x7f7ea4072de0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.491+0000 7f7ea3200640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7ea4100e30 0x7f7ea40728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.491+0000 7f7ea3200640 1 --2- 172.21.15.27:0/4053205211 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7ea40ffc30 0x7f7ea4074200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.491+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 >> 172.21.15.27:0/4053205211 conn(0x7f7ea40fb3c0 msgr2=0x7f7ea4104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.491+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 shutdown_connections 2024-09-13T18:03:26.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:26.491+0000 7f7ea3200640 1 -- 172.21.15.27:0/4053205211 wait complete. 2024-09-13T18:03:27.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:26 smithi122 ceph-mon[35310]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T18:03:27.242 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:26 smithi027 ceph-mon[30611]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T18:03:27.274 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T18:03:27.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:26 smithi143 ceph-mon[38210]: pgmap v343: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T18:03:27.602 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:28.011 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:27 smithi027 ceph-mon[30611]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:28.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:27 smithi122 ceph-mon[35310]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:28.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:27 smithi143 ceph-mon[38210]: from='client.25048 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:29.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:28 smithi027 ceph-mon[30611]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:03:29.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:28 smithi122 ceph-mon[35310]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:03:29.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:28 smithi143 ceph-mon[38210]: pgmap v344: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:03:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.582+0000 7f069a000640 1 -- 172.21.15.27:0/387498250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694102010 msgr2=0x7f0694102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.582+0000 7f069a000640 1 --2- 172.21.15.27:0/387498250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694102010 0x7f0694102410 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0684009900 tx=0x7f068402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.582+0000 7f069a000640 1 -- 172.21.15.27:0/387498250 shutdown_connections 2024-09-13T18:03:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.582+0000 7f069a000640 1 --2- 172.21.15.27:0/387498250 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0694103bd0 0x7f069410a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.582+0000 7f069a000640 1 --2- 172.21.15.27:0/387498250 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0694103210 0x7f0694103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.582+0000 7f069a000640 1 --2- 172.21.15.27:0/387498250 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694102010 0x7f0694102410 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.582+0000 7f069a000640 1 -- 172.21.15.27:0/387498250 >> 172.21.15.27:0/387498250 conn(0x7f06940fd7a0 msgr2=0x7f06940ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.582+0000 7f069a000640 1 -- 172.21.15.27:0/387498250 shutdown_connections 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.582+0000 7f069a000640 1 -- 172.21.15.27:0/387498250 wait complete. 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.583+0000 7f069a000640 1 Processor -- start 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.583+0000 7f069a000640 1 -- start start 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.583+0000 7f069a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0694102010 0x7f06941980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.583+0000 7f069a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0694103210 0x7f0694198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.583+0000 7f069a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694103bd0 0x7f069419f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.583+0000 7f069a000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069419fbf0 con 0x7f0694103bd0 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.583+0000 7f069a000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069419fd60 con 0x7f0694102010 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.583+0000 7f069a000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069419ff20 con 0x7f0694103210 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694103bd0 0x7f069419f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694103bd0 0x7f069419f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:58308/0 (socket says 172.21.15.27:58308) 2024-09-13T18:03:29.603 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693e00640 1 -- 172.21.15.27:0/1614959855 learned_addr learned my addr 172.21.15.27:0/1614959855 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693400640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0694102010 0x7f06941980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f068aa00640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0694103210 0x7f0694198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693e00640 1 -- 172.21.15.27:0/1614959855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0694103210 msgr2=0x7f0694198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693e00640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0694103210 0x7f0694198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693e00640 1 -- 172.21.15.27:0/1614959855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0694102010 msgr2=0x7f06941980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693e00640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0694102010 0x7f06941980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693e00640 1 -- 172.21.15.27:0/1614959855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684009560 con 0x7f0694103bd0 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.584+0000 7f0693e00640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694103bd0 0x7f069419f6b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f068c00eb10 tx=0x7f068c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.585+0000 7f0690c00640 1 -- 172.21.15.27:0/1614959855 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c004b20 con 0x7f0694103bd0 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.585+0000 7f0690c00640 1 -- 172.21.15.27:0/1614959855 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f068c004c80 con 0x7f0694103bd0 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.585+0000 7f0690c00640 1 -- 172.21.15.27:0/1614959855 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c010650 con 0x7f0694103bd0 2024-09-13T18:03:29.604 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.585+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06941a0200 con 0x7f0694103bd0 2024-09-13T18:03:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.585+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06941a06b0 con 0x7f0694103bd0 2024-09-13T18:03:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.586+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0694109460 con 0x7f0694103bd0 2024-09-13T18:03:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.588+0000 7f0690c00640 1 -- 172.21.15.27:0/1614959855 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f068c005020 con 0x7f0694103bd0 2024-09-13T18:03:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.589+0000 7f0690c00640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f06780a1130 0x7f06780a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.590+0000 7f0690c00640 1 -- 172.21.15.27:0/1614959855 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f068c014070 con 0x7f0694103bd0 2024-09-13T18:03:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.590+0000 7f0693400640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f06780a1130 0x7f06780a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.590+0000 7f0693400640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f06780a1130 0x7f06780a35f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0684009230 tx=0x7f0684005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:29.605 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.594+0000 7f0690c00640 1 -- 172.21.15.27:0/1614959855 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f068c096570 con 0x7f0694103bd0 2024-09-13T18:03:29.787 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.785+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f069402c480 con 0x7f06780a1130 2024-09-13T18:03:29.801 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.799+0000 7f0690c00640 1 -- 172.21.15.27:0/1614959855 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4154 (secure 0 0 0) 0x7f069402c480 con 0x7f06780a1130 2024-09-13T18:03:29.801 INFO:teuthology.orchestra.run.smithi027.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.a smithi027 running (112s) 20s ago 112s 16.5M - 18.2.4-860-g6c6b083f 8a91f241d7d4 e5e17e48b429 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.b smithi122 running (110s) 42s ago 109s 25.8M - 18.2.4-860-g6c6b083f 8a91f241d7d4 2cd571312c45 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.c smithi143 running (2m) 42s ago 2m 17.4M - 18.2.4-860-g6c6b083f 8a91f241d7d4 28518d241256 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.d smithi027 running (2m) 20s ago 2m 12.6M - 18.2.4-860-g6c6b083f 8a91f241d7d4 0b503c24d687 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.e smithi122 running (2m) 42s ago 2m 17.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 f9e4ac08501c 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.f smithi143 running (2m) 42s ago 2m 17.1M - 18.2.4-860-g6c6b083f 8a91f241d7d4 99127e990e2b 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.g smithi027 running (116s) 20s ago 115s 15.7M - 18.2.4-860-g6c6b083f 8a91f241d7d4 352630ec46bd 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.h smithi122 running (2m) 42s ago 2m 17.6M - 18.2.4-860-g6c6b083f 8a91f241d7d4 66dd7dec7369 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.i smithi143 running (119s) 42s ago 119s 16.7M - 18.2.4-860-g6c6b083f 8a91f241d7d4 a121b6f20c09 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.j smithi027 running (2m) 20s ago 2m 12.6M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b54a53cda8c3 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.k smithi122 running (2m) 42s ago 2m 17.2M - 18.2.4-860-g6c6b083f 8a91f241d7d4 894f3c91308d 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mds.l smithi143 running (2m) 42s ago 2m 17.7M - 18.2.4-860-g6c6b083f 8a91f241d7d4 27f3b385b716 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.x smithi027 *:9283,8765 running (9m) 20s ago 9m 496M - 18.2.4-860-g6c6b083f 8a91f241d7d4 5049dcf0971f 2024-09-13T18:03:29.802 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.y smithi122 *:8443,8765 running (7m) 42s ago 7m 440M - 18.2.4-860-g6c6b083f 8a91f241d7d4 b2981fac8317 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:mgr.z smithi143 *:8443,8765 running (7m) 42s ago 7m 439M - 18.2.4-860-g6c6b083f 8a91f241d7d4 6dbea186e507 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:mon.a smithi027 running (9m) 20s ago 9m 47.7M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 29c954fa87cf 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:mon.b smithi122 running (7m) 42s ago 7m 42.5M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 889580ada60e 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:mon.c smithi143 running (8m) 42s ago 8m 40.6M 2048M 18.2.4-860-g6c6b083f 8a91f241d7d4 03c582cf67a3 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 smithi027 running (7m) 20s ago 7m 54.2M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 35a67f9a6979 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 smithi122 running (6m) 42s ago 6m 50.2M 4271M 18.2.4-860-g6c6b083f 8a91f241d7d4 7cf473291454 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 smithi143 running (6m) 42s ago 6m 49.7M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 512e73860ad0 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 smithi027 running (5m) 20s ago 5m 52.0M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 522d3d40d736 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 smithi122 running (5m) 42s ago 5m 53.2M 4271M 18.2.4-860-g6c6b083f 8a91f241d7d4 1a8bd0230758 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 smithi143 running (5m) 42s ago 5m 54.4M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 7e4849090110 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:osd.6 smithi027 running (4m) 20s ago 4m 44.2M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 1fa44cdbe0d0 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:osd.7 smithi122 running (4m) 42s ago 4m 56.8M 4271M 18.2.4-860-g6c6b083f 8a91f241d7d4 681e496fd0fb 2024-09-13T18:03:29.803 INFO:teuthology.orchestra.run.smithi027.stdout:osd.8 smithi143 running (3m) 42s ago 3m 46.6M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 60f947a2a80d 2024-09-13T18:03:29.804 INFO:teuthology.orchestra.run.smithi027.stdout:osd.9 smithi027 running (3m) 20s ago 3m 50.7M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 9cf336f3c41c 2024-09-13T18:03:29.804 INFO:teuthology.orchestra.run.smithi027.stdout:osd.10 smithi122 running (3m) 42s ago 3m 46.0M 4271M 18.2.4-860-g6c6b083f 8a91f241d7d4 ca6b16ab3c2f 2024-09-13T18:03:29.804 INFO:teuthology.orchestra.run.smithi027.stdout:osd.11 smithi143 running (2m) 42s ago 2m 43.3M 4272M 18.2.4-860-g6c6b083f 8a91f241d7d4 c25255dd84c3 2024-09-13T18:03:29.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.802+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f06780a1130 msgr2=0x7f06780a35f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.802+0000 7f069a000640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f06780a1130 0x7f06780a35f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0684009230 tx=0x7f0684005a20 comp rx=0 tx=0).stop 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.802+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694103bd0 msgr2=0x7f069419f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.802+0000 7f069a000640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694103bd0 0x7f069419f6b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f068c00eb10 tx=0x7f068c00c2d0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.803+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 shutdown_connections 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.803+0000 7f069a000640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f06780a1130 0x7f06780a35f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.803+0000 7f069a000640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0694103bd0 0x7f069419f6b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.803+0000 7f069a000640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0694103210 0x7f0694198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.803+0000 7f069a000640 1 --2- 172.21.15.27:0/1614959855 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0694102010 0x7f06941980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.803+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 >> 172.21.15.27:0/1614959855 conn(0x7f06940fd7a0 msgr2=0x7f0694106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.803+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 shutdown_connections 2024-09-13T18:03:29.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:29.803+0000 7f069a000640 1 -- 172.21.15.27:0/1614959855 wait complete. 2024-09-13T18:03:30.588 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T18:03:30.916 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:31.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:30 smithi122 ceph-mon[35310]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:03:31.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:30 smithi122 ceph-mon[35310]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:31.216 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:30 smithi027 ceph-mon[30611]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:03:31.216 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:30 smithi027 ceph-mon[30611]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:31.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:30 smithi143 ceph-mon[38210]: pgmap v345: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:03:31.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:30 smithi143 ceph-mon[38210]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:32.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.856+0000 7f7074a00640 1 -- 172.21.15.27:0/15872823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070102010 msgr2=0x7f7070102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:32.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.856+0000 7f7074a00640 1 --2- 172.21.15.27:0/15872823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070102010 0x7f7070102410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7060009900 tx=0x7f706002a410 comp rx=0 tx=0).stop 2024-09-13T18:03:32.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.856+0000 7f7074a00640 1 -- 172.21.15.27:0/15872823 shutdown_connections 2024-09-13T18:03:32.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.856+0000 7f7074a00640 1 --2- 172.21.15.27:0/15872823 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7070103bd0 0x7f707010a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:32.860 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.856+0000 7f7074a00640 1 --2- 172.21.15.27:0/15872823 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7070103210 0x7f7070103690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:32.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.856+0000 7f7074a00640 1 --2- 172.21.15.27:0/15872823 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070102010 0x7f7070102410 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:32.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.856+0000 7f7074a00640 1 -- 172.21.15.27:0/15872823 >> 172.21.15.27:0/15872823 conn(0x7f70700fd7a0 msgr2=0x7f70700ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:32.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.856+0000 7f7074a00640 1 -- 172.21.15.27:0/15872823 shutdown_connections 2024-09-13T18:03:32.861 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.856+0000 7f7074a00640 1 -- 172.21.15.27:0/15872823 wait complete. 2024-09-13T18:03:32.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.857+0000 7f7074a00640 1 Processor -- start 2024-09-13T18:03:32.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.857+0000 7f7074a00640 1 -- start start 2024-09-13T18:03:32.864 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f7074a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7070102010 0x7f70701980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:32.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f7074a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103210 0x7f7070198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:32.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f7074a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7070103bd0 0x7f707019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:32.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f7074a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707019fbf0 con 0x7f7070103210 2024-09-13T18:03:32.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f7074a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707019fd60 con 0x7f7070102010 2024-09-13T18:03:32.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f7074a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707019ff20 con 0x7f7070103bd0 2024-09-13T18:03:32.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f706de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7070102010 0x7f70701980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:32.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f706d400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103210 0x7f7070198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:32.865 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f706de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7070102010 0x7f70701980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:60586/0 (socket says 172.21.15.27:60586) 2024-09-13T18:03:32.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f706de00640 1 -- 172.21.15.27:0/4000845620 learned_addr learned my addr 172.21.15.27:0/4000845620 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:32.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.858+0000 7f706e800640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7070103bd0 0x7f707019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:32.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f706de00640 1 -- 172.21.15.27:0/4000845620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7070103bd0 msgr2=0x7f707019f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:32.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f706de00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7070103bd0 0x7f707019f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:32.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f706de00640 1 -- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103210 msgr2=0x7f7070198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:32.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f706de00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103210 0x7f7070198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:32.866 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f706de00640 1 -- 172.21.15.27:0/4000845620 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7060009560 con 0x7f7070102010 2024-09-13T18:03:32.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f706d400640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103210 0x7f7070198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:32.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f706de00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7070102010 0x7f70701980f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7060031510 tx=0x7f70600055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:32.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f7066a00640 1 -- 172.21.15.27:0/4000845620 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060004b50 con 0x7f7070102010 2024-09-13T18:03:32.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70701a01a0 con 0x7f7070102010 2024-09-13T18:03:32.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70701a0690 con 0x7f7070102010 2024-09-13T18:03:32.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.859+0000 7f7066a00640 1 -- 172.21.15.27:0/4000845620 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7060004cb0 con 0x7f7070102010 2024-09-13T18:03:32.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.860+0000 7f7066a00640 1 -- 172.21.15.27:0/4000845620 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7060031b80 con 0x7f7070102010 2024-09-13T18:03:32.867 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.861+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7070109460 con 0x7f7070102010 2024-09-13T18:03:32.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.863+0000 7f7066a00640 1 -- 172.21.15.27:0/4000845620 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7060003cd0 con 0x7f7070102010 2024-09-13T18:03:32.869 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.864+0000 7f7066a00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f70540a10b0 0x7f70540a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:32.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.864+0000 7f7066a00640 1 -- 172.21.15.27:0/4000845620 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f70600ed690 con 0x7f7070102010 2024-09-13T18:03:32.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.864+0000 7f706d400640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f70540a10b0 0x7f70540a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:32.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.865+0000 7f706d400640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f70540a10b0 0x7f70540a3570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7070199610 tx=0x7f705c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:32.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:32.866+0000 7f7066a00640 1 -- 172.21.15.27:0/4000845620 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f70600b6e80 con 0x7f7070102010 2024-09-13T18:03:33.061 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.057+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f707002c450 con 0x7f70540a10b0 2024-09-13T18:03:33.066 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.063+0000 7f7066a00640 1 -- 172.21.15.27:0/4000845620 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f707002c450 con 0x7f70540a10b0 2024-09-13T18:03:33.066 INFO:teuthology.orchestra.run.smithi027.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T18:03:33.066 INFO:teuthology.orchestra.run.smithi027.stdout:mds.all 12/12 45s ago 2m smithi027=a;smithi027=d;smithi027=g;smithi027=j;smithi122=b;smithi122=e;smithi122=h;smithi122=k;smithi143=c;smithi143=f;smithi143=i;smithi143=l;count:12 2024-09-13T18:03:33.066 INFO:teuthology.orchestra.run.smithi027.stdout:mgr 3/3 45s ago 7m smithi027=x;smithi122=y;smithi143=z;count:3 2024-09-13T18:03:33.067 INFO:teuthology.orchestra.run.smithi027.stdout:mon 3/3 45s ago 8m smithi027:172.21.15.27=a;smithi122:172.21.15.122=b;smithi143:172.21.15.143=c;count:3 2024-09-13T18:03:33.067 INFO:teuthology.orchestra.run.smithi027.stdout:osd 12 45s ago - 2024-09-13T18:03:33.068 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f70540a10b0 msgr2=0x7f70540a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f70540a10b0 0x7f70540a3570 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7070199610 tx=0x7f705c005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7070102010 msgr2=0x7f70701980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7070102010 0x7f70701980f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7060031510 tx=0x7f70600055a0 comp rx=0 tx=0).stop 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 shutdown_connections 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f70540a10b0 0x7f70540a3570 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f7070103bd0 0x7f707019f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f7070103210 0x7f7070198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 --2- 172.21.15.27:0/4000845620 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f7070102010 0x7f70701980f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.065+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 >> 172.21.15.27:0/4000845620 conn(0x7f70700fd7a0 msgr2=0x7f7070106630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.066+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 shutdown_connections 2024-09-13T18:03:33.069 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:33.066+0000 7f7074a00640 1 -- 172.21.15.27:0/4000845620 wait complete. 2024-09-13T18:03:33.398 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:33 smithi027 ceph-mon[30611]: pgmap v346: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:03:33.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:33 smithi122 ceph-mon[35310]: pgmap v346: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:03:33.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:33 smithi143 ceph-mon[38210]: pgmap v346: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:03:33.881 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T18:03:34.207 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:34.347 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:34 smithi027 ceph-mon[30611]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:34.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:34 smithi122 ceph-mon[35310]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:34.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:34 smithi143 ceph-mon[38210]: from='client.25085 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:35.378 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:35 smithi027 ceph-mon[30611]: pgmap v347: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:03:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:35 smithi122 ceph-mon[35310]: pgmap v347: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:03:35.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:35 smithi143 ceph-mon[38210]: pgmap v347: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.291+0000 7f008da00640 1 -- 172.21.15.27:0/1795643853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00881017f0 msgr2=0x7f0088108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.291+0000 7f008da00640 1 --2- 172.21.15.27:0/1795643853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00881017f0 0x7f0088108080 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0080009ca0 tx=0x7f008002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.291+0000 7f008da00640 1 -- 172.21.15.27:0/1795643853 shutdown_connections 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.291+0000 7f008da00640 1 --2- 172.21.15.27:0/1795643853 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00881017f0 0x7f0088108080 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.291+0000 7f008da00640 1 --2- 172.21.15.27:0/1795643853 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0088100e30 0x7f00881012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.291+0000 7f008da00640 1 --2- 172.21.15.27:0/1795643853 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00880ffc30 0x7f0088100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.291+0000 7f008da00640 1 -- 172.21.15.27:0/1795643853 >> 172.21.15.27:0/1795643853 conn(0x7f00880fb3c0 msgr2=0x7f00880fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.291+0000 7f008da00640 1 -- 172.21.15.27:0/1795643853 shutdown_connections 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.291+0000 7f008da00640 1 -- 172.21.15.27:0/1795643853 wait complete. 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.292+0000 7f008da00640 1 Processor -- start 2024-09-13T18:03:36.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f008da00640 1 -- start start 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f008da00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00880ffc30 0x7f0088197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f008da00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0088100e30 0x7f0088198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f008da00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00881017f0 0x7f008819f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f008da00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008819f930 con 0x7f00880ffc30 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f008da00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008819faa0 con 0x7f00881017f0 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f008da00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008819fc60 con 0x7f0088100e30 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f0087e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00880ffc30 0x7f0088197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f0087e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00880ffc30 0x7f0088197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45926/0 (socket says 172.21.15.27:45926) 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f0087e00640 1 -- 172.21.15.27:0/3778531948 learned_addr learned my addr 172.21.15.27:0/3778531948 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.293+0000 7f008d000640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00881017f0 0x7f008819f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.294+0000 7f0087400640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0088100e30 0x7f0088198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.294+0000 7f0087e00640 1 -- 172.21.15.27:0/3778531948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0088100e30 msgr2=0x7f0088198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:36.310 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.294+0000 7f0087e00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0088100e30 0x7f0088198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.294+0000 7f0087e00640 1 -- 172.21.15.27:0/3778531948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00881017f0 msgr2=0x7f008819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.294+0000 7f0087e00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00881017f0 0x7f008819f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.294+0000 7f0087e00640 1 -- 172.21.15.27:0/3778531948 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080009900 con 0x7f00880ffc30 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.294+0000 7f008d000640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00881017f0 0x7f008819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.294+0000 7f0087e00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00880ffc30 0x7f0088197e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f007800e9c0 tx=0x7f007800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.295+0000 7f0084c00640 1 -- 172.21.15.27:0/3778531948 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078009700 con 0x7f00880ffc30 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.295+0000 7f0084c00640 1 -- 172.21.15.27:0/3778531948 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f007800cd80 con 0x7f00880ffc30 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.295+0000 7f0084c00640 1 -- 172.21.15.27:0/3778531948 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078010430 con 0x7f00880ffc30 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.295+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008819ff40 con 0x7f00880ffc30 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.295+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00881a02f0 con 0x7f00880ffc30 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.296+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008810b650 con 0x7f00880ffc30 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.298+0000 7f0084c00640 1 -- 172.21.15.27:0/3778531948 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0078003680 con 0x7f00880ffc30 2024-09-13T18:03:36.311 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.299+0000 7f0084c00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f006c0a10a0 0x7f006c0a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:36.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.300+0000 7f0084c00640 1 -- 172.21.15.27:0/3778531948 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0078014070 con 0x7f00880ffc30 2024-09-13T18:03:36.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.300+0000 7f0087400640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f006c0a10a0 0x7f006c0a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:36.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.300+0000 7f0087400640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f006c0a10a0 0x7f006c0a3560 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0088199350 tx=0x7f0074005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:36.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.308+0000 7f0084c00640 1 -- 172.21.15.27:0/3778531948 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0078096510 con 0x7f00880ffc30 2024-09-13T18:03:36.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.497+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f0088107d20 con 0x7f006c0a10a0 2024-09-13T18:03:36.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.498+0000 7f0084c00640 1 -- 172.21.15.27:0/3778531948 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f0088107d20 con 0x7f006c0a10a0 2024-09-13T18:03:36.501 INFO:teuthology.orchestra.run.smithi027.stdout:HOST ADDR LABELS STATUS 2024-09-13T18:03:36.501 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027 172.21.15.27 2024-09-13T18:03:36.501 INFO:teuthology.orchestra.run.smithi027.stdout:smithi122 172.21.15.122 2024-09-13T18:03:36.501 INFO:teuthology.orchestra.run.smithi027.stdout:smithi143 172.21.15.143 2024-09-13T18:03:36.501 INFO:teuthology.orchestra.run.smithi027.stdout:3 hosts in cluster 2024-09-13T18:03:36.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f006c0a10a0 msgr2=0x7f006c0a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:36.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f006c0a10a0 0x7f006c0a3560 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0088199350 tx=0x7f0074005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:36.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00880ffc30 msgr2=0x7f0088197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:36.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00880ffc30 0x7f0088197e30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f007800e9c0 tx=0x7f007800ee80 comp rx=0 tx=0).stop 2024-09-13T18:03:36.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 shutdown_connections 2024-09-13T18:03:36.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f006c0a10a0 0x7f006c0a3560 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f00881017f0 0x7f008819f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0088100e30 0x7f0088198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 --2- 172.21.15.27:0/3778531948 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f00880ffc30 0x7f0088197e30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:36.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 >> 172.21.15.27:0/3778531948 conn(0x7f00880fb3c0 msgr2=0x7f0088106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:36.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 shutdown_connections 2024-09-13T18:03:36.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:36.502+0000 7f008da00640 1 -- 172.21.15.27:0/3778531948 wait complete. 2024-09-13T18:03:37.273 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:37 smithi027 ceph-mon[30611]: pgmap v348: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:03:37.402 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T18:03:37.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:37 smithi122 ceph-mon[35310]: pgmap v348: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:03:37.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:37 smithi143 ceph-mon[38210]: pgmap v348: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:03:37.733 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:38.192 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:38 smithi027 ceph-mon[30611]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:38.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:38 smithi122 ceph-mon[35310]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:38.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:38 smithi143 ceph-mon[38210]: from='client.15039 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:39.266 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:39 smithi027 ceph-mon[30611]: pgmap v349: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-13T18:03:39.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:39 smithi122 ceph-mon[35310]: pgmap v349: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-13T18:03:39.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:39 smithi143 ceph-mon[38210]: pgmap v349: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-09-13T18:03:39.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.738+0000 7ff8e1c00640 1 -- 172.21.15.27:0/778825591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 msgr2=0x7ff8dc103410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.738+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/778825591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 0x7ff8dc103410 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009900 tx=0x7ff8c802a410 comp rx=0 tx=0).stop 2024-09-13T18:03:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.738+0000 7ff8e1c00640 1 -- 172.21.15.27:0/778825591 shutdown_connections 2024-09-13T18:03:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.738+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/778825591 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8dc103950 0x7ff8dc10a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.738+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/778825591 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 0x7ff8dc103410 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.738+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/778825591 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8dc101e30 0x7ff8dc102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.738+0000 7ff8e1c00640 1 -- 172.21.15.27:0/778825591 >> 172.21.15.27:0/778825591 conn(0x7ff8dc0fd5e0 msgr2=0x7ff8dc0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.738+0000 7ff8e1c00640 1 -- 172.21.15.27:0/778825591 shutdown_connections 2024-09-13T18:03:39.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.738+0000 7ff8e1c00640 1 -- 172.21.15.27:0/778825591 wait complete. 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.739+0000 7ff8e1c00640 1 Processor -- start 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.739+0000 7ff8e1c00640 1 -- start start 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8e1c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8dc101e30 0x7ff8dc197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8e1c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 0x7ff8dc198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8e1c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8dc103950 0x7ff8dc19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8e1c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc19fa00 con 0x7ff8dc102f90 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8e1c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc19fb70 con 0x7ff8dc101e30 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8e1c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc19fd30 con 0x7ff8dc103950 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8db400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 0x7ff8dc198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8dbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8dc101e30 0x7ff8dc197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8db400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 0x7ff8dc198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:45936/0 (socket says 172.21.15.27:45936) 2024-09-13T18:03:39.744 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8db400640 1 -- 172.21.15.27:0/1810899010 learned_addr learned my addr 172.21.15.27:0/1810899010 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8dbe00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8dc101e30 0x7ff8dc197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:60624/0 (socket says 172.21.15.27:60624) 2024-09-13T18:03:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8e1200640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8dc103950 0x7ff8dc19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8db400640 1 -- 172.21.15.27:0/1810899010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8dc103950 msgr2=0x7ff8dc19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8db400640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8dc103950 0x7ff8dc19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8db400640 1 -- 172.21.15.27:0/1810899010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8dc101e30 msgr2=0x7ff8dc197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8db400640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8dc101e30 0x7ff8dc197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8db400640 1 -- 172.21.15.27:0/1810899010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c8009560 con 0x7ff8dc102f90 2024-09-13T18:03:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8dbe00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8dc101e30 0x7ff8dc197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:39.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.740+0000 7ff8e1200640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8dc103950 0x7ff8dc19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.742+0000 7ff8db400640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 0x7ff8dc198440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8031510 tx=0x7ff8c80055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.742+0000 7ff8d8c00640 1 -- 172.21.15.27:0/1810899010 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8004b50 con 0x7ff8dc102f90 2024-09-13T18:03:39.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.742+0000 7ff8d8c00640 1 -- 172.21.15.27:0/1810899010 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff8c8004cb0 con 0x7ff8dc102f90 2024-09-13T18:03:39.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.742+0000 7ff8d8c00640 1 -- 172.21.15.27:0/1810899010 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8031ba0 con 0x7ff8dc102f90 2024-09-13T18:03:39.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.742+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc19ffb0 con 0x7ff8dc102f90 2024-09-13T18:03:39.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.742+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc1a0360 con 0x7ff8dc102f90 2024-09-13T18:03:39.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.744+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc1091c0 con 0x7ff8dc102f90 2024-09-13T18:03:39.747 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.745+0000 7ff8d8c00640 1 -- 172.21.15.27:0/1810899010 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff8c8031d00 con 0x7ff8dc102f90 2024-09-13T18:03:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.747+0000 7ff8d8c00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff8c00a1120 0x7ff8c00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.747+0000 7ff8d8c00640 1 -- 172.21.15.27:0/1810899010 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff8c80ed6a0 con 0x7ff8dc102f90 2024-09-13T18:03:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.747+0000 7ff8dbe00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff8c00a1120 0x7ff8c00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:39.749 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.747+0000 7ff8dbe00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff8c00a1120 0x7ff8c00a35e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009fc0 tx=0x7ff8cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:39.753 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.750+0000 7ff8d8c00640 1 -- 172.21.15.27:0/1810899010 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff8c80b6ef0 con 0x7ff8dc102f90 2024-09-13T18:03:39.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.939+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8dc02c4f0 con 0x7ff8c00a1120 2024-09-13T18:03:39.943 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.941+0000 7ff8d8c00640 1 -- 172.21.15.27:0/1810899010 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7ff8dc02c4f0 con 0x7ff8c00a1120 2024-09-13T18:03:39.943 INFO:teuthology.orchestra.run.smithi027.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T18:03:39.944 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331001C400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T18:03:39.944 INFO:teuthology.orchestra.run.smithi027.stdout:smithi122 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204010U400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-13T18:03:39.944 INFO:teuthology.orchestra.run.smithi027.stdout:smithi143 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330073400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-13T18:03:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff8c00a1120 msgr2=0x7ff8c00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff8c00a1120 0x7ff8c00a35e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc009fc0 tx=0x7ff8cc005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 msgr2=0x7ff8dc198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 0x7ff8dc198440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8031510 tx=0x7ff8c80055a0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 shutdown_connections 2024-09-13T18:03:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff8c00a1120 0x7ff8c00a35e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff8dc103950 0x7ff8dc19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.947 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff8dc102f90 0x7ff8dc198440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 --2- 172.21.15.27:0/1810899010 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff8dc101e30 0x7ff8dc197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:39.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 >> 172.21.15.27:0/1810899010 conn(0x7ff8dc0fd5e0 msgr2=0x7ff8dc106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:39.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 shutdown_connections 2024-09-13T18:03:39.948 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:39.945+0000 7ff8e1c00640 1 -- 172.21.15.27:0/1810899010 wait complete. 2024-09-13T18:03:40.748 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T18:03:40.756 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-13T18:03:40.756 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T18:03:41.086 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:41.371 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:41 smithi027 ceph-mon[30611]: pgmap v350: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:03:41.371 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:41 smithi027 ceph-mon[30611]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:41.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:41 smithi122 ceph-mon[35310]: pgmap v350: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:03:41.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:41 smithi122 ceph-mon[35310]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:41.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:41 smithi143 ceph-mon[38210]: pgmap v350: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:03:41.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:41 smithi143 ceph-mon[38210]: from='client.15045 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:03:43.081 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.045+0000 7fb187c00640 1 -- 172.21.15.27:0/1346038455 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180076a50 msgr2=0x7fb1800772f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.045+0000 7fb187c00640 1 --2- 172.21.15.27:0/1346038455 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180076a50 0x7fb1800772f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb178009ca0 tx=0x7fb17802a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.045+0000 7fb187c00640 1 -- 172.21.15.27:0/1346038455 shutdown_connections 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.045+0000 7fb187c00640 1 --2- 172.21.15.27:0/1346038455 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180076a50 0x7fb1800772f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.045+0000 7fb187c00640 1 --2- 172.21.15.27:0/1346038455 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1800760b0 0x7fb180076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.045+0000 7fb187c00640 1 --2- 172.21.15.27:0/1346038455 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb180074e60 0x7fb180075260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.045+0000 7fb187c00640 1 -- 172.21.15.27:0/1346038455 >> 172.21.15.27:0/1346038455 conn(0x7fb1800fd7a0 msgr2=0x7fb1800ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.045+0000 7fb187c00640 1 -- 172.21.15.27:0/1346038455 shutdown_connections 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.045+0000 7fb187c00640 1 -- 172.21.15.27:0/1346038455 wait complete. 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.046+0000 7fb187c00640 1 Processor -- start 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.046+0000 7fb187c00640 1 -- start start 2024-09-13T18:03:43.082 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb187c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180074e60 0x7fb18019c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb187c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1800760b0 0x7fb18019c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb187c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb180076a50 0x7fb1801a39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb187c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1801a3f20 con 0x7fb1800760b0 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb187c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1801a4090 con 0x7fb180076a50 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb187c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1801a4250 con 0x7fb180074e60 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb17fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1800760b0 0x7fb18019c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb185c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb180076a50 0x7fb1801a39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb185200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180074e60 0x7fb18019c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb185c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb180076a50 0x7fb1801a39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:37666/0 (socket says 172.21.15.27:37666) 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb17fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1800760b0 0x7fb18019c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33536/0 (socket says 172.21.15.27:33536) 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb17fe00640 1 -- 172.21.15.27:0/4077438428 learned_addr learned my addr 172.21.15.27:0/4077438428 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.047+0000 7fb185200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180074e60 0x7fb18019c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:51830/0 (socket says 172.21.15.27:51830) 2024-09-13T18:03:43.083 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb185200640 1 -- 172.21.15.27:0/4077438428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb180076a50 msgr2=0x7fb1801a39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb185200640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb180076a50 0x7fb1801a39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb185200640 1 -- 172.21.15.27:0/4077438428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1800760b0 msgr2=0x7fb18019c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb185200640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1800760b0 0x7fb18019c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb185200640 1 -- 172.21.15.27:0/4077438428 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178009900 con 0x7fb180074e60 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb185200640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180074e60 0x7fb18019c420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb17400e9f0 tx=0x7fb17400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb17d600640 1 -- 172.21.15.27:0/4077438428 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400ccc0 con 0x7fb180074e60 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1801a4530 con 0x7fb180074e60 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb17d600640 1 -- 172.21.15.27:0/4077438428 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb17400ce20 con 0x7fb180074e60 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.048+0000 7fb17d600640 1 -- 172.21.15.27:0/4077438428 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb174004a00 con 0x7fb180074e60 2024-09-13T18:03:43.084 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.049+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1801a49e0 con 0x7fb180074e60 2024-09-13T18:03:43.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.050+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18010e990 con 0x7fb180074e60 2024-09-13T18:03:43.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.052+0000 7fb17d600640 1 -- 172.21.15.27:0/4077438428 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb174004b60 con 0x7fb180074e60 2024-09-13T18:03:43.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.053+0000 7fb17d600640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb1680a10b0 0x7fb1680a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:43.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.053+0000 7fb17d600640 1 -- 172.21.15.27:0/4077438428 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb174014070 con 0x7fb180074e60 2024-09-13T18:03:43.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.053+0000 7fb17fe00640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb1680a10b0 0x7fb1680a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:43.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.054+0000 7fb17fe00640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb1680a10b0 0x7fb1680a3570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb18019d940 tx=0x7fb16c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:43.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.057+0000 7fb17d600640 1 -- 172.21.15.27:0/4077438428 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fb174095f90 con 0x7fb180074e60 2024-09-13T18:03:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.280+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb18002c3e0 con 0x7fb180074e60 2024-09-13T18:03:43.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.280+0000 7fb17d600640 1 -- 172.21.15.27:0/4077438428 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2926 (secure 0 0 0) 0x7fb1740995b0 con 0x7fb180074e60 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:e26 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:legacy client fscid: 1 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:Filesystem 'cephfs' (1) 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:fs_name cephfs 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 26 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-13T18:01:46.320502+0000 2024-09-13T18:03:43.283 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-13T18:01:53.056677+0000 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:tableserver 0 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:root 0 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:session_timeout 300 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:session_autoclose 300 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:max_file_size 1099511627776 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:max_xattr_size 65536 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:required_client_features {} 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure 0 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:last_failure_osd_epoch 0 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:max_mds 5 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:in 0,1,2,3,4 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:up {0=24584,1=24556,2=24533,3=24529,4=24448} 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:failed 2024-09-13T18:03:43.284 INFO:teuthology.orchestra.run.smithi027.stdout:damaged 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:stopped 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:data_pools [3] 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:metadata_pool 2 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:inline_data disabled 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:balancer 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:bal_rank_mask -1 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:standby_count_wanted 0 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.b{0:24584} state up:active seq 3 addr [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.c{0:24511} state up:standby-replay seq 1 addr [v2:172.21.15.143:6836/3738799013,v1:172.21.15.143:6837/3738799013] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a{1:24556} state up:active seq 4 addr [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.f{1:24499} state up:standby-replay seq 1 addr [v2:172.21.15.143:6834/1530941636,v1:172.21.15.143:6835/1530941636] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.h{2:24533} state up:active seq 7 addr [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.285 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.e{2:24497} state up:standby-replay seq 1 addr [v2:172.21.15.122:6834/1011366471,v1:172.21.15.122:6835/1011366471] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.i{3:24529} state up:active seq 7 addr [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.k{3:24455} state up:standby-replay seq 1 addr [v2:172.21.15.122:6832/1100066007,v1:172.21.15.122:6833/1100066007] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.l{4:24448} state up:active seq 12 addr [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.g{4:14505} state up:standby-replay seq 1 addr [v2:172.21.15.27:6838/91312549,v1:172.21.15.27:6839/91312549] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout:Standby daemons: 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.j{-1:14439} state up:standby seq 1 addr [v2:172.21.15.27:6834/2543999093,v1:172.21.15.27:6835/2543999093] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.286 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.d{-1:14457} state up:standby seq 1 addr [v2:172.21.15.27:6836/1224306728,v1:172.21.15.27:6837/1224306728] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T18:03:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 26 2024-09-13T18:03:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb1680a10b0 msgr2=0x7fb1680a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb1680a10b0 0x7fb1680a3570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb18019d940 tx=0x7fb16c005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180074e60 msgr2=0x7fb18019c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180074e60 0x7fb18019c420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb17400e9f0 tx=0x7fb17400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 shutdown_connections 2024-09-13T18:03:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb1680a10b0 0x7fb1680a3570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.287 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb180076a50 0x7fb1801a39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb1800760b0 0x7fb18019c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 --2- 172.21.15.27:0/4077438428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb180074e60 0x7fb18019c420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 >> 172.21.15.27:0/4077438428 conn(0x7fb1800fd7a0 msgr2=0x7fb1800ff230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 shutdown_connections 2024-09-13T18:03:43.288 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:43.284+0000 7fb187c00640 1 -- 172.21.15.27:0/4077438428 wait complete. 2024-09-13T18:03:43.299 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:43 smithi027 ceph-mon[30611]: pgmap v351: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:03:43.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:43 smithi122 ceph-mon[35310]: pgmap v351: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:03:43.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:43 smithi143 ceph-mon[38210]: pgmap v351: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:03:44.094 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-13T18:03:44.424 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:44.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:44 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/4077438428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:03:44.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:44 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/4077438428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:03:44.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:44 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/4077438428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T18:03:45.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:45 smithi122 ceph-mon[35310]: pgmap v352: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:03:45.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:45 smithi143 ceph-mon[38210]: pgmap v352: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:03:45.545 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:45 smithi027 ceph-mon[30611]: pgmap v352: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:03:46.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.166+0000 7ff19be00640 1 -- 172.21.15.27:0/3622700548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 msgr2=0x7ff19c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:46.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.166+0000 7ff19be00640 1 --2- 172.21.15.27:0/3622700548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 0x7ff19c100030 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009900 tx=0x7ff18c02a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.166+0000 7ff19be00640 1 -- 172.21.15.27:0/3622700548 shutdown_connections 2024-09-13T18:03:46.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.166+0000 7ff19be00640 1 --2- 172.21.15.27:0/3622700548 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff19c1017f0 0x7ff19c108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.166+0000 7ff19be00640 1 --2- 172.21.15.27:0/3622700548 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19c100e30 0x7ff19c1012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.166+0000 7ff19be00640 1 --2- 172.21.15.27:0/3622700548 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 0x7ff19c100030 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.166+0000 7ff19be00640 1 -- 172.21.15.27:0/3622700548 >> 172.21.15.27:0/3622700548 conn(0x7ff19c0fb3c0 msgr2=0x7ff19c0fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:46.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.166+0000 7ff19be00640 1 -- 172.21.15.27:0/3622700548 shutdown_connections 2024-09-13T18:03:46.190 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.166+0000 7ff19be00640 1 -- 172.21.15.27:0/3622700548 wait complete. 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.167+0000 7ff19be00640 1 Processor -- start 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.167+0000 7ff19be00640 1 -- start start 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.167+0000 7ff19be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 0x7ff19c197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.167+0000 7ff19be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19c100e30 0x7ff19c198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.167+0000 7ff19be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff19c1017f0 0x7ff19c19f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.167+0000 7ff19be00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c19f940 con 0x7ff19c0ffc30 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.167+0000 7ff19be00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c19fab0 con 0x7ff19c100e30 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.167+0000 7ff19be00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19c19fc70 con 0x7ff19c1017f0 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 0x7ff19c197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19aa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 0x7ff19c197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33554/0 (socket says 172.21.15.27:33554) 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19aa00640 1 -- 172.21.15.27:0/1498896956 learned_addr learned my addr 172.21.15.27:0/1498896956 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19a000640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19c100e30 0x7ff19c198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:46.191 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19b400640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff19c1017f0 0x7ff19c19f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19aa00640 1 -- 172.21.15.27:0/1498896956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff19c1017f0 msgr2=0x7ff19c19f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19aa00640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff19c1017f0 0x7ff19c19f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19aa00640 1 -- 172.21.15.27:0/1498896956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19c100e30 msgr2=0x7ff19c198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19aa00640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19c100e30 0x7ff19c198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19aa00640 1 -- 172.21.15.27:0/1498896956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c009560 con 0x7ff19c0ffc30 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19b400640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff19c1017f0 0x7ff19c19f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.168+0000 7ff19aa00640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 0x7ff19c197e40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff18c031510 tx=0x7ff18c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.169+0000 7ff193400640 1 -- 172.21.15.27:0/1498896956 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c005000 con 0x7ff19c0ffc30 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.169+0000 7ff193400640 1 -- 172.21.15.27:0/1498896956 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff18c0046c0 con 0x7ff19c0ffc30 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.169+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19c19fef0 con 0x7ff19c0ffc30 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.169+0000 7ff193400640 1 -- 172.21.15.27:0/1498896956 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c003a10 con 0x7ff19c0ffc30 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.169+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19c1a02b0 con 0x7ff19c0ffc30 2024-09-13T18:03:46.192 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.170+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff19c10b650 con 0x7ff19c0ffc30 2024-09-13T18:03:46.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.172+0000 7ff193400640 1 -- 172.21.15.27:0/1498896956 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff18c004bc0 con 0x7ff19c0ffc30 2024-09-13T18:03:46.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.173+0000 7ff193400640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff1800a10a0 0x7ff1800a3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:46.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.173+0000 7ff193400640 1 -- 172.21.15.27:0/1498896956 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff18c0ed580 con 0x7ff19c0ffc30 2024-09-13T18:03:46.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.173+0000 7ff19a000640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff1800a10a0 0x7ff1800a3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:46.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.174+0000 7ff19a000640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff1800a10a0 0x7ff1800a3560 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff19c199360 tx=0x7ff188005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:46.193 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.177+0000 7ff193400640 1 -- 172.21.15.27:0/1498896956 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ff18c0b6cc0 con 0x7ff19c0ffc30 2024-09-13T18:03:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.363+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7ff19c1a0560 con 0x7ff19c0ffc30 2024-09-13T18:03:46.365 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.364+0000 7ff193400640 1 -- 172.21.15.27:0/1498896956 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) v1 ==== 56+0+5273 (secure 0 0 0) 0x7ff18c0ba2e0 con 0x7ff19c0ffc30 2024-09-13T18:03:46.366 INFO:teuthology.orchestra.run.smithi027.stdout:epoch 88 2024-09-13T18:03:46.366 INFO:teuthology.orchestra.run.smithi027.stdout:fsid f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T18:03:46.366 INFO:teuthology.orchestra.run.smithi027.stdout:created 2024-09-13T17:53:40.282980+0000 2024-09-13T18:03:46.366 INFO:teuthology.orchestra.run.smithi027.stdout:modified 2024-09-13T18:02:37.160677+0000 2024-09-13T18:03:46.366 INFO:teuthology.orchestra.run.smithi027.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-13T18:03:46.366 INFO:teuthology.orchestra.run.smithi027.stdout:crush_version 26 2024-09-13T18:03:46.366 INFO:teuthology.orchestra.run.smithi027.stdout:full_ratio 0.95 2024-09-13T18:03:46.366 INFO:teuthology.orchestra.run.smithi027.stdout:backfillfull_ratio 0.9 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:nearfull_ratio 0.85 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:require_min_compat_client luminous 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:min_compat_client luminous 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:require_osd_release reef 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:stretch_mode_enabled false 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 86 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:max_osd 12 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6802/3184758537,v1:172.21.15.27:6803/3184758537] [v2:172.21.15.27:6804/3184758537,v1:172.21.15.27:6805/3184758537] exists,up 54ed9933-44c6-4fe4-b442-fc797b98c8bf 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6800/4170403737,v1:172.21.15.122:6801/4170403737] [v2:172.21.15.122:6802/4170403737,v1:172.21.15.122:6803/4170403737] exists,up 66669cca-0b9c-4b87-b8b3-3581b2959c02 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.143:6800/134202082,v1:172.21.15.143:6801/134202082] [v2:172.21.15.143:6802/134202082,v1:172.21.15.143:6803/134202082] exists,up 2db6f706-d974-4498-b969-2d2382873bf2 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:osd.3 up in weight 1 up_from 26 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6810/3127939559,v1:172.21.15.27:6811/3127939559] [v2:172.21.15.27:6812/3127939559,v1:172.21.15.27:6813/3127939559] exists,up 14528e45-0ca2-401e-9cf7-8cafd2beb354 2024-09-13T18:03:46.367 INFO:teuthology.orchestra.run.smithi027.stdout:osd.4 up in weight 1 up_from 34 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6808/854453885,v1:172.21.15.122:6809/854453885] [v2:172.21.15.122:6810/854453885,v1:172.21.15.122:6811/854453885] exists,up ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:osd.5 up in weight 1 up_from 39 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.143:6808/3812784407,v1:172.21.15.143:6809/3812784407] [v2:172.21.15.143:6810/3812784407,v1:172.21.15.143:6811/3812784407] exists,up 5676151a-5792-4ec2-b503-b9ca28b51dd6 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:osd.6 up in weight 1 up_from 47 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6818/1338968311,v1:172.21.15.27:6819/1338968311] [v2:172.21.15.27:6820/1338968311,v1:172.21.15.27:6821/1338968311] exists,up 34db282b-ab45-44ce-9bc1-de0de6c820e3 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:osd.7 up in weight 1 up_from 52 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6816/4046950984,v1:172.21.15.122:6817/4046950984] [v2:172.21.15.122:6818/4046950984,v1:172.21.15.122:6819/4046950984] exists,up 0b75e0da-1e0f-425c-abd6-36f99a066e11 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:osd.8 up in weight 1 up_from 60 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.143:6816/2661911433,v1:172.21.15.143:6817/2661911433] [v2:172.21.15.143:6818/2661911433,v1:172.21.15.143:6819/2661911433] exists,up ba26500a-70ee-4016-bbbe-6b625a329bd7 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:osd.9 up in weight 1 up_from 68 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.27:6826/154819265,v1:172.21.15.27:6827/154819265] [v2:172.21.15.27:6828/154819265,v1:172.21.15.27:6829/154819265] exists,up 6044d334-8e68-415d-b23b-ca534e3fdd5b 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:osd.10 up in weight 1 up_from 73 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.122:6824/465237167,v1:172.21.15.122:6825/465237167] [v2:172.21.15.122:6826/465237167,v1:172.21.15.122:6827/465237167] exists,up cd55cd55-918b-4927-ab29-1f0e04d05c8f 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:osd.11 up in weight 1 up_from 81 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.143:6824/378792736,v1:172.21.15.143:6825/378792736] [v2:172.21.15.143:6826/378792736,v1:172.21.15.143:6827/378792736] exists,up 5f6c673e-6209-4e56-b97d-50419c0e0500 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 2.a [2,11] 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 2.b [8,11] 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 2.c [2,4] 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 2.1f [8,1] 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 3.3 [4,9] 2024-09-13T18:03:46.368 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 3.36 [4,9] 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 3.39 [5,8] 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:pg_upmap_items 3.3c [4,9] 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/1188602618 expires 2024-09-14T17:54:35.275484+0000 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/3579424943 expires 2024-09-14T17:54:35.275484+0000 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/246522964 expires 2024-09-14T17:54:35.275484+0000 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:6801/1083878216 expires 2024-09-14T17:54:35.275484+0000 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:6800/1083878216 expires 2024-09-14T17:54:35.275484+0000 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:6801/2456729013 expires 2024-09-14T17:54:06.682080+0000 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:6800/2456729013 expires 2024-09-14T17:54:06.682080+0000 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/2249948778 expires 2024-09-14T17:54:06.682080+0000 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/852564053 expires 2024-09-14T17:54:06.682080+0000 2024-09-13T18:03:46.369 INFO:teuthology.orchestra.run.smithi027.stdout:blocklist 172.21.15.27:0/2742710546 expires 2024-09-14T17:54:06.682080+0000 2024-09-13T18:03:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff1800a10a0 msgr2=0x7ff1800a3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff1800a10a0 0x7ff1800a3560 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff19c199360 tx=0x7ff188005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 msgr2=0x7ff19c197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 0x7ff19c197e40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff18c031510 tx=0x7ff18c004270 comp rx=0 tx=0).stop 2024-09-13T18:03:46.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 shutdown_connections 2024-09-13T18:03:46.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ff1800a10a0 0x7ff1800a3560 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ff19c1017f0 0x7ff19c19f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ff19c100e30 0x7ff19c198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 --2- 172.21.15.27:0/1498896956 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ff19c0ffc30 0x7ff19c197e40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:46.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.366+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 >> 172.21.15.27:0/1498896956 conn(0x7ff19c0fb3c0 msgr2=0x7ff19c0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:46.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.367+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 shutdown_connections 2024-09-13T18:03:46.371 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:46.367+0000 7ff19be00640 1 -- 172.21.15.27:0/1498896956 wait complete. 2024-09-13T18:03:47.175 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-13T18:03:47.187 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:03:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.348+0000 7f3ba6800640 1 -- 172.21.15.27:0/2431158898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba00ffda0 msgr2=0x7f3ba01001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.348+0000 7f3ba6800640 1 --2- 172.21.15.27:0/2431158898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba00ffda0 0x7f3ba01001a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009900 tx=0x7f3b9002a410 comp rx=0 tx=0).stop 2024-09-13T18:03:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.348+0000 7f3ba6800640 1 -- 172.21.15.27:0/2431158898 shutdown_connections 2024-09-13T18:03:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.348+0000 7f3ba6800640 1 --2- 172.21.15.27:0/2431158898 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ba0101950 0x7f3ba01081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.348+0000 7f3ba6800640 1 --2- 172.21.15.27:0/2431158898 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ba0100f90 0x7f3ba0101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.348+0000 7f3ba6800640 1 --2- 172.21.15.27:0/2431158898 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba00ffda0 0x7f3ba01001a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.348+0000 7f3ba6800640 1 -- 172.21.15.27:0/2431158898 >> 172.21.15.27:0/2431158898 conn(0x7f3ba00fb520 msgr2=0x7f3ba00fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.348+0000 7f3ba6800640 1 -- 172.21.15.27:0/2431158898 shutdown_connections 2024-09-13T18:03:47.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.349+0000 7f3ba6800640 1 -- 172.21.15.27:0/2431158898 wait complete. 2024-09-13T18:03:47.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.349+0000 7f3ba6800640 1 Processor -- start 2024-09-13T18:03:47.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3ba6800640 1 -- start start 2024-09-13T18:03:47.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3ba6800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ba00ffda0 0x7f3ba0198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:47.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3ba6800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ba0100f90 0x7f3ba0198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3ba6800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba0101950 0x7f3ba019f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3ba6800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba019fbf0 con 0x7f3ba0101950 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3ba6800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba019fd60 con 0x7f3ba0100f90 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3ba6800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba019ff20 con 0x7f3ba00ffda0 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3b9fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba0101950 0x7f3ba019f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3b9fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba0101950 0x7f3ba019f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33578/0 (socket says 172.21.15.27:33578) 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3b9fe00640 1 -- 172.21.15.27:0/351749140 learned_addr learned my addr 172.21.15.27:0/351749140 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3b9f400640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ba00ffda0 0x7f3ba0198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.350+0000 7f3b96a00640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ba0100f90 0x7f3ba0198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b9fe00640 1 -- 172.21.15.27:0/351749140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ba00ffda0 msgr2=0x7f3ba0198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b9fe00640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ba00ffda0 0x7f3ba0198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b9fe00640 1 -- 172.21.15.27:0/351749140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ba0100f90 msgr2=0x7f3ba0198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.354 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b9fe00640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ba0100f90 0x7f3ba0198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b9fe00640 1 -- 172.21.15.27:0/351749140 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009560 con 0x7f3ba0101950 2024-09-13T18:03:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b96a00640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ba0100f90 0x7f3ba0198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b9fe00640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba0101950 0x7f3ba019f6b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800eb10 tx=0x7f3b9800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b9cc00640 1 -- 172.21.15.27:0/351749140 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98004b20 con 0x7f3ba0101950 2024-09-13T18:03:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b9cc00640 1 -- 172.21.15.27:0/351749140 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3b98004c80 con 0x7f3ba0101950 2024-09-13T18:03:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba01a0200 con 0x7f3ba0101950 2024-09-13T18:03:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3b9cc00640 1 -- 172.21.15.27:0/351749140 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98010650 con 0x7f3ba0101950 2024-09-13T18:03:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.351+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba01a0760 con 0x7f3ba0101950 2024-09-13T18:03:47.355 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.352+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba010b830 con 0x7f3ba0101950 2024-09-13T18:03:47.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.354+0000 7f3b9cc00640 1 -- 172.21.15.27:0/351749140 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3b98005020 con 0x7f3ba0101950 2024-09-13T18:03:47.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.356+0000 7f3b9cc00640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3b840a1110 0x7f3b840a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:47.358 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.357+0000 7f3b9cc00640 1 -- 172.21.15.27:0/351749140 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3b98014070 con 0x7f3ba0101950 2024-09-13T18:03:47.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.357+0000 7f3b9f400640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3b840a1110 0x7f3b840a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:47.359 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.357+0000 7f3b9f400640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3b840a1110 0x7f3b840a35d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009230 tx=0x7f3b90005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:47.362 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.361+0000 7f3b9cc00640 1 -- 172.21.15.27:0/351749140 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3b98096570 con 0x7f3ba0101950 2024-09-13T18:03:47.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:47 smithi122 ceph-mon[35310]: pgmap v353: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:03:47.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:47 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1498896956' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T18:03:47.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:47 smithi143 ceph-mon[38210]: pgmap v353: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:03:47.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:47 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1498896956' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T18:03:47.545 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.543+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ba010b9c0 con 0x7f3ba0101950 2024-09-13T18:03:47.546 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.544+0000 7f3b9cc00640 1 -- 172.21.15.27:0/351749140 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f3b98099b90 con 0x7f3ba0101950 2024-09-13T18:03:47.547 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:47.547 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":88,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:02:37.160677+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:03:47.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.546+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3b840a1110 msgr2=0x7f3b840a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.548 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.546+0000 7f3ba6800640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3b840a1110 0x7f3b840a35d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3b90009230 tx=0x7f3b90005a20 comp rx=0 tx=0).stop 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.546+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba0101950 msgr2=0x7f3ba019f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.546+0000 7f3ba6800640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba0101950 0x7f3ba019f6b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800eb10 tx=0x7f3b9800c2d0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.546+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 shutdown_connections 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.546+0000 7f3ba6800640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3b840a1110 0x7f3b840a35d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.546+0000 7f3ba6800640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ba0101950 0x7f3ba019f6b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.546+0000 7f3ba6800640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ba0100f90 0x7f3ba0198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.546+0000 7f3ba6800640 1 --2- 172.21.15.27:0/351749140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ba00ffda0 0x7f3ba0198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.547+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 >> 172.21.15.27:0/351749140 conn(0x7f3ba00fb520 msgr2=0x7f3ba0106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.547+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 shutdown_connections 2024-09-13T18:03:47.549 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.547+0000 7f3ba6800640 1 -- 172.21.15.27:0/351749140 wait complete. 2024-09-13T18:03:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:47 smithi027 ceph-mon[30611]: pgmap v353: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:03:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:47 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1498896956' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-13T18:03:47.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:57:10.088488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:01:44.492835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:01:45.883650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:03:47.566 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:03:47.730 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.728+0000 7fc387600640 1 -- 172.21.15.27:0/2212089404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380107c00 msgr2=0x7fc38010a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.728+0000 7fc387600640 1 --2- 172.21.15.27:0/2212089404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380107c00 0x7fc38010a0c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc378009ca0 tx=0x7fc37802a950 comp rx=0 tx=0).stop 2024-09-13T18:03:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.728+0000 7fc387600640 1 -- 172.21.15.27:0/2212089404 shutdown_connections 2024-09-13T18:03:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.728+0000 7fc387600640 1 --2- 172.21.15.27:0/2212089404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380107c00 0x7fc38010a0c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.728+0000 7fc387600640 1 --2- 172.21.15.27:0/2212089404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc380072eb0 0x7fc380073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.728+0000 7fc387600640 1 --2- 172.21.15.27:0/2212089404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc380074490 0x7fc3800728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.728+0000 7fc387600640 1 -- 172.21.15.27:0/2212089404 >> 172.21.15.27:0/2212089404 conn(0x7fc3800fb4d0 msgr2=0x7fc3800fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.728+0000 7fc387600640 1 -- 172.21.15.27:0/2212089404 shutdown_connections 2024-09-13T18:03:47.731 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.728+0000 7fc387600640 1 -- 172.21.15.27:0/2212089404 wait complete. 2024-09-13T18:03:47.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.729+0000 7fc387600640 1 Processor -- start 2024-09-13T18:03:47.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.729+0000 7fc387600640 1 -- start start 2024-09-13T18:03:47.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.729+0000 7fc387600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380072eb0 0x7fc380197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:47.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.729+0000 7fc387600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc380074490 0x7fc3801984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:47.733 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc387600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc380107c00 0x7fc38019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:47.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc387600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38019fa70 con 0x7fc380072eb0 2024-09-13T18:03:47.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc387600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38019fbe0 con 0x7fc380107c00 2024-09-13T18:03:47.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc387600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38019fda0 con 0x7fc380074490 2024-09-13T18:03:47.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc384c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380072eb0 0x7fc380197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:47.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc384c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380072eb0 0x7fc380197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33602/0 (socket says 172.21.15.27:33602) 2024-09-13T18:03:47.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc384c00640 1 -- 172.21.15.27:0/2791743974 learned_addr learned my addr 172.21.15.27:0/2791743974 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:47.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc37fe00640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc380074490 0x7fc3801984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:47.734 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc385600640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc380107c00 0x7fc38019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc384c00640 1 -- 172.21.15.27:0/2791743974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc380074490 msgr2=0x7fc3801984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc384c00640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc380074490 0x7fc3801984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc384c00640 1 -- 172.21.15.27:0/2791743974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc380107c00 msgr2=0x7fc38019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc384c00640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc380107c00 0x7fc38019f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.730+0000 7fc384c00640 1 -- 172.21.15.27:0/2791743974 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc374009490 con 0x7fc380072eb0 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.731+0000 7fc384c00640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380072eb0 0x7fc380197f80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc37400ea60 tx=0x7fc37400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.731+0000 7fc37d600640 1 -- 172.21.15.27:0/2791743974 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37400cde0 con 0x7fc380072eb0 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.731+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc378009900 con 0x7fc380072eb0 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.731+0000 7fc37d600640 1 -- 172.21.15.27:0/2791743974 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc3740035f0 con 0x7fc380072eb0 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.731+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3801a0450 con 0x7fc380072eb0 2024-09-13T18:03:47.735 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.731+0000 7fc37d600640 1 -- 172.21.15.27:0/2791743974 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc374005220 con 0x7fc380072eb0 2024-09-13T18:03:47.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.732+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3801069c0 con 0x7fc380072eb0 2024-09-13T18:03:47.736 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.734+0000 7fc37d600640 1 -- 172.21.15.27:0/2791743974 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc374003af0 con 0x7fc380072eb0 2024-09-13T18:03:47.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.735+0000 7fc37d600640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc3680a1090 0x7fc3680a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:47.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.736+0000 7fc37d600640 1 -- 172.21.15.27:0/2791743974 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc374014070 con 0x7fc380072eb0 2024-09-13T18:03:47.737 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.736+0000 7fc37fe00640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc3680a1090 0x7fc3680a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:47.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.736+0000 7fc37fe00640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc3680a1090 0x7fc3680a3550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc380199490 tx=0x7fc36c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:47.740 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.739+0000 7fc37d600640 1 -- 172.21.15.27:0/2791743974 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fc374096470 con 0x7fc380072eb0 2024-09-13T18:03:47.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.919+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc38010d970 con 0x7fc380072eb0 2024-09-13T18:03:47.921 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.919+0000 7fc37d600640 1 -- 172.21.15.27:0/2791743974 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc374099a90 con 0x7fc380072eb0 2024-09-13T18:03:47.921 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-13T18:03:47.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc3680a1090 msgr2=0x7fc3680a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.923 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc3680a1090 0x7fc3680a3550 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc380199490 tx=0x7fc36c005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380072eb0 msgr2=0x7fc380197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380072eb0 0x7fc380197f80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc37400ea60 tx=0x7fc37400ef20 comp rx=0 tx=0).stop 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 shutdown_connections 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fc3680a1090 0x7fc3680a3550 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fc380107c00 0x7fc38019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fc380074490 0x7fc3801984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 --2- 172.21.15.27:0/2791743974 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fc380072eb0 0x7fc380197f80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.921+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 >> 172.21.15.27:0/2791743974 conn(0x7fc3800fb4d0 msgr2=0x7fc380103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.922+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 shutdown_connections 2024-09-13T18:03:47.924 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:47.922+0000 7fc387600640 1 -- 172.21.15.27:0/2791743974 wait complete. 2024-09-13T18:03:47.939 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:03:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.100+0000 7f95ba800640 1 -- 172.21.15.27:0/946806414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 msgr2=0x7f95b41035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.100+0000 7f95ba800640 1 --2- 172.21.15.27:0/946806414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 0x7f95b41035f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009900 tx=0x7f95a002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.102 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.100+0000 7f95ba800640 1 -- 172.21.15.27:0/946806414 shutdown_connections 2024-09-13T18:03:48.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.100+0000 7f95ba800640 1 --2- 172.21.15.27:0/946806414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95b4103b30 0x7f95b410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.100+0000 7f95ba800640 1 --2- 172.21.15.27:0/946806414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 0x7f95b41035f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.100+0000 7f95ba800640 1 --2- 172.21.15.27:0/946806414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b4101f80 0x7f95b4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.100+0000 7f95ba800640 1 -- 172.21.15.27:0/946806414 >> 172.21.15.27:0/946806414 conn(0x7f95b40fd700 msgr2=0x7f95b40ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:48.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.100+0000 7f95ba800640 1 -- 172.21.15.27:0/946806414 shutdown_connections 2024-09-13T18:03:48.103 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.100+0000 7f95ba800640 1 -- 172.21.15.27:0/946806414 wait complete. 2024-09-13T18:03:48.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.101+0000 7f95ba800640 1 Processor -- start 2024-09-13T18:03:48.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.101+0000 7f95ba800640 1 -- start start 2024-09-13T18:03:48.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.101+0000 7f95ba800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95b4101f80 0x7f95b4198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.101+0000 7f95ba800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 0x7f95b41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95ba800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b4103b30 0x7f95b419f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95ba800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b419fb70 con 0x7f95b4103170 2024-09-13T18:03:48.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95ba800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b419fce0 con 0x7f95b4101f80 2024-09-13T18:03:48.105 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95ba800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b419fea0 con 0x7f95b4103b30 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b2a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 0x7f95b41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b2a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 0x7f95b41985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33616/0 (socket says 172.21.15.27:33616) 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b2a00640 1 -- 172.21.15.27:0/4111793788 learned_addr learned my addr 172.21.15.27:0/4111793788 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b3400640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95b4101f80 0x7f95b4198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b3e00640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b4103b30 0x7f95b419f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b2a00640 1 -- 172.21.15.27:0/4111793788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b4103b30 msgr2=0x7f95b419f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b2a00640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b4103b30 0x7f95b419f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b2a00640 1 -- 172.21.15.27:0/4111793788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95b4101f80 msgr2=0x7f95b4198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b2a00640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95b4101f80 0x7f95b4198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b2a00640 1 -- 172.21.15.27:0/4111793788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a0009560 con 0x7f95b4103170 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.102+0000 7f95b2a00640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 0x7f95b41985c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f95a0031510 tx=0x7f95a00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.103+0000 7f95abe00640 1 -- 172.21.15.27:0/4111793788 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0004b50 con 0x7f95b4103170 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.103+0000 7f95abe00640 1 -- 172.21.15.27:0/4111793788 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f95a0004cb0 con 0x7f95b4103170 2024-09-13T18:03:48.106 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.103+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b41a0120 con 0x7f95b4103170 2024-09-13T18:03:48.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.103+0000 7f95abe00640 1 -- 172.21.15.27:0/4111793788 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a0031ba0 con 0x7f95b4103170 2024-09-13T18:03:48.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.103+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b41a05d0 con 0x7f95b4103170 2024-09-13T18:03:48.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.104+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b4109390 con 0x7f95b4103170 2024-09-13T18:03:48.107 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.106+0000 7f95abe00640 1 -- 172.21.15.27:0/4111793788 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f95a0031d00 con 0x7f95b4103170 2024-09-13T18:03:48.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.107+0000 7f95abe00640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95980a1090 0x7f95980a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.107+0000 7f95abe00640 1 -- 172.21.15.27:0/4111793788 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f95a00ed830 con 0x7f95b4103170 2024-09-13T18:03:48.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.107+0000 7f95b3400640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95980a1090 0x7f95980a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.109 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.108+0000 7f95b3400640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95980a1090 0x7f95980a3550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95b4102fd0 tx=0x7f95a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:48.112 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.111+0000 7f95abe00640 1 -- 172.21.15.27:0/4111793788 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f95a00b7020 con 0x7f95b4103170 2024-09-13T18:03:48.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.292+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95b4108e00 con 0x7f95b4103170 2024-09-13T18:03:48.295 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.293+0000 7f95abe00640 1 -- 172.21.15.27:0/4111793788 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95a00ba640 con 0x7f95b4103170 2024-09-13T18:03:48.295 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-09-13T18:03:48.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95980a1090 msgr2=0x7f95980a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95980a1090 0x7f95980a3550 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95b4102fd0 tx=0x7f95a4005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:48.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 msgr2=0x7f95b41985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 0x7f95b41985c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f95a0031510 tx=0x7f95a00055a0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.297 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 shutdown_connections 2024-09-13T18:03:48.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f95980a1090 0x7f95980a3550 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f95b4103b30 0x7f95b419f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f95b4103170 0x7f95b41985c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 --2- 172.21.15.27:0/4111793788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f95b4101f80 0x7f95b4198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 >> 172.21.15.27:0/4111793788 conn(0x7f95b40fd700 msgr2=0x7f95b4106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:48.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 shutdown_connections 2024-09-13T18:03:48.298 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.295+0000 7f95ba800640 1 -- 172.21.15.27:0/4111793788 wait complete. 2024-09-13T18:03:48.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:48 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/351749140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:48.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:48 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2791743974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:48.313 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:03:48.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:48 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/351749140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:48.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:48 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2791743974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:48.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.474+0000 7f5711600640 1 -- 172.21.15.27:0/4282214531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c103a40 msgr2=0x7f570c10a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.474+0000 7f5711600640 1 --2- 172.21.15.27:0/4282214531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c103a40 0x7f570c10a360 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5704009ca0 tx=0x7f570402a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.474+0000 7f5711600640 1 -- 172.21.15.27:0/4282214531 shutdown_connections 2024-09-13T18:03:48.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.474+0000 7f5711600640 1 --2- 172.21.15.27:0/4282214531 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c103a40 0x7f570c10a360 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.474+0000 7f5711600640 1 --2- 172.21.15.27:0/4282214531 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f570c103080 0x7f570c103500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.474+0000 7f5711600640 1 --2- 172.21.15.27:0/4282214531 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f570c101ea0 0x7f570c1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.474+0000 7f5711600640 1 -- 172.21.15.27:0/4282214531 >> 172.21.15.27:0/4282214531 conn(0x7f570c0fd670 msgr2=0x7f570c0ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:48.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.474+0000 7f5711600640 1 -- 172.21.15.27:0/4282214531 shutdown_connections 2024-09-13T18:03:48.476 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.474+0000 7f5711600640 1 -- 172.21.15.27:0/4282214531 wait complete. 2024-09-13T18:03:48.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.475+0000 7f5711600640 1 Processor -- start 2024-09-13T18:03:48.478 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.475+0000 7f5711600640 1 -- start start 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.475+0000 7f5711600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c101ea0 0x7f570c197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.475+0000 7f5711600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f570c103080 0x7f570c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.475+0000 7f5711600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f570c103a40 0x7f570c19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.475+0000 7f5711600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c19fa00 con 0x7f570c101ea0 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.475+0000 7f5711600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c19fb70 con 0x7f570c103a40 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.475+0000 7f5711600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570c19fd30 con 0x7f570c103080 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.475+0000 7f570be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c101ea0 0x7f570c197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f570be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c101ea0 0x7f570c197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33634/0 (socket says 172.21.15.27:33634) 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f570be00640 1 -- 172.21.15.27:0/2395025918 learned_addr learned my addr 172.21.15.27:0/2395025918 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f5703400640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f570c103080 0x7f570c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f5710c00640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f570c103a40 0x7f570c19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f570be00640 1 -- 172.21.15.27:0/2395025918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f570c103080 msgr2=0x7f570c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.479 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f570be00640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f570c103080 0x7f570c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f570be00640 1 -- 172.21.15.27:0/2395025918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f570c103a40 msgr2=0x7f570c19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f570be00640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f570c103a40 0x7f570c19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f570be00640 1 -- 172.21.15.27:0/2395025918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704009900 con 0x7f570c101ea0 2024-09-13T18:03:48.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f570be00640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c101ea0 0x7f570c197f10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00e9c0 tx=0x7f56fc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:48.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f5709600640 1 -- 172.21.15.27:0/2395025918 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc009700 con 0x7f570c101ea0 2024-09-13T18:03:48.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f5709600640 1 -- 172.21.15.27:0/2395025918 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f56fc00cd80 con 0x7f570c101ea0 2024-09-13T18:03:48.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570c19ffb0 con 0x7f570c101ea0 2024-09-13T18:03:48.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.476+0000 7f5709600640 1 -- 172.21.15.27:0/2395025918 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56fc010430 con 0x7f570c101ea0 2024-09-13T18:03:48.480 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.477+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570c1a0430 con 0x7f570c101ea0 2024-09-13T18:03:48.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.478+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570c109310 con 0x7f570c101ea0 2024-09-13T18:03:48.481 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.480+0000 7f5709600640 1 -- 172.21.15.27:0/2395025918 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f56fc003680 con 0x7f570c101ea0 2024-09-13T18:03:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.481+0000 7f5709600640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56f00a1090 0x7f56f00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.481+0000 7f5709600640 1 -- 172.21.15.27:0/2395025918 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f56fc014070 con 0x7f570c101ea0 2024-09-13T18:03:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.481+0000 7f5703400640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56f00a1090 0x7f56f00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.483 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.482+0000 7f5703400640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56f00a1090 0x7f56f00a3550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f570c199420 tx=0x7f56f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:48.484 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.483+0000 7f5709600640 1 -- 172.21.15.27:0/2395025918 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f56fc096600 con 0x7f570c101ea0 2024-09-13T18:03:48.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:48 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/351749140' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:48.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:48 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2791743974' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:48.666 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.664+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f570c108d80 con 0x7f570c101ea0 2024-09-13T18:03:48.667 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.665+0000 7f5709600640 1 -- 172.21.15.27:0/2395025918 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56fc099c20 con 0x7f570c101ea0 2024-09-13T18:03:48.667 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-09-13T18:03:48.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56f00a1090 msgr2=0x7f56f00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56f00a1090 0x7f56f00a3550 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f570c199420 tx=0x7f56f4005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:48.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c101ea0 msgr2=0x7f570c197f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c101ea0 0x7f570c197f10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00e9c0 tx=0x7f56fc00ee80 comp rx=0 tx=0).stop 2024-09-13T18:03:48.669 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 shutdown_connections 2024-09-13T18:03:48.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f56f00a1090 0x7f56f00a3550 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f570c103a40 0x7f570c19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f570c103080 0x7f570c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 --2- 172.21.15.27:0/2395025918 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f570c101ea0 0x7f570c197f10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 >> 172.21.15.27:0/2395025918 conn(0x7f570c0fd670 msgr2=0x7f570c1064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:48.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 shutdown_connections 2024-09-13T18:03:48.670 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.667+0000 7f5711600640 1 -- 172.21.15.27:0/2395025918 wait complete. 2024-09-13T18:03:48.685 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:03:48.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.844+0000 7f1da3200640 1 -- 172.21.15.27:0/543192556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4103970 msgr2=0x7f1da410a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.844+0000 7f1da3200640 1 --2- 172.21.15.27:0/543192556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4103970 0x7f1da410a200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009ca0 tx=0x7f1d9c02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.844+0000 7f1da3200640 1 -- 172.21.15.27:0/543192556 shutdown_connections 2024-09-13T18:03:48.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.844+0000 7f1da3200640 1 --2- 172.21.15.27:0/543192556 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4103970 0x7f1da410a200 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.844+0000 7f1da3200640 1 --2- 172.21.15.27:0/543192556 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1da4102fb0 0x7f1da4103430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.844+0000 7f1da3200640 1 --2- 172.21.15.27:0/543192556 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1da4101dc0 0x7f1da41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.846 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.844+0000 7f1da3200640 1 -- 172.21.15.27:0/543192556 >> 172.21.15.27:0/543192556 conn(0x7f1da40fd540 msgr2=0x7f1da40ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:48.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.844+0000 7f1da3200640 1 -- 172.21.15.27:0/543192556 shutdown_connections 2024-09-13T18:03:48.847 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.844+0000 7f1da3200640 1 -- 172.21.15.27:0/543192556 wait complete. 2024-09-13T18:03:48.848 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da3200640 1 Processor -- start 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da3200640 1 -- start start 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da3200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1da4101dc0 0x7f1da4197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da3200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4102fb0 0x7f1da4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da3200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1da4103970 0x7f1da419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da3200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da419f930 con 0x7f1da4102fb0 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da3200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da419faa0 con 0x7f1da4103970 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da3200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da419fc60 con 0x7f1da4101dc0 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da1400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4102fb0 0x7f1da4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da1400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4102fb0 0x7f1da4198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33644/0 (socket says 172.21.15.27:33644) 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da1400640 1 -- 172.21.15.27:0/3539203139 learned_addr learned my addr 172.21.15.27:0/3539203139 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da2800640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1da4103970 0x7f1da419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.845+0000 7f1da1e00640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1da4101dc0 0x7f1da4197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1da1400640 1 -- 172.21.15.27:0/3539203139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1da4101dc0 msgr2=0x7f1da4197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1da1400640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1da4101dc0 0x7f1da4197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1da1400640 1 -- 172.21.15.27:0/3539203139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1da4103970 msgr2=0x7f1da419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1da1400640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1da4103970 0x7f1da419f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1da1400640 1 -- 172.21.15.27:0/3539203139 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94009490 con 0x7f1da4102fb0 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1da1400640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4102fb0 0x7f1da4198380 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000ea60 tx=0x7f1d9000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1d9aa00640 1 -- 172.21.15.27:0/3539203139 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000cde0 con 0x7f1da4102fb0 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1d9aa00640 1 -- 172.21.15.27:0/3539203139 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1d900035f0 con 0x7f1da4102fb0 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1d9aa00640 1 -- 172.21.15.27:0/3539203139 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90010690 con 0x7f1da4102fb0 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d90009490 con 0x7f1da4102fb0 2024-09-13T18:03:48.850 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.846+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c009900 con 0x7f1da4102fb0 2024-09-13T18:03:48.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.847+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da4109200 con 0x7f1da4102fb0 2024-09-13T18:03:48.851 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.849+0000 7f1d9aa00640 1 -- 172.21.15.27:0/3539203139 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1d90003af0 con 0x7f1da4102fb0 2024-09-13T18:03:48.852 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.851+0000 7f1d9aa00640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d880a1110 0x7f1d880a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:48.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.851+0000 7f1d9aa00640 1 -- 172.21.15.27:0/3539203139 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1d90014070 con 0x7f1da4102fb0 2024-09-13T18:03:48.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.851+0000 7f1da1e00640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d880a1110 0x7f1d880a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:48.853 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.852+0000 7f1da1e00640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d880a1110 0x7f1d880a35d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1da4102e10 tx=0x7f1d94005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:48.856 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:48.854+0000 7f1d9aa00640 1 -- 172.21.15.27:0/3539203139 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1d90096430 con 0x7f1da4102fb0 2024-09-13T18:03:49.076 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.074+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1da410d7c0 con 0x7f1da4102fb0 2024-09-13T18:03:49.077 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.075+0000 7f1d9aa00640 1 -- 172.21.15.27:0/3539203139 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10916 (secure 0 0 0) 0x7f1d90099a50 con 0x7f1da4102fb0 2024-09-13T18:03:49.077 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:49.077 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:01:46.320502+0000","modified":"2024-09-13T18:01:53.056677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24556,"mds_2":24533,"mds_3":24529,"mds_4":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24448":{"gid":24448,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24529":{"gid":24529,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24556":{"gid":24556,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/1102491877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1102491877},{"type":"v1","addr":"172.21.15.122:6839","nonce":1102491877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:03:49.077 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 26 2024-09-13T18:03:49.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d880a1110 msgr2=0x7f1d880a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d880a1110 0x7f1d880a35d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1da4102e10 tx=0x7f1d94005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:49.079 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4102fb0 msgr2=0x7f1da4198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4102fb0 0x7f1da4198380 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000ea60 tx=0x7f1d9000ef20 comp rx=0 tx=0).stop 2024-09-13T18:03:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 shutdown_connections 2024-09-13T18:03:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1d880a1110 0x7f1d880a35d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1da4103970 0x7f1da419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1da4102fb0 0x7f1da4198380 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 --2- 172.21.15.27:0/3539203139 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1da4101dc0 0x7f1da4197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.077+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 >> 172.21.15.27:0/3539203139 conn(0x7f1da40fd540 msgr2=0x7f1da41063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.078+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 shutdown_connections 2024-09-13T18:03:49.080 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.078+0000 7f1da3200640 1 -- 172.21.15.27:0/3539203139 wait complete. 2024-09-13T18:03:49.096 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:03:49.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.256+0000 7faf35a00640 1 -- 172.21.15.27:0/725065486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf300744f0 msgr2=0x7faf30072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.258 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.256+0000 7faf35a00640 1 --2- 172.21.15.27:0/725065486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf300744f0 0x7faf30072940 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faf20009be0 tx=0x7faf2002a6c0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.256+0000 7faf35a00640 1 -- 172.21.15.27:0/725065486 shutdown_connections 2024-09-13T18:03:49.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.256+0000 7faf35a00640 1 --2- 172.21.15.27:0/725065486 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf3010c370 0x7faf3010e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.256+0000 7faf35a00640 1 --2- 172.21.15.27:0/725065486 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf30072f10 0x7faf30073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.256+0000 7faf35a00640 1 --2- 172.21.15.27:0/725065486 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf300744f0 0x7faf30072940 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.256+0000 7faf35a00640 1 -- 172.21.15.27:0/725065486 >> 172.21.15.27:0/725065486 conn(0x7faf300fb520 msgr2=0x7faf300fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:49.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.256+0000 7faf35a00640 1 -- 172.21.15.27:0/725065486 shutdown_connections 2024-09-13T18:03:49.259 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.256+0000 7faf35a00640 1 -- 172.21.15.27:0/725065486 wait complete. 2024-09-13T18:03:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.257+0000 7faf35a00640 1 Processor -- start 2024-09-13T18:03:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.257+0000 7faf35a00640 1 -- start start 2024-09-13T18:03:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf35a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30072f10 0x7faf3019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf35a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf300744f0 0x7faf3019c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf35a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3010c370 0x7faf301a3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf35a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf301a3f80 con 0x7faf3010c370 2024-09-13T18:03:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf35a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf301a40f0 con 0x7faf300744f0 2024-09-13T18:03:49.261 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf35a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf301a42b0 con 0x7faf30072f10 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2ea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30072f10 0x7faf3019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2f400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3010c370 0x7faf301a3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2f400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3010c370 0x7faf301a3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33658/0 (socket says 172.21.15.27:33658) 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2f400640 1 -- 172.21.15.27:0/3447731601 learned_addr learned my addr 172.21.15.27:0/3447731601 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2ea00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30072f10 0x7faf3019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:51966/0 (socket says 172.21.15.27:51966) 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf26000640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf300744f0 0x7faf3019c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2f400640 1 -- 172.21.15.27:0/3447731601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30072f10 msgr2=0x7faf3019c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2f400640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30072f10 0x7faf3019c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2f400640 1 -- 172.21.15.27:0/3447731601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf300744f0 msgr2=0x7faf3019c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2f400640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf300744f0 0x7faf3019c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2f400640 1 -- 172.21.15.27:0/3447731601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf18009560 con 0x7faf3010c370 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.258+0000 7faf2ea00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30072f10 0x7faf3019c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:49.262 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.259+0000 7faf2f400640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3010c370 0x7faf301a3a40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf2800e970 tx=0x7faf2800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:49.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.259+0000 7faf27e00640 1 -- 172.21.15.27:0/3447731601 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28009720 con 0x7faf3010c370 2024-09-13T18:03:49.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.259+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf20009840 con 0x7faf3010c370 2024-09-13T18:03:49.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.259+0000 7faf27e00640 1 -- 172.21.15.27:0/3447731601 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faf28005500 con 0x7faf3010c370 2024-09-13T18:03:49.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.259+0000 7faf27e00640 1 -- 172.21.15.27:0/3447731601 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28010430 con 0x7faf3010c370 2024-09-13T18:03:49.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.259+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf301a4910 con 0x7faf3010c370 2024-09-13T18:03:49.263 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.260+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf30101d10 con 0x7faf3010c370 2024-09-13T18:03:49.264 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.262+0000 7faf27e00640 1 -- 172.21.15.27:0/3447731601 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7faf28004ff0 con 0x7faf3010c370 2024-09-13T18:03:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.263+0000 7faf27e00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf140a1090 0x7faf140a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.263+0000 7faf27e00640 1 -- 172.21.15.27:0/3447731601 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faf28014070 con 0x7faf3010c370 2024-09-13T18:03:49.265 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.264+0000 7faf2ea00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf140a1090 0x7faf140a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:49.266 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.264+0000 7faf2ea00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf140a1090 0x7faf140a3550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faf2002acb0 tx=0x7faf20005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:49.269 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.267+0000 7faf27e00640 1 -- 172.21.15.27:0/3447731601 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7faf280963c0 con 0x7faf3010c370 2024-09-13T18:03:49.426 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:49 smithi143 ceph-mon[38210]: pgmap v354: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:03:49.426 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:49 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/4111793788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:49.426 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:49 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2395025918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:49.426 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:49 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3539203139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:49.452 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.450+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf30111db0 con 0x7faf3010c370 2024-09-13T18:03:49.453 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.451+0000 7faf27e00640 1 -- 172.21.15.27:0/3447731601 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7faf280999e0 con 0x7faf3010c370 2024-09-13T18:03:49.454 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:49.454 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":88,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:02:37.160677+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf140a1090 msgr2=0x7faf140a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf140a1090 0x7faf140a3550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faf2002acb0 tx=0x7faf20005fd0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3010c370 msgr2=0x7faf301a3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3010c370 0x7faf301a3a40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf2800e970 tx=0x7faf2800ed70 comp rx=0 tx=0).stop 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 shutdown_connections 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7faf140a1090 0x7faf140a3550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7faf3010c370 0x7faf301a3a40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7faf300744f0 0x7faf3019c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 --2- 172.21.15.27:0/3447731601 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7faf30072f10 0x7faf3019c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.456 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 >> 172.21.15.27:0/3447731601 conn(0x7faf300fb520 msgr2=0x7faf300fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:49.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 shutdown_connections 2024-09-13T18:03:49.457 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.454+0000 7faf35a00640 1 -- 172.21.15.27:0/3447731601 wait complete. 2024-09-13T18:03:49.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:49 smithi122 ceph-mon[35310]: pgmap v354: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:03:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:49 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/4111793788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:49 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2395025918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:49 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3539203139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:49.470 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:49 smithi027 ceph-mon[30611]: pgmap v354: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:03:49.470 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:49 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/4111793788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:49.470 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:49 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2395025918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:49.470 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:49 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3539203139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:49.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:57:10.088488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:01:44.492835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:01:45.883650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:03:49.473 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:03:49.635 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.633+0000 7fbe50400640 1 -- 172.21.15.27:0/2718098785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48072eb0 msgr2=0x7fbe48073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.633+0000 7fbe50400640 1 --2- 172.21.15.27:0/2718098785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48072eb0 0x7fbe48073310 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbe34009900 tx=0x7fbe3402a480 comp rx=0 tx=0).stop 2024-09-13T18:03:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.633+0000 7fbe50400640 1 -- 172.21.15.27:0/2718098785 shutdown_connections 2024-09-13T18:03:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.633+0000 7fbe50400640 1 --2- 172.21.15.27:0/2718098785 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe48107c00 0x7fbe4810a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.633+0000 7fbe50400640 1 --2- 172.21.15.27:0/2718098785 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48072eb0 0x7fbe48073310 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.633+0000 7fbe50400640 1 --2- 172.21.15.27:0/2718098785 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe48074490 0x7fbe480728e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.633+0000 7fbe50400640 1 -- 172.21.15.27:0/2718098785 >> 172.21.15.27:0/2718098785 conn(0x7fbe480fb4d0 msgr2=0x7fbe480fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.633+0000 7fbe50400640 1 -- 172.21.15.27:0/2718098785 shutdown_connections 2024-09-13T18:03:49.636 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.633+0000 7fbe50400640 1 -- 172.21.15.27:0/2718098785 wait complete. 2024-09-13T18:03:49.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.634+0000 7fbe50400640 1 Processor -- start 2024-09-13T18:03:49.638 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.634+0000 7fbe50400640 1 -- start start 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe50400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe48072eb0 0x7fbe48198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe50400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48074490 0x7fbe48198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe50400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe48107c00 0x7fbe4819f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe50400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4819fb40 con 0x7fbe48074490 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe50400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4819fcb0 con 0x7fbe48107c00 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe50400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4819fe70 con 0x7fbe48072eb0 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe4d000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48074490 0x7fbe48198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe4d000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48074490 0x7fbe48198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:33676/0 (socket says 172.21.15.27:33676) 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe4d000640 1 -- 172.21.15.27:0/3573888281 learned_addr learned my addr 172.21.15.27:0/3573888281 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe4e400640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe48107c00 0x7fbe4819f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:49.639 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.635+0000 7fbe4da00640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe48072eb0 0x7fbe48198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe4d000640 1 -- 172.21.15.27:0/3573888281 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe48072eb0 msgr2=0x7fbe48198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe4d000640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe48072eb0 0x7fbe48198050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe4d000640 1 -- 172.21.15.27:0/3573888281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe48107c00 msgr2=0x7fbe4819f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe4d000640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe48107c00 0x7fbe4819f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe4d000640 1 -- 172.21.15.27:0/3573888281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe40009840 con 0x7fbe48074490 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe4e400640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe48107c00 0x7fbe4819f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe4d000640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48074490 0x7fbe48198590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbe34031510 tx=0x7fbe34004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe46000640 1 -- 172.21.15.27:0/3573888281 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34005000 con 0x7fbe48074490 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe46000640 1 -- 172.21.15.27:0/3573888281 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbe340046c0 con 0x7fbe48074490 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe34009560 con 0x7fbe48074490 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe46000640 1 -- 172.21.15.27:0/3573888281 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe34003950 con 0x7fbe48074490 2024-09-13T18:03:49.640 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.636+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe481a0460 con 0x7fbe48074490 2024-09-13T18:03:49.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.637+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe481069c0 con 0x7fbe48074490 2024-09-13T18:03:49.641 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.639+0000 7fbe46000640 1 -- 172.21.15.27:0/3573888281 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbe34003cc0 con 0x7fbe48074490 2024-09-13T18:03:49.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.641+0000 7fbe46000640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbe300a1110 0x7fbe300a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:49.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.641+0000 7fbe46000640 1 -- 172.21.15.27:0/3573888281 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbe340ed730 con 0x7fbe48074490 2024-09-13T18:03:49.643 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.641+0000 7fbe4da00640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbe300a1110 0x7fbe300a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:49.644 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.642+0000 7fbe4da00640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbe300a1110 0x7fbe300a35d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009bd0 tx=0x7fbe3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:49.646 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.644+0000 7fbe46000640 1 -- 172.21.15.27:0/3573888281 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbe340b6e70 con 0x7fbe48074490 2024-09-13T18:03:49.824 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.823+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe48106430 con 0x7fbe48074490 2024-09-13T18:03:49.825 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.823+0000 7fbe46000640 1 -- 172.21.15.27:0/3573888281 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe340ba490 con 0x7fbe48074490 2024-09-13T18:03:49.825 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-13T18:03:49.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbe300a1110 msgr2=0x7fbe300a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbe300a1110 0x7fbe300a35d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009bd0 tx=0x7fbe3c005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:49.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48074490 msgr2=0x7fbe48198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:49.827 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48074490 0x7fbe48198590 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbe34031510 tx=0x7fbe34004270 comp rx=0 tx=0).stop 2024-09-13T18:03:49.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 shutdown_connections 2024-09-13T18:03:49.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbe300a1110 0x7fbe300a35d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbe48107c00 0x7fbe4819f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbe48074490 0x7fbe48198590 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 --2- 172.21.15.27:0/3573888281 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbe48072eb0 0x7fbe48198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:49.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 >> 172.21.15.27:0/3573888281 conn(0x7fbe480fb4d0 msgr2=0x7fbe48103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:49.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 shutdown_connections 2024-09-13T18:03:49.828 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:49.825+0000 7fbe50400640 1 -- 172.21.15.27:0/3573888281 wait complete. 2024-09-13T18:03:49.844 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:03:50.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.004+0000 7f2609a00640 1 -- 172.21.15.27:0/341680882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604105a60 msgr2=0x7f2604107ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.004+0000 7f2609a00640 1 --2- 172.21.15.27:0/341680882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604105a60 0x7f2604107ed0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009ca0 tx=0x7f25fc02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.006 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.004+0000 7f2609a00640 1 -- 172.21.15.27:0/341680882 shutdown_connections 2024-09-13T18:03:50.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.004+0000 7f2609a00640 1 --2- 172.21.15.27:0/341680882 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604105a60 0x7f2604107ed0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.004+0000 7f2609a00640 1 --2- 172.21.15.27:0/341680882 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2604103130 0x7f2604105520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.004+0000 7f2609a00640 1 --2- 172.21.15.27:0/341680882 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2604100800 0x7f2604102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.004+0000 7f2609a00640 1 -- 172.21.15.27:0/341680882 >> 172.21.15.27:0/341680882 conn(0x7f26040fa3e0 msgr2=0x7f26040fc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:50.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.004+0000 7f2609a00640 1 -- 172.21.15.27:0/341680882 shutdown_connections 2024-09-13T18:03:50.007 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.004+0000 7f2609a00640 1 -- 172.21.15.27:0/341680882 wait complete. 2024-09-13T18:03:50.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.005+0000 7f2609a00640 1 Processor -- start 2024-09-13T18:03:50.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.005+0000 7f2609a00640 1 -- start start 2024-09-13T18:03:50.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.005+0000 7f2609a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2604100800 0x7f2604100170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.005+0000 7f2609a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604103130 0x7f26040fe7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2609a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2604105a60 0x7f26040fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2609a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26040ff450 con 0x7f2604103130 2024-09-13T18:03:50.009 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2609a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26040ff5c0 con 0x7f2604100800 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2609a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260419ff30 con 0x7f2604105a60 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2602000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604103130 0x7f26040fe7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2602000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604103130 0x7f26040fe7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60726/0 (socket says 172.21.15.27:60726) 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2602000640 1 -- 172.21.15.27:0/3001884070 learned_addr learned my addr 172.21.15.27:0/3001884070 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2603400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2604105a60 0x7f26040fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2602a00640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2604100800 0x7f2604100170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2602000640 1 -- 172.21.15.27:0/3001884070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2604105a60 msgr2=0x7f26040fecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2602000640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2604105a60 0x7f26040fecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2602000640 1 -- 172.21.15.27:0/3001884070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2604100800 msgr2=0x7f2604100170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2602000640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2604100800 0x7f2604100170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.006+0000 7f2602000640 1 -- 172.21.15.27:0/3001884070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc009900 con 0x7f2604103130 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.007+0000 7f2602000640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604103130 0x7f26040fe7b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e9f0 tx=0x7f25f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.007+0000 7f25fb400640 1 -- 172.21.15.27:0/3001884070 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0009700 con 0x7f2604103130 2024-09-13T18:03:50.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.007+0000 7f25fb400640 1 -- 172.21.15.27:0/3001884070 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f25f000cd80 con 0x7f2604103130 2024-09-13T18:03:50.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.007+0000 7f25fb400640 1 -- 172.21.15.27:0/3001884070 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0010690 con 0x7f2604103130 2024-09-13T18:03:50.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.007+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26041a01e0 con 0x7f2604103130 2024-09-13T18:03:50.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.007+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26041a06a0 con 0x7f2604103130 2024-09-13T18:03:50.011 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.008+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26040fbed0 con 0x7f2604103130 2024-09-13T18:03:50.012 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.010+0000 7f25fb400640 1 -- 172.21.15.27:0/3001884070 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f25f00046c0 con 0x7f2604103130 2024-09-13T18:03:50.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.011+0000 7f25fb400640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f25e80a1090 0x7f25e80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.011+0000 7f25fb400640 1 -- 172.21.15.27:0/3001884070 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25f0014070 con 0x7f2604103130 2024-09-13T18:03:50.013 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.011+0000 7f2602a00640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f25e80a1090 0x7f25e80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.012+0000 7f2602a00640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f25e80a1090 0x7f25e80a3550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009bd0 tx=0x7f25f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:50.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.015+0000 7f25fb400640 1 -- 172.21.15.27:0/3001884070 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f25f0096390 con 0x7f2604103130 2024-09-13T18:03:50.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.198+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26040fb940 con 0x7f2604103130 2024-09-13T18:03:50.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.198+0000 7f25fb400640 1 -- 172.21.15.27:0/3001884070 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f25f00999b0 con 0x7f2604103130 2024-09-13T18:03:50.200 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-09-13T18:03:50.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f25e80a1090 msgr2=0x7f25e80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f25e80a1090 0x7f25e80a3550 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f25f4009bd0 tx=0x7f25f4005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:50.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604103130 msgr2=0x7f26040fe7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604103130 0x7f26040fe7b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f25f000e9f0 tx=0x7f25f000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 shutdown_connections 2024-09-13T18:03:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f25e80a1090 0x7f25e80a3550 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2604105a60 0x7f26040fecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f2604103130 0x7f26040fe7b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 --2- 172.21.15.27:0/3001884070 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2604100800 0x7f2604100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 >> 172.21.15.27:0/3001884070 conn(0x7f26040fa3e0 msgr2=0x7f26041011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 shutdown_connections 2024-09-13T18:03:50.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.200+0000 7f2609a00640 1 -- 172.21.15.27:0/3001884070 wait complete. 2024-09-13T18:03:50.218 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:03:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.378+0000 7f09c4e00640 1 -- 172.21.15.27:0/2375095815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0103120 msgr2=0x7f09c0105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.378+0000 7f09c4e00640 1 --2- 172.21.15.27:0/2375095815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0103120 0x7f09c0105510 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009900 tx=0x7f09a802a410 comp rx=0 tx=0).stop 2024-09-13T18:03:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.379+0000 7f09c4e00640 1 -- 172.21.15.27:0/2375095815 shutdown_connections 2024-09-13T18:03:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.379+0000 7f09c4e00640 1 --2- 172.21.15.27:0/2375095815 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c0105a50 0x7f09c0107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.379+0000 7f09c4e00640 1 --2- 172.21.15.27:0/2375095815 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0103120 0x7f09c0105510 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.379+0000 7f09c4e00640 1 --2- 172.21.15.27:0/2375095815 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09c01007f0 0x7f09c0102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.379+0000 7f09c4e00640 1 -- 172.21.15.27:0/2375095815 >> 172.21.15.27:0/2375095815 conn(0x7f09c00fa3d0 msgr2=0x7f09c00fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.379+0000 7f09c4e00640 1 -- 172.21.15.27:0/2375095815 shutdown_connections 2024-09-13T18:03:50.381 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.379+0000 7f09c4e00640 1 -- 172.21.15.27:0/2375095815 wait complete. 2024-09-13T18:03:50.383 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.379+0000 7f09c4e00640 1 Processor -- start 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09c4e00640 1 -- start start 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09c4e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09c01007f0 0x7f09c0195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09c4e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c0103120 0x7f09c0196450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09c4e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0105a50 0x7f09c019d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09c4e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c019da00 con 0x7f09c0105a50 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09c4e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c019db70 con 0x7f09c0103120 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09c4e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c019dd30 con 0x7f09c01007f0 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09be800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0105a50 0x7f09c019d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09be800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0105a50 0x7f09c019d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60758/0 (socket says 172.21.15.27:60758) 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c0103120 0x7f09c0196450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.384 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09be800640 1 -- 172.21.15.27:0/960923516 learned_addr learned my addr 172.21.15.27:0/960923516 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.380+0000 7f09bde00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09c01007f0 0x7f09c0195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09be800640 1 -- 172.21.15.27:0/960923516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09c01007f0 msgr2=0x7f09c0195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09be800640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09c01007f0 0x7f09c0195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09be800640 1 -- 172.21.15.27:0/960923516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c0103120 msgr2=0x7f09c0196450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09be800640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c0103120 0x7f09c0196450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09be800640 1 -- 172.21.15.27:0/960923516 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a8009560 con 0x7f09c0105a50 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09b7e00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c0103120 0x7f09c0196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09bde00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09c01007f0 0x7f09c0195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09be800640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0105a50 0x7f09c019d4c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f09b800eb40 tx=0x7f09b800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09b6a00640 1 -- 172.21.15.27:0/960923516 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b8004b20 con 0x7f09c0105a50 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09b6a00640 1 -- 172.21.15.27:0/960923516 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f09b8004c80 con 0x7f09c0105a50 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c019dfb0 con 0x7f09c0105a50 2024-09-13T18:03:50.385 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09b6a00640 1 -- 172.21.15.27:0/960923516 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b80107b0 con 0x7f09c0105a50 2024-09-13T18:03:50.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.381+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c019e490 con 0x7f09c0105a50 2024-09-13T18:03:50.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.382+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c00fbec0 con 0x7f09c0105a50 2024-09-13T18:03:50.386 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.384+0000 7f09b6a00640 1 -- 172.21.15.27:0/960923516 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f09b8005020 con 0x7f09c0105a50 2024-09-13T18:03:50.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.385+0000 7f09b6a00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f09a40a1110 0x7f09a40a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.386+0000 7f09b6a00640 1 -- 172.21.15.27:0/960923516 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f09b8014070 con 0x7f09c0105a50 2024-09-13T18:03:50.387 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.386+0000 7f09bde00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f09a40a1110 0x7f09a40a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.388 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.386+0000 7f09bde00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f09a40a1110 0x7f09a40a35d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009c20 tx=0x7f09b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:50.391 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.389+0000 7f09b6a00640 1 -- 172.21.15.27:0/960923516 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f09b80967d0 con 0x7f09c0105a50 2024-09-13T18:03:50.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:50 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3447731601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:50.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:50 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3573888281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:50 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3447731601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:50.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:50 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3573888281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:50.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:50 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3447731601' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:50.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:50 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3573888281' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:03:50.586 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.584+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09c002c480 con 0x7f09c0105a50 2024-09-13T18:03:50.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.585+0000 7f09b6a00640 1 -- 172.21.15.27:0/960923516 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09b8099df0 con 0x7f09c0105a50 2024-09-13T18:03:50.587 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-09-13T18:03:50.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f09a40a1110 msgr2=0x7f09a40a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f09a40a1110 0x7f09a40a35d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009c20 tx=0x7f09b0005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:50.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0105a50 msgr2=0x7f09c019d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0105a50 0x7f09c019d4c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f09b800eb40 tx=0x7f09b800c2d0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 shutdown_connections 2024-09-13T18:03:50.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f09a40a1110 0x7f09a40a35d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f09c0105a50 0x7f09c019d4c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f09c0103120 0x7f09c0196450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 --2- 172.21.15.27:0/960923516 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f09c01007f0 0x7f09c0195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 >> 172.21.15.27:0/960923516 conn(0x7f09c00fa3d0 msgr2=0x7f09c0101290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:50.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 shutdown_connections 2024-09-13T18:03:50.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.587+0000 7f09c4e00640 1 -- 172.21.15.27:0/960923516 wait complete. 2024-09-13T18:03:50.605 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:03:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.763+0000 7f229a000640 1 -- 172.21.15.27:0/3008739461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 msgr2=0x7f229410e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.763+0000 7f229a000640 1 --2- 172.21.15.27:0/3008739461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 0x7f229410e740 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f228c009ca0 tx=0x7f228c02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.763+0000 7f229a000640 1 -- 172.21.15.27:0/3008739461 shutdown_connections 2024-09-13T18:03:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.763+0000 7f229a000640 1 --2- 172.21.15.27:0/3008739461 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 0x7f229410e740 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.763+0000 7f229a000640 1 --2- 172.21.15.27:0/3008739461 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f2294072f10 0x7f2294073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.763+0000 7f229a000640 1 --2- 172.21.15.27:0/3008739461 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f22940744f0 0x7f2294072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.763+0000 7f229a000640 1 -- 172.21.15.27:0/3008739461 >> 172.21.15.27:0/3008739461 conn(0x7f22940fb500 msgr2=0x7f22940fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.764+0000 7f229a000640 1 -- 172.21.15.27:0/3008739461 shutdown_connections 2024-09-13T18:03:50.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.764+0000 7f229a000640 1 -- 172.21.15.27:0/3008739461 wait complete. 2024-09-13T18:03:50.768 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.764+0000 7f229a000640 1 Processor -- start 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f229a000640 1 -- start start 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f229a000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2294072f10 0x7f229419c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f229a000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22940744f0 0x7f229419c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f229a000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 0x7f22941a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f229a000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22941a3f70 con 0x7f229410c350 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f229a000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22941a40e0 con 0x7f22940744f0 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f229a000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22941a42a0 con 0x7f2294072f10 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f2293e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 0x7f22941a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f228aa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22940744f0 0x7f229419c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f2293e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 0x7f22941a3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60786/0 (socket says 172.21.15.27:60786) 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f2293400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2294072f10 0x7f229419c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.765+0000 7f2293e00640 1 -- 172.21.15.27:0/1209032532 learned_addr learned my addr 172.21.15.27:0/1209032532 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:50.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f228aa00640 1 -- 172.21.15.27:0/1209032532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2294072f10 msgr2=0x7f229419c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f228aa00640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2294072f10 0x7f229419c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f228aa00640 1 -- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 msgr2=0x7f22941a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f228aa00640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 0x7f22941a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f228aa00640 1 -- 172.21.15.27:0/1209032532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c009900 con 0x7f22940744f0 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f2293e00640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 0x7f22941a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f228aa00640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22940744f0 0x7f229419c9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f227c00e9f0 tx=0x7f227c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f2290c00640 1 -- 172.21.15.27:0/1209032532 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c00ccc0 con 0x7f22940744f0 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22941a4580 con 0x7f22940744f0 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f2290c00640 1 -- 172.21.15.27:0/1209032532 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f227c00ce20 con 0x7f22940744f0 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f2290c00640 1 -- 172.21.15.27:0/1209032532 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c018920 con 0x7f22940744f0 2024-09-13T18:03:50.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.766+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22941a4a90 con 0x7f22940744f0 2024-09-13T18:03:50.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.767+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2294102520 con 0x7f22940744f0 2024-09-13T18:03:50.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.769+0000 7f2290c00640 1 -- 172.21.15.27:0/1209032532 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f227c018a80 con 0x7f22940744f0 2024-09-13T18:03:50.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.771+0000 7f2290c00640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f22780a1090 0x7f22780a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:50.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.771+0000 7f2290c00640 1 -- 172.21.15.27:0/1209032532 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f227c014070 con 0x7f22940744f0 2024-09-13T18:03:50.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.771+0000 7f2293400640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f22780a1090 0x7f22780a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:50.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.771+0000 7f2293400640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f22780a1090 0x7f22780a3550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2284009bd0 tx=0x7f2284005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:50.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.773+0000 7f2290c00640 1 -- 172.21.15.27:0/1209032532 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f227c0965f0 con 0x7f22940744f0 2024-09-13T18:03:50.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.993+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2294111de0 con 0x7f22940744f0 2024-09-13T18:03:50.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.994+0000 7f2290c00640 1 -- 172.21.15.27:0/1209032532 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10916 (secure 0 0 0) 0x7f227c099c10 con 0x7f22940744f0 2024-09-13T18:03:50.996 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:50.996 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:01:46.320502+0000","modified":"2024-09-13T18:01:53.056677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24556,"mds_2":24533,"mds_3":24529,"mds_4":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24448":{"gid":24448,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24529":{"gid":24529,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24556":{"gid":24556,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/1102491877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1102491877},{"type":"v1","addr":"172.21.15.122:6839","nonce":1102491877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:03:50.996 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 26 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f22780a1090 msgr2=0x7f22780a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f22780a1090 0x7f22780a3550 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2284009bd0 tx=0x7f2284005f90 comp rx=0 tx=0).stop 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22940744f0 msgr2=0x7f229419c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22940744f0 0x7f229419c9c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f227c00e9f0 tx=0x7f227c00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 shutdown_connections 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f22780a1090 0x7f22780a3550 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f229410c350 0x7f22941a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f22940744f0 0x7f229419c9c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 --2- 172.21.15.27:0/1209032532 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f2294072f10 0x7f229419c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 >> 172.21.15.27:0/1209032532 conn(0x7f22940fb500 msgr2=0x7f22940ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:50.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 shutdown_connections 2024-09-13T18:03:50.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:50.996+0000 7f229a000640 1 -- 172.21.15.27:0/1209032532 wait complete. 2024-09-13T18:03:51.013 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:03:51.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.171+0000 7fada7200640 1 -- 172.21.15.27:0/415362986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada80728c0 msgr2=0x7fada8072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.171+0000 7fada7200640 1 --2- 172.21.15.27:0/415362986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada80728c0 0x7fada8072cc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fad98009900 tx=0x7fad9802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.173 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.171+0000 7fada7200640 1 -- 172.21.15.27:0/415362986 shutdown_connections 2024-09-13T18:03:51.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.171+0000 7fada7200640 1 --2- 172.21.15.27:0/415362986 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fada8107f50 0x7fada810a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.171+0000 7fada7200640 1 --2- 172.21.15.27:0/415362986 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fada8073200 0x7fada8107a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.171+0000 7fada7200640 1 --2- 172.21.15.27:0/415362986 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada80728c0 0x7fada8072cc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.171+0000 7fada7200640 1 -- 172.21.15.27:0/415362986 >> 172.21.15.27:0/415362986 conn(0x7fada80fb310 msgr2=0x7fada80fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.171+0000 7fada7200640 1 -- 172.21.15.27:0/415362986 shutdown_connections 2024-09-13T18:03:51.174 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.171+0000 7fada7200640 1 -- 172.21.15.27:0/415362986 wait complete. 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fada7200640 1 Processor -- start 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fada7200640 1 -- start start 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fada7200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fada80728c0 0x7fada8197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fada7200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada8073200 0x7fada81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fada7200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fada8107f50 0x7fada819f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fada7200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada819faa0 con 0x7fada8073200 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fada7200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada819fc10 con 0x7fada80728c0 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fada7200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada819fdd0 con 0x7fada8107f50 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fad9fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada8073200 0x7fada81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.176 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fad9fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada8073200 0x7fada81984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60812/0 (socket says 172.21.15.27:60812) 2024-09-13T18:03:51.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fada5e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fada80728c0 0x7fada8197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.172+0000 7fad9fe00640 1 -- 172.21.15.27:0/2905997274 learned_addr learned my addr 172.21.15.27:0/2905997274 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fada6800640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fada8107f50 0x7fada819f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fad9fe00640 1 -- 172.21.15.27:0/2905997274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fada8107f50 msgr2=0x7fada819f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fad9fe00640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fada8107f50 0x7fada819f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.177 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fad9fe00640 1 -- 172.21.15.27:0/2905997274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fada80728c0 msgr2=0x7fada8197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fad9fe00640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fada80728c0 0x7fada8197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fad9fe00640 1 -- 172.21.15.27:0/2905997274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98009560 con 0x7fada8073200 2024-09-13T18:03:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fada6800640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fada8107f50 0x7fada819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fad9fe00640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada8073200 0x7fada81984f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fad9000d950 tx=0x7fad9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fad9ea00640 1 -- 172.21.15.27:0/2905997274 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90009c30 con 0x7fada8073200 2024-09-13T18:03:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada81a00b0 con 0x7fada8073200 2024-09-13T18:03:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fad9ea00640 1 -- 172.21.15.27:0/2905997274 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fad90009d90 con 0x7fada8073200 2024-09-13T18:03:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.173+0000 7fad9ea00640 1 -- 172.21.15.27:0/2905997274 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000f7e0 con 0x7fada8073200 2024-09-13T18:03:51.178 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.174+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada81a05c0 con 0x7fada8073200 2024-09-13T18:03:51.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.175+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada8072cc0 con 0x7fada8073200 2024-09-13T18:03:51.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.177+0000 7fad9ea00640 1 -- 172.21.15.27:0/2905997274 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fad90010ad0 con 0x7fada8073200 2024-09-13T18:03:51.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.179+0000 7fad9ea00640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fad8c0a1090 0x7fad8c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.179+0000 7fad9ea00640 1 -- 172.21.15.27:0/2905997274 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fad900cc550 con 0x7fada8073200 2024-09-13T18:03:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.179+0000 7fada5e00640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fad8c0a1090 0x7fad8c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.181 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.179+0000 7fada5e00640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fad8c0a1090 0x7fad8c0a3550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fad98005ab0 tx=0x7fad98005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.182+0000 7fad9ea00640 1 -- 172.21.15.27:0/2905997274 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fad90095cf0 con 0x7fada8073200 2024-09-13T18:03:51.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:51 smithi027 ceph-mon[30611]: pgmap v355: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:03:51.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:51 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3001884070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:51.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:51 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/960923516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:51.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:51 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1209032532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:51.368 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.366+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fada810d8f0 con 0x7fada8073200 2024-09-13T18:03:51.370 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.368+0000 7fad9ea00640 1 -- 172.21.15.27:0/2905997274 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7fad90099310 con 0x7fada8073200 2024-09-13T18:03:51.370 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:03:51.370 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":88,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:02:37.160677+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:03:51.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fad8c0a1090 msgr2=0x7fad8c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fad8c0a1090 0x7fad8c0a3550 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fad98005ab0 tx=0x7fad98005a20 comp rx=0 tx=0).stop 2024-09-13T18:03:51.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada8073200 msgr2=0x7fada81984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada8073200 0x7fada81984f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fad9000d950 tx=0x7fad9000de10 comp rx=0 tx=0).stop 2024-09-13T18:03:51.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 shutdown_connections 2024-09-13T18:03:51.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fad8c0a1090 0x7fad8c0a3550 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fada8107f50 0x7fada819f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fada8073200 0x7fada81984f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 --2- 172.21.15.27:0/2905997274 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fada80728c0 0x7fada8197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 >> 172.21.15.27:0/2905997274 conn(0x7fada80fb310 msgr2=0x7fada81039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 shutdown_connections 2024-09-13T18:03:51.373 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.370+0000 7fada7200640 1 -- 172.21.15.27:0/2905997274 wait complete. 2024-09-13T18:03:51.389 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-13T18:01:46.320502+0000', 'modified': '2024-09-13T18:01:53.056677+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24584, 'mds_1': 24556, 'mds_2': 24533, 'mds_3': 24529, 'mds_4': 24448}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14505': {'gid': 14505, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.27:6839/91312549', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6838', 'nonce': 91312549}, {'type': 'v1', 'addr': '172.21.15.27:6839', 'nonce': 91312549}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24448': {'gid': 24448, 'name': 'l', 'rank': 4, 'incarnation': 24, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.143:6833/2820864881', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6832', 'nonce': 2820864881}, {'type': 'v1', 'addr': '172.21.15.143:6833', 'nonce': 2820864881}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24455': {'gid': 24455, 'name': 'k', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6833/1100066007', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6832', 'nonce': 1100066007}, {'type': 'v1', 'addr': '172.21.15.122:6833', 'nonce': 1100066007}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24497': {'gid': 24497, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.122:6835/1011366471', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6834', 'nonce': 1011366471}, {'type': 'v1', 'addr': '172.21.15.122:6835', 'nonce': 1011366471}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24499': {'gid': 24499, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.143:6835/1530941636', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6834', 'nonce': 1530941636}, {'type': 'v1', 'addr': '172.21.15.143:6835', 'nonce': 1530941636}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24511': {'gid': 24511, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.143:6837/3738799013', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6836', 'nonce': 3738799013}, {'type': 'v1', 'addr': '172.21.15.143:6837', 'nonce': 3738799013}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24529': {'gid': 24529, 'name': 'i', 'rank': 3, 'incarnation': 22, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.143:6839/1150747117', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.143:6838', 'nonce': 1150747117}, {'type': 'v1', 'addr': '172.21.15.143:6839', 'nonce': 1150747117}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.122:6837/65111779', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6836', 'nonce': 65111779}, {'type': 'v1', 'addr': '172.21.15.122:6837', 'nonce': 65111779}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24556': {'gid': 24556, 'name': 'a', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.27:6841/3673158651', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.27:6840', 'nonce': 3673158651}, {'type': 'v1', 'addr': '172.21.15.27:6841', 'nonce': 3673158651}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24584': {'gid': 24584, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.122:6839/1102491877', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.122:6838', 'nonce': 1102491877}, {'type': 'v1', 'addr': '172.21.15.122:6839', 'nonce': 1102491877}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:03:51.389 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-13T18:03:51.390 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2024-09-13T18:03:51.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:51 smithi122 ceph-mon[35310]: pgmap v355: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:03:51.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:51 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3001884070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:51.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:51 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/960923516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:51.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:51 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1209032532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:51.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:51 smithi143 ceph-mon[38210]: pgmap v355: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:03:51.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:51 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3001884070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:03:51.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:51 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/960923516' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:03:51.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:51 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1209032532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:03:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.550+0000 7fa124a00640 1 -- 172.21.15.27:0/1923620417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120103180 msgr2=0x7fa120103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.550+0000 7fa124a00640 1 --2- 172.21.15.27:0/1923620417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120103180 0x7fa120103600 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa108009900 tx=0x7fa10802a410 comp rx=0 tx=0).stop 2024-09-13T18:03:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.550+0000 7fa124a00640 1 -- 172.21.15.27:0/1923620417 shutdown_connections 2024-09-13T18:03:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.550+0000 7fa124a00640 1 --2- 172.21.15.27:0/1923620417 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa120103b40 0x7fa12010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.550+0000 7fa124a00640 1 --2- 172.21.15.27:0/1923620417 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120103180 0x7fa120103600 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.552 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.550+0000 7fa124a00640 1 --2- 172.21.15.27:0/1923620417 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa120101f90 0x7fa120102390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.550+0000 7fa124a00640 1 -- 172.21.15.27:0/1923620417 >> 172.21.15.27:0/1923620417 conn(0x7fa1200fd6d0 msgr2=0x7fa1200ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.550+0000 7fa124a00640 1 -- 172.21.15.27:0/1923620417 shutdown_connections 2024-09-13T18:03:51.553 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.550+0000 7fa124a00640 1 -- 172.21.15.27:0/1923620417 wait complete. 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.551+0000 7fa124a00640 1 Processor -- start 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.551+0000 7fa124a00640 1 -- start start 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.551+0000 7fa124a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120101f90 0x7fa120198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.551+0000 7fa124a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa120103180 0x7fa120198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa124a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa120103b40 0x7fa12019f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa124a00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12019fb20 con 0x7fa120101f90 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa124a00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12019fc90 con 0x7fa120103b40 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa124a00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12019fe50 con 0x7fa120103180 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120101f90 0x7fa120198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11de00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120101f90 0x7fa120198030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60830/0 (socket says 172.21.15.27:60830) 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11de00640 1 -- 172.21.15.27:0/1506273393 learned_addr learned my addr 172.21.15.27:0/1506273393 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.555 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa115400640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa120103180 0x7fa120198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11e800640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa120103b40 0x7fa12019f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11de00640 1 -- 172.21.15.27:0/1506273393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa120103180 msgr2=0x7fa120198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11de00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa120103180 0x7fa120198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11de00640 1 -- 172.21.15.27:0/1506273393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa120103b40 msgr2=0x7fa12019f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11de00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa120103b40 0x7fa12019f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11de00640 1 -- 172.21.15.27:0/1506273393 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa110009490 con 0x7fa120101f90 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.552+0000 7fa11de00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120101f90 0x7fa120198030 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa11000e9c0 tx=0x7fa11000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.553+0000 7fa117400640 1 -- 172.21.15.27:0/1506273393 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11000cde0 con 0x7fa120101f90 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.553+0000 7fa117400640 1 -- 172.21.15.27:0/1506273393 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa110010910 con 0x7fa120101f90 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.553+0000 7fa117400640 1 -- 172.21.15.27:0/1506273393 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110018a10 con 0x7fa120101f90 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.553+0000 7fa124a00640 1 -- 172.21.15.27:0/1506273393 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa108009560 con 0x7fa120101f90 2024-09-13T18:03:51.556 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.553+0000 7fa124a00640 1 -- 172.21.15.27:0/1506273393 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1201a0430 con 0x7fa120101f90 2024-09-13T18:03:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa127830740 1 Processor -- start 2024-09-13T18:03:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa117400640 1 -- 172.21.15.27:0/1506273393 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa110010a80 con 0x7fa120101f90 2024-09-13T18:03:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa127830740 1 -- start start 2024-09-13T18:03:51.559 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa127830740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba661f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa127830740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba662470 0x555aba666f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa127830740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba667500 0x555aba6699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa127830740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba5cbab0 con 0x555aba661b30 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa127830740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba5c9240 con 0x555aba662470 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa127830740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba5c4b30 con 0x555aba667500 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.556+0000 7fa11e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba661f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba661f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60840/0 (socket says 172.21.15.27:60840) 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11e800640 1 -- 172.21.15.27:0/3136987962 learned_addr learned my addr 172.21.15.27:0/3136987962 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11de00640 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba662470 0x555aba666f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa115400640 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba667500 0x555aba6699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11e800640 1 -- 172.21.15.27:0/3136987962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba667500 msgr2=0x555aba6699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.560 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11e800640 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba667500 0x555aba6699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11e800640 1 -- 172.21.15.27:0/3136987962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba662470 msgr2=0x555aba666f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11e800640 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba662470 0x555aba666f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11e800640 1 -- 172.21.15.27:0/3136987962 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aba58fbd0 con 0x555aba661b30 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11de00640 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba662470 0x555aba666f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa115400640 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba667500 0x555aba6699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa11e800640 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba661f30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa118009fc0 tx=0x7fa118010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b82f4d03722361d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa117400640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1040a1110 0x7fa1040a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa10f400640 1 -- 172.21.15.27:0/3136987962 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118003b70 con 0x555aba661b30 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa10f400640 1 -- 172.21.15.27:0/3136987962 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa118015070 con 0x555aba661b30 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa10f400640 1 -- 172.21.15.27:0/3136987962 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118011900 con 0x555aba661b30 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.557+0000 7fa117400640 1 -- 172.21.15.27:0/1506273393 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa110014070 con 0x7fa120101f90 2024-09-13T18:03:51.561 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa11de00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1040a1110 0x7fa1040a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa127830740 1 -- 172.21.15.27:0/3136987962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 msgr2=0x555aba661f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa127830740 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba661f30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa118009fc0 tx=0x7fa118010860 comp rx=0 tx=0).stop 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa11de00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1040a1110 0x7fa1040a35d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa1100a2460 tx=0x7fa1100184b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa127830740 1 -- 172.21.15.27:0/3136987962 shutdown_connections 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa127830740 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba667500 0x555aba6699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa127830740 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba662470 0x555aba666f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa127830740 1 --2- 172.21.15.27:0/3136987962 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba661f30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa127830740 1 -- 172.21.15.27:0/3136987962 >> 172.21.15.27:0/3136987962 conn(0x555aba65d1a0 msgr2=0x555aba65d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.558+0000 7fa127830740 1 -- 172.21.15.27:0/3136987962 shutdown_connections 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.559+0000 7fa127830740 1 -- 172.21.15.27:0/3136987962 wait complete. 2024-09-13T18:03:51.565 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.559+0000 7fa127830740 1 -- start start 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.559+0000 7fa127830740 1 Processor -- start 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.559+0000 7fa127830740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 0x555aba66b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.559+0000 7fa127830740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.559+0000 7fa127830740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba667500 0x555aba672c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.559+0000 7fa127830740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba566260 con 0x555aba667500 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.559+0000 7fa127830740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba565f00 con 0x555aba661b30 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa127830740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba32bf20 con 0x555aba662470 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa127830740 10 client.0 _ll_register_callbacks cb 0x555aba5be1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa11e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba667500 0x555aba672c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa11e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba667500 0x555aba672c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60846/0 (socket says 172.21.15.27:60846) 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa11e800640 1 -- 172.21.15.27:0/3394313125 learned_addr learned my addr 172.21.15.27:0/3394313125 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa115400640 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.566 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa11e800640 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 0x555aba66b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa11e800640 1 -- 172.21.15.27:0/3394313125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 msgr2=0x555aba66bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa11e800640 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa11e800640 1 -- 172.21.15.27:0/3394313125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 msgr2=0x555aba66b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa11e800640 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 0x555aba66b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.560+0000 7fa11e800640 1 -- 172.21.15.27:0/3394313125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa118009c70 con 0x555aba667500 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.561+0000 7fa11e800640 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba667500 0x555aba672c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa118009f90 tx=0x7fa118013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9171638c10b9cb33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.561+0000 7fa103e00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.561+0000 7fa103e00640 1 -- 172.21.15.27:0/3394313125 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1180046e0 con 0x555aba667500 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.561+0000 7fa103e00640 1 -- 172.21.15.27:0/3394313125 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa118017070 con 0x555aba667500 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.561+0000 7fa127830740 1 -- 172.21.15.27:0/3394313125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555aba5eecd0 con 0x555aba667500 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.561+0000 7fa103e00640 1 -- 172.21.15.27:0/3394313125 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa118004a40 con 0x555aba667500 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.561+0000 7fa127830740 10 client.15135 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:51.567 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.561+0000 7fa127830740 1 -- 172.21.15.27:0/3394313125 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555aba5c31b0 con 0x555aba667500 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.561+0000 7fa103e00640 1 -- 172.21.15.27:0/3394313125 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555aba5eecd0 con 0x555aba667500 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.562+0000 7fa103e00640 1 -- 172.21.15.27:0/3394313125 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa118005040 con 0x555aba667500 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.562+0000 7fa127830740 10 client.15135 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.562+0000 7fa127830740 10 client.15135 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.562+0000 7fa127830740 20 client.15135 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.562+0000 7fa127830740 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x555aba677b10 0x555aba67bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.562+0000 7fa127830740 4 client.15135 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.562+0000 7fa127830740 1 -- 172.21.15.27:0/3394313125 --> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555aba2b83c0 con 0x555aba677b10 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.562+0000 7fa115400640 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x555aba677b10 0x555aba67bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.563+0000 7fa115400640 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x555aba677b10 0x555aba67bc70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3d7b504fdfc280a server_cookie=9ebbf50d10bd2cc5 in_seq=0 out_seq=0 2024-09-13T18:03:51.568 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.563+0000 7fa103e00640 10 client.15135 ms_handle_connect on v2:172.21.15.143:6832/2820864881 2024-09-13T18:03:51.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.563+0000 7fa103e00640 1 -- 172.21.15.27:0/3394313125 <== mds.4 v2:172.21.15.143:6832/2820864881 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555aba2b83c0 con 0x555aba677b10 2024-09-13T18:03:51.569 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.563+0000 7fa103e00640 10 client.15135 handle_command_reply: tid=0 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 client.15135 shutdown 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 -- 172.21.15.27:0/3394313125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba667500 msgr2=0x555aba672c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba667500 0x555aba672c80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa118009f90 tx=0x7fa118013040 comp rx=0 tx=0).stop 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 -- 172.21.15.27:0/3394313125 shutdown_connections 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x555aba677b10 0x555aba67bc70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba667500 0x555aba672c80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 --2- 172.21.15.27:0/3394313125 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 0x555aba66b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa103e00640 0 client.15135 ms_handle_reset on v2:172.21.15.143:6832/2820864881 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 -- 172.21.15.27:0/3394313125 >> 172.21.15.27:0/3394313125 conn(0x555aba65d1a0 msgr2=0x555aba65e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 -- 172.21.15.27:0/3394313125 shutdown_connections 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 1 -- 172.21.15.27:0/3394313125 wait complete. 2024-09-13T18:03:51.570 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.564+0000 7fa127830740 20 client.15135 trim_cache size 0 max 16384 2024-09-13T18:03:51.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.579+0000 7fa127830740 1 Processor -- start 2024-09-13T18:03:51.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa127830740 1 -- start start 2024-09-13T18:03:51.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa127830740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba65d1a0 0x555aba66b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa127830740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba672ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.582 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa127830740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa127830740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba662d30 con 0x555aba661b30 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa127830740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba5bd8d0 con 0x555aba65d1a0 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa127830740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba5602f0 con 0x555aba662470 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa115400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba672ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa115400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba672ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60862/0 (socket says 172.21.15.27:60862) 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa115400640 1 -- 172.21.15.27:0/4059607108 learned_addr learned my addr 172.21.15.27:0/4059607108 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa11e800640 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba65d1a0 0x555aba66b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa11e800640 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa115400640 1 -- 172.21.15.27:0/4059607108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 msgr2=0x555aba66b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa115400640 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa115400640 1 -- 172.21.15.27:0/4059607108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba65d1a0 msgr2=0x555aba66b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa115400640 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba65d1a0 0x555aba66b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.583 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa115400640 1 -- 172.21.15.27:0/4059607108 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555aba565470 con 0x555aba661b30 2024-09-13T18:03:51.584 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.580+0000 7fa11e800640 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:51.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.581+0000 7fa115400640 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba672ba0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa108009850 tx=0x7fa1080058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a47f9276d52364 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.581+0000 7fa10fe00640 1 -- 172.21.15.27:0/4059607108 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108032bf0 con 0x555aba661b30 2024-09-13T18:03:51.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.581+0000 7fa10fe00640 1 -- 172.21.15.27:0/4059607108 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa108032d50 con 0x555aba661b30 2024-09-13T18:03:51.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.581+0000 7fa10fe00640 1 -- 172.21.15.27:0/4059607108 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa108005040 con 0x555aba661b30 2024-09-13T18:03:51.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.581+0000 7fa127830740 1 -- 172.21.15.27:0/4059607108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 msgr2=0x555aba672ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba672ba0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa108009850 tx=0x7fa1080058b0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 -- 172.21.15.27:0/4059607108 shutdown_connections 2024-09-13T18:03:51.587 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba661b30 0x555aba672ba0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 --2- 172.21.15.27:0/4059607108 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba65d1a0 0x555aba66b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 -- 172.21.15.27:0/4059607108 >> 172.21.15.27:0/4059607108 conn(0x555aba669c60 msgr2=0x555aba6668a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 -- 172.21.15.27:0/4059607108 shutdown_connections 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 -- 172.21.15.27:0/4059607108 wait complete. 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 -- start start 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.582+0000 7fa127830740 1 Processor -- start 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa127830740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba65d1a0 0x555aba672a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa127830740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 0x555aba66f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa127830740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa127830740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba66ffa0 con 0x555aba65d1a0 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa127830740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba670110 con 0x555aba661b30 2024-09-13T18:03:51.588 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa127830740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x555aba6cd930 con 0x555aba662470 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa127830740 10 client.0 _ll_register_callbacks cb 0x7fa118009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa11e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba65d1a0 0x555aba672a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa11e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba65d1a0 0x555aba672a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60868/0 (socket says 172.21.15.27:60868) 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa11e800640 1 -- 172.21.15.27:0/1724785348 learned_addr learned my addr 172.21.15.27:0/1724785348 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa115400640 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 0x555aba66f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa11e800640 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa11e800640 1 -- 172.21.15.27:0/1724785348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 msgr2=0x555aba66fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa11e800640 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa11e800640 1 -- 172.21.15.27:0/1724785348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 msgr2=0x555aba66f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa11e800640 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 0x555aba66f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.583+0000 7fa11e800640 1 -- 172.21.15.27:0/1724785348 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12010acd0 con 0x555aba65d1a0 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.584+0000 7fa11e800640 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba65d1a0 0x555aba672a30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa118009c40 tx=0x7fa11801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf768e2a6344e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.584+0000 7fa103e00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:51.589 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.584+0000 7fa103e00640 1 -- 172.21.15.27:0/1724785348 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa118003d20 con 0x555aba65d1a0 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.584+0000 7fa103e00640 1 -- 172.21.15.27:0/1724785348 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa118017040 con 0x555aba65d1a0 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.584+0000 7fa127830740 1 -- 172.21.15.27:0/1724785348 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa118015070 con 0x555aba65d1a0 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.584+0000 7fa103e00640 1 -- 172.21.15.27:0/1724785348 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa118003e80 con 0x555aba65d1a0 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.584+0000 7fa127830740 10 client.15141 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.584+0000 7fa127830740 1 -- 172.21.15.27:0/1724785348 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555aba58a980 con 0x555aba65d1a0 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.584+0000 7fa103e00640 1 -- 172.21.15.27:0/1724785348 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa118015070 con 0x555aba65d1a0 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.585+0000 7fa103e00640 1 -- 172.21.15.27:0/1724785348 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa11802ba90 con 0x555aba65d1a0 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.585+0000 7fa127830740 10 client.15141 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.585+0000 7fa127830740 10 client.15141 resolve_mds: resolved name 'l' to daemon mds.l 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.585+0000 7fa127830740 20 client.15141 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.585+0000 7fa127830740 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x555aba667500 0x555aba6cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.585+0000 7fa127830740 4 client.15141 mds_command: new command op to 24448 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.585+0000 7fa127830740 1 -- 172.21.15.27:0/1724785348 --> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555aba2c96c0 con 0x555aba667500 2024-09-13T18:03:51.590 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.585+0000 7fa115400640 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x555aba667500 0x555aba6cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa115400640 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x555aba667500 0x555aba6cebf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=60bd859af22859a2 server_cookie=1d11e6479003c849 in_seq=0 out_seq=0 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa103e00640 10 client.15141 ms_handle_connect on v2:172.21.15.143:6832/2820864881 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa103e00640 1 -- 172.21.15.27:0/1724785348 <== mds.4 v2:172.21.15.143:6832/2820864881 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x555aba2c96c0 con 0x555aba667500 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa103e00640 10 client.15141 handle_command_reply: tid=0 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 client.15141 shutdown 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 -- 172.21.15.27:0/1724785348 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba65d1a0 msgr2=0x555aba672a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba65d1a0 0x555aba672a30 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa118009c40 tx=0x7fa11801d040 comp rx=0 tx=0).stop 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 -- 172.21.15.27:0/1724785348 shutdown_connections 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.143:6832/2820864881,v1:172.21.15.143:6833/2820864881] conn(0x555aba667500 0x555aba6cebf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555aba662470 0x555aba66fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555aba661b30 0x555aba66f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 --2- 172.21.15.27:0/1724785348 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555aba65d1a0 0x555aba672a30 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.592 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa103e00640 0 client.15141 ms_handle_reset on v2:172.21.15.143:6832/2820864881 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 -- 172.21.15.27:0/1724785348 >> 172.21.15.27:0/1724785348 conn(0x555aba669c60 msgr2=0x555aba67fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 -- 172.21.15.27:0/1724785348 shutdown_connections 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.586+0000 7fa127830740 1 -- 172.21.15.27:0/1724785348 wait complete. 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa127830740 20 client.15141 trim_cache size 0 max 16384 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 4, 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24448, 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:51.593 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:51.594 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:51.594 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 119.533382751, 2024-09-13T18:03:51.594 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:51.594 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:51.594 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:51.594 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 162.578459041 2024-09-13T18:03:51.594 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 -- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1040a1110 msgr2=0x7fa1040a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1040a1110 0x7fa1040a35d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa1100a2460 tx=0x7fa1100184b0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 -- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120101f90 msgr2=0x7fa120198030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120101f90 0x7fa120198030 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa11000e9c0 tx=0x7fa11000ee80 comp rx=0 tx=0).stop 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 -- 172.21.15.27:0/1506273393 shutdown_connections 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa1040a1110 0x7fa1040a35d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa120103b40 0x7fa12019f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa120103180 0x7fa120198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 --2- 172.21.15.27:0/1506273393 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa120101f90 0x7fa120198030 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 -- 172.21.15.27:0/1506273393 >> 172.21.15.27:0/1506273393 conn(0x7fa1200fd6d0 msgr2=0x7fa120106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 -- 172.21.15.27:0/1506273393 shutdown_connections 2024-09-13T18:03:51.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.587+0000 7fa124a00640 1 -- 172.21.15.27:0/1506273393 wait complete. 2024-09-13T18:03:51.605 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-09-13T18:03:51.766 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.764+0000 7efe9be00640 1 -- 172.21.15.27:0/2678179343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe94100f60 msgr2=0x7efe941013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.764+0000 7efe9be00640 1 --2- 172.21.15.27:0/2678179343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe94100f60 0x7efe941013e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efe80009900 tx=0x7efe8002a410 comp rx=0 tx=0).stop 2024-09-13T18:03:51.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.764+0000 7efe9be00640 1 -- 172.21.15.27:0/2678179343 shutdown_connections 2024-09-13T18:03:51.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.764+0000 7efe9be00640 1 --2- 172.21.15.27:0/2678179343 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe94101920 0x7efe941081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.764+0000 7efe9be00640 1 --2- 172.21.15.27:0/2678179343 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe94100f60 0x7efe941013e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.764+0000 7efe9be00640 1 --2- 172.21.15.27:0/2678179343 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe940ffd70 0x7efe94100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.764+0000 7efe9be00640 1 -- 172.21.15.27:0/2678179343 >> 172.21.15.27:0/2678179343 conn(0x7efe940fb4d0 msgr2=0x7efe940fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.764+0000 7efe9be00640 1 -- 172.21.15.27:0/2678179343 shutdown_connections 2024-09-13T18:03:51.767 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.764+0000 7efe9be00640 1 -- 172.21.15.27:0/2678179343 wait complete. 2024-09-13T18:03:51.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.765+0000 7efe9be00640 1 Processor -- start 2024-09-13T18:03:51.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.765+0000 7efe9be00640 1 -- start start 2024-09-13T18:03:51.769 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe9be00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe940ffd70 0x7efe94195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe9be00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe94100f60 0x7efe94196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe9be00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe94101920 0x7efe9419d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe9be00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9419d910 con 0x7efe94101920 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe9be00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9419da80 con 0x7efe94100f60 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe9be00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9419dc40 con 0x7efe940ffd70 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe98a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe94100f60 0x7efe94196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe99e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe94101920 0x7efe9419d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe98a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe94100f60 0x7efe94196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:50422/0 (socket says 172.21.15.27:50422) 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe98a00640 1 -- 172.21.15.27:0/2259021510 learned_addr learned my addr 172.21.15.27:0/2259021510 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.766+0000 7efe99400640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe940ffd70 0x7efe94195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe98a00640 1 -- 172.21.15.27:0/2259021510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe940ffd70 msgr2=0x7efe94195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe98a00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe940ffd70 0x7efe94195e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.770 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe98a00640 1 -- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe94101920 msgr2=0x7efe9419d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe98a00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe94101920 0x7efe9419d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe98a00640 1 -- 172.21.15.27:0/2259021510 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe80009560 con 0x7efe94100f60 2024-09-13T18:03:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe99e00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe94101920 0x7efe9419d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe98a00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe94100f60 0x7efe94196360 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe80031510 tx=0x7efe80004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe92000640 1 -- 172.21.15.27:0/2259021510 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80005210 con 0x7efe94100f60 2024-09-13T18:03:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe9be00640 1 -- 172.21.15.27:0/2259021510 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9419dec0 con 0x7efe94100f60 2024-09-13T18:03:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe92000640 1 -- 172.21.15.27:0/2259021510 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efe80004ba0 con 0x7efe94100f60 2024-09-13T18:03:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.767+0000 7efe92000640 1 -- 172.21.15.27:0/2259021510 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe80003b20 con 0x7efe94100f60 2024-09-13T18:03:51.771 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.768+0000 7efe9be00640 1 -- 172.21.15.27:0/2259021510 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9419e2e0 con 0x7efe94100f60 2024-09-13T18:03:51.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.770+0000 7efe9ebcc740 1 Processor -- start 2024-09-13T18:03:51.772 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.770+0000 7efe9ebcc740 1 -- start start 2024-09-13T18:03:51.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e703340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.773 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 0x55f15e708340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e708910 0x55f15e70add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e668ab0 con 0x55f15e702f40 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e666240 con 0x55f15e703880 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e661b30 con 0x55f15e708910 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe92000640 1 -- 172.21.15.27:0/2259021510 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7efe80004d10 con 0x7efe94100f60 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe99e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e703340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe99e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e703340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60892/0 (socket says 172.21.15.27:60892) 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe99e00640 1 -- 172.21.15.27:0/110789077 learned_addr learned my addr 172.21.15.27:0/110789077 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe99400640 1 --2- 172.21.15.27:0/110789077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 0x55f15e708340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe98a00640 1 --2- 172.21.15.27:0/110789077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e708910 0x55f15e70add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe99e00640 1 -- 172.21.15.27:0/110789077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e708910 msgr2=0x55f15e70add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.774 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe99e00640 1 --2- 172.21.15.27:0/110789077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e708910 0x55f15e70add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe99e00640 1 -- 172.21.15.27:0/110789077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 msgr2=0x55f15e708340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe99e00640 1 --2- 172.21.15.27:0/110789077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 0x55f15e708340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.771+0000 7efe99e00640 1 -- 172.21.15.27:0/110789077 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f15e62cbd0 con 0x55f15e702f40 2024-09-13T18:03:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.772+0000 7efe99e00640 1 --2- 172.21.15.27:0/110789077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e703340 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0107e0 tx=0x7efe8c010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6a01dfa19bf090 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.772+0000 7efe86a00640 1 -- 172.21.15.27:0/110789077 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c003b70 con 0x55f15e702f40 2024-09-13T18:03:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.772+0000 7efe86a00640 1 -- 172.21.15.27:0/110789077 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efe8c015070 con 0x55f15e702f40 2024-09-13T18:03:51.775 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.772+0000 7efe86a00640 1 -- 172.21.15.27:0/110789077 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c004690 con 0x55f15e702f40 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.772+0000 7efe9ebcc740 1 -- 172.21.15.27:0/110789077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 msgr2=0x55f15e703340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.772+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/110789077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e703340 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0107e0 tx=0x7efe8c010ca0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.772+0000 7efe92000640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efe7c0a1090 0x7efe7c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe9ebcc740 1 -- 172.21.15.27:0/110789077 shutdown_connections 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/110789077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e708910 0x55f15e70add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/110789077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 0x55f15e708340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/110789077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e703340 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe92000640 1 -- 172.21.15.27:0/2259021510 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efe800ed590 con 0x7efe94100f60 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe9ebcc740 1 -- 172.21.15.27:0/110789077 >> 172.21.15.27:0/110789077 conn(0x55f15e6fa1a0 msgr2=0x55f15e6fa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe99e00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efe7c0a1090 0x7efe7c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.779 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe9ebcc740 1 -- 172.21.15.27:0/110789077 shutdown_connections 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe9ebcc740 1 -- 172.21.15.27:0/110789077 wait complete. 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe9ebcc740 1 -- start start 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe99e00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efe7c0a1090 0x7efe7c0a3550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efe8c005fd0 tx=0x7efe8c009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.773+0000 7efe9ebcc740 1 Processor -- start 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e70cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 0x55f15e70d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e708910 0x55f15e714090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e603260 con 0x55f15e702f40 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e602f00 con 0x55f15e708910 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e3c8f20 con 0x55f15e703880 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe9ebcc740 10 client.0 _ll_register_callbacks cb 0x55f15e65b1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe99400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e70cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.780 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe99400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e70cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60906/0 (socket says 172.21.15.27:60906) 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe99400640 1 -- 172.21.15.27:0/2051833394 learned_addr learned my addr 172.21.15.27:0/2051833394 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe98a00640 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 0x55f15e70d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.774+0000 7efe99e00640 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e708910 0x55f15e714090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe99400640 1 -- 172.21.15.27:0/2051833394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 msgr2=0x55f15e70d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe99400640 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 0x55f15e70d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe99400640 1 -- 172.21.15.27:0/2051833394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e708910 msgr2=0x55f15e714090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe99400640 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e708910 0x55f15e714090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe99400640 1 -- 172.21.15.27:0/2051833394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c010410 con 0x55f15e702f40 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe99e00640 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e708910 0x55f15e714090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe99400640 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e70cb10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efe88012700 tx=0x7efe88012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277e5e9114ef489 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe7b400640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe7b400640 1 -- 172.21.15.27:0/2051833394 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88017070 con 0x55f15e702f40 2024-09-13T18:03:51.781 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe7b400640 1 -- 172.21.15.27:0/2051833394 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efe88004050 con 0x55f15e702f40 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2051833394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f15e68bcd0 con 0x55f15e702f40 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe7b400640 1 -- 172.21.15.27:0/2051833394 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe88022030 con 0x55f15e702f40 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe9ebcc740 10 client.15153 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.775+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2051833394 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f15e6601b0 con 0x55f15e702f40 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.776+0000 7efe7b400640 1 -- 172.21.15.27:0/2051833394 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55f15e68bcd0 con 0x55f15e702f40 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.776+0000 7efe7b400640 1 -- 172.21.15.27:0/2051833394 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efe880038e0 con 0x55f15e702f40 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.776+0000 7efe9ebcc740 10 client.15153 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.776+0000 7efe9ebcc740 10 client.15153 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.776+0000 7efe9ebcc740 20 client.15153 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.776+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55f15e718b60 0x55f15e71d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.776+0000 7efe9ebcc740 4 client.15153 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.776+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2051833394 --> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f15e3553c0 con 0x55f15e718b60 2024-09-13T18:03:51.782 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.776+0000 7efe98a00640 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55f15e718b60 0x55f15e71d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.777+0000 7efe98a00640 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55f15e718b60 0x55f15e71d2d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3c002fdb708be8cb server_cookie=3fe57f35686feace in_seq=0 out_seq=0 2024-09-13T18:03:51.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.777+0000 7efe7b400640 10 client.15153 ms_handle_connect on v2:172.21.15.143:6838/1150747117 2024-09-13T18:03:51.783 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.777+0000 7efe7b400640 1 -- 172.21.15.27:0/2051833394 <== mds.3 v2:172.21.15.143:6838/1150747117 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55f15e3553c0 con 0x55f15e718b60 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.777+0000 7efe7b400640 10 client.15153 handle_command_reply: tid=0 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 client.15153 shutdown 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2051833394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 msgr2=0x55f15e70cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e70cb10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efe88012700 tx=0x7efe88012bc0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2051833394 shutdown_connections 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e708910 0x55f15e714090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55f15e718b60 0x55f15e71d2d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 0x55f15e70d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2051833394 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e70cb10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe7b400640 0 client.15153 ms_handle_reset on v2:172.21.15.143:6838/1150747117 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2051833394 >> 172.21.15.27:0/2051833394 conn(0x55f15e6fa1a0 msgr2=0x55f15e6fb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.784 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2051833394 shutdown_connections 2024-09-13T18:03:51.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2051833394 wait complete. 2024-09-13T18:03:51.785 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.778+0000 7efe9ebcc740 20 client.15153 trim_cache size 0 max 16384 2024-09-13T18:03:51.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.793+0000 7efe9ebcc740 1 Processor -- start 2024-09-13T18:03:51.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe9ebcc740 1 -- start start 2024-09-13T18:03:51.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e6fa1a0 0x55f15e707cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.796 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 0x55f15e713fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e68bd00 con 0x55f15e702f40 2024-09-13T18:03:51.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e65a900 con 0x55f15e703880 2024-09-13T18:03:51.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e5fd2f0 con 0x55f15e6fa1a0 2024-09-13T18:03:51.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe98a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe99400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e6fa1a0 0x55f15e707cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe98a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7081f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60918/0 (socket says 172.21.15.27:60918) 2024-09-13T18:03:51.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe98a00640 1 -- 172.21.15.27:0/2905788551 learned_addr learned my addr 172.21.15.27:0/2905788551 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.797 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe99e00640 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 0x55f15e713fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe99400640 1 -- 172.21.15.27:0/2905788551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 msgr2=0x55f15e713fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe99400640 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 0x55f15e713fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe99400640 1 -- 172.21.15.27:0/2905788551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 msgr2=0x55f15e7081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe99400640 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7081f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.794+0000 7efe99400640 1 -- 172.21.15.27:0/2905788551 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f15e602470 con 0x55f15e6fa1a0 2024-09-13T18:03:51.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.795+0000 7efe99e00640 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 0x55f15e713fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:51.798 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.795+0000 7efe98a00640 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:51.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.795+0000 7efe99400640 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e6fa1a0 0x55f15e707cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe88012420 tx=0x7efe88009660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4697cc56157261de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.795+0000 7efe87400640 1 -- 172.21.15.27:0/2905788551 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88017040 con 0x55f15e6fa1a0 2024-09-13T18:03:51.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.795+0000 7efe87400640 1 -- 172.21.15.27:0/2905788551 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efe8800f920 con 0x55f15e6fa1a0 2024-09-13T18:03:51.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.795+0000 7efe87400640 1 -- 172.21.15.27:0/2905788551 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe88022040 con 0x55f15e6fa1a0 2024-09-13T18:03:51.802 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2905788551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e6fa1a0 msgr2=0x55f15e707cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e6fa1a0 0x55f15e707cb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe88012420 tx=0x7efe88009660 comp rx=0 tx=0).stop 2024-09-13T18:03:51.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2905788551 shutdown_connections 2024-09-13T18:03:51.803 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e703880 0x55f15e713fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/2905788551 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e6fa1a0 0x55f15e707cb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2905788551 >> 172.21.15.27:0/2905788551 conn(0x55f15e70b070 msgr2=0x55f15e704700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2905788551 shutdown_connections 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 -- 172.21.15.27:0/2905788551 wait complete. 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 -- start start 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.796+0000 7efe9ebcc740 1 Processor -- start 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e6fa1a0 0x55f15e710e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7113d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe9ebcc740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 0x55f15e76ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.804 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e714300 con 0x55f15e702f40 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e714470 con 0x55f15e6fa1a0 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe9ebcc740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15e76f4d0 con 0x55f15e703880 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe9ebcc740 10 client.0 _ll_register_callbacks cb 0x7efe88009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe98a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe98a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7113d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60928/0 (socket says 172.21.15.27:60928) 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe98a00640 1 -- 172.21.15.27:0/476480402 learned_addr learned my addr 172.21.15.27:0/476480402 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe99e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 0x55f15e76ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe99400640 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e6fa1a0 0x55f15e710e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe98a00640 1 -- 172.21.15.27:0/476480402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 msgr2=0x55f15e76ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe98a00640 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 0x55f15e76ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe98a00640 1 -- 172.21.15.27:0/476480402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e6fa1a0 msgr2=0x55f15e710e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe98a00640 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e6fa1a0 0x55f15e710e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.797+0000 7efe98a00640 1 -- 172.21.15.27:0/476480402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9419e2e0 con 0x55f15e702f40 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe98a00640 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7113d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efe800b6f40 tx=0x7efe800035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fd00c7288bcb8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe7b400640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe7b400640 1 -- 172.21.15.27:0/476480402 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe800be7c0 con 0x55f15e702f40 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe7b400640 1 -- 172.21.15.27:0/476480402 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efe800c2e10 con 0x55f15e702f40 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe9ebcc740 1 -- 172.21.15.27:0/476480402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe8c015070 con 0x55f15e702f40 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe7b400640 1 -- 172.21.15.27:0/476480402 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe800d3020 con 0x55f15e702f40 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe9ebcc740 10 client.15159 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe9ebcc740 1 -- 172.21.15.27:0/476480402 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f15e6601b0 con 0x55f15e702f40 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe7b400640 1 -- 172.21.15.27:0/476480402 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efe8c015070 con 0x55f15e702f40 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe7b400640 1 -- 172.21.15.27:0/476480402 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efe80005370 con 0x55f15e702f40 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe9ebcc740 10 client.15159 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe9ebcc740 10 client.15159 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-13T18:03:51.806 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe9ebcc740 20 client.15159 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.798+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55f15e708910 0x55f15e770940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.799+0000 7efe9ebcc740 4 client.15159 mds_command: new command op to 24529 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.799+0000 7efe9ebcc740 1 -- 172.21.15.27:0/476480402 --> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f15e3666c0 con 0x55f15e708910 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.799+0000 7efe99400640 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55f15e708910 0x55f15e770940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.799+0000 7efe99400640 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55f15e708910 0x55f15e770940 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6d356b4be75aa03c server_cookie=eb3ec2f91ded8a6a in_seq=0 out_seq=0 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.799+0000 7efe7b400640 10 client.15159 ms_handle_connect on v2:172.21.15.143:6838/1150747117 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe7b400640 1 -- 172.21.15.27:0/476480402 <== mds.3 v2:172.21.15.143:6838/1150747117 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x55f15e3666c0 con 0x55f15e708910 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe7b400640 10 client.15159 handle_command_reply: tid=0 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 client.15159 shutdown 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 -- 172.21.15.27:0/476480402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 msgr2=0x55f15e7113d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7113d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efe800b6f40 tx=0x7efe800035f0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 -- 172.21.15.27:0/476480402 shutdown_connections 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.143:6838/1150747117,v1:172.21.15.143:6839/1150747117] conn(0x55f15e708910 0x55f15e770940 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.807 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55f15e703880 0x55f15e76ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55f15e702f40 0x55f15e7113d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe7b400640 0 client.15159 ms_handle_reset on v2:172.21.15.143:6838/1150747117 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 --2- 172.21.15.27:0/476480402 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55f15e6fa1a0 0x55f15e710e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 -- 172.21.15.27:0/476480402 >> 172.21.15.27:0/476480402 conn(0x55f15e70b070 msgr2=0x55f15e70c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 -- 172.21.15.27:0/476480402 shutdown_connections 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 1 -- 172.21.15.27:0/476480402 wait complete. 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.800+0000 7efe9ebcc740 20 client.15159 trim_cache size 0 max 16384 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:51.808 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 3, 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24529, 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 120.43326249, 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 141.134177585 2024-09-13T18:03:51.809 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:51.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 -- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efe7c0a1090 msgr2=0x7efe7c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efe7c0a1090 0x7efe7c0a3550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efe8c005fd0 tx=0x7efe8c009920 comp rx=0 tx=0).stop 2024-09-13T18:03:51.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 -- 172.21.15.27:0/2259021510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe94100f60 msgr2=0x7efe94196360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe94100f60 0x7efe94196360 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe80031510 tx=0x7efe80004360 comp rx=0 tx=0).stop 2024-09-13T18:03:51.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 -- 172.21.15.27:0/2259021510 shutdown_connections 2024-09-13T18:03:51.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7efe7c0a1090 0x7efe7c0a3550 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7efe94101920 0x7efe9419d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.810 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7efe94100f60 0x7efe94196360 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 --2- 172.21.15.27:0/2259021510 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7efe940ffd70 0x7efe94195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 -- 172.21.15.27:0/2259021510 >> 172.21.15.27:0/2259021510 conn(0x7efe940fb4d0 msgr2=0x7efe941043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 -- 172.21.15.27:0/2259021510 shutdown_connections 2024-09-13T18:03:51.811 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.801+0000 7efe9be00640 1 -- 172.21.15.27:0/2259021510 wait complete. 2024-09-13T18:03:51.817 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-09-13T18:03:51.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.978+0000 7fb8c4400640 1 -- 172.21.15.27:0/394029382 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 msgr2=0x7fb8bc073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.978+0000 7fb8c4400640 1 --2- 172.21.15.27:0/394029382 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 0x7fb8bc073370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009860 tx=0x7fb8a802a340 comp rx=0 tx=0).stop 2024-09-13T18:03:51.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.978+0000 7fb8c4400640 1 -- 172.21.15.27:0/394029382 shutdown_connections 2024-09-13T18:03:51.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.978+0000 7fb8c4400640 1 --2- 172.21.15.27:0/394029382 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8bc107bd0 0x7fb8bc10a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.978+0000 7fb8c4400640 1 --2- 172.21.15.27:0/394029382 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 0x7fb8bc073370 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.978+0000 7fb8c4400640 1 --2- 172.21.15.27:0/394029382 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8bc0744f0 0x7fb8bc072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.978+0000 7fb8c4400640 1 -- 172.21.15.27:0/394029382 >> 172.21.15.27:0/394029382 conn(0x7fb8bc0fb4c0 msgr2=0x7fb8bc0fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.980 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.978+0000 7fb8c4400640 1 -- 172.21.15.27:0/394029382 shutdown_connections 2024-09-13T18:03:51.981 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.978+0000 7fb8c4400640 1 -- 172.21.15.27:0/394029382 wait complete. 2024-09-13T18:03:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c4400640 1 Processor -- start 2024-09-13T18:03:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c4400640 1 -- start start 2024-09-13T18:03:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c4400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 0x7fb8bc198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c4400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8bc0744f0 0x7fb8bc1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c4400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8bc107bd0 0x7fb8bc19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c4400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc19fb80 con 0x7fb8bc107bd0 2024-09-13T18:03:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c4400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc19fcf0 con 0x7fb8bc0744f0 2024-09-13T18:03:51.983 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c4400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc19feb0 con 0x7fb8bc072f10 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c2400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8bc107bd0 0x7fb8bc19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.979+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 0x7fb8bc198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 0x7fb8bc198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:40718/0 (socket says 172.21.15.27:40718) 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c1a00640 1 -- 172.21.15.27:0/826382856 learned_addr learned my addr 172.21.15.27:0/826382856 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c1000640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8bc0744f0 0x7fb8bc1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c2400640 1 -- 172.21.15.27:0/826382856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 msgr2=0x7fb8bc198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c2400640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 0x7fb8bc198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c2400640 1 -- 172.21.15.27:0/826382856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8bc0744f0 msgr2=0x7fb8bc1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c2400640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8bc0744f0 0x7fb8bc1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c2400640 1 -- 172.21.15.27:0/826382856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4009900 con 0x7fb8bc107bd0 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 0x7fb8bc198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8c2400640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8bc107bd0 0x7fb8bc19f640 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400efc0 tx=0x7fb8b400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.984 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8ba000640 1 -- 172.21.15.27:0/826382856 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4003970 con 0x7fb8bc107bd0 2024-09-13T18:03:51.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.980+0000 7fb8ba000640 1 -- 172.21.15.27:0/826382856 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb8b4004020 con 0x7fb8bc107bd0 2024-09-13T18:03:51.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.981+0000 7fb8c4400640 1 -- 172.21.15.27:0/826382856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a8009490 con 0x7fb8bc107bd0 2024-09-13T18:03:51.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.981+0000 7fb8ba000640 1 -- 172.21.15.27:0/826382856 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b400b960 con 0x7fb8bc107bd0 2024-09-13T18:03:51.985 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.981+0000 7fb8c4400640 1 -- 172.21.15.27:0/826382856 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc1a0490 con 0x7fb8bc107bd0 2024-09-13T18:03:51.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.984+0000 7fb8ba000640 1 -- 172.21.15.27:0/826382856 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb8b400a040 con 0x7fb8bc107bd0 2024-09-13T18:03:51.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.984+0000 7fb8c7221740 1 Processor -- start 2024-09-13T18:03:51.986 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.984+0000 7fb8c7221740 1 -- start start 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.984+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.984+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.984+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 0x55d60d1a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.984+0000 7fb8c7221740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d108ab0 con 0x55d60d19eb30 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.984+0000 7fb8c7221740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d106240 con 0x55d60d19f470 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.984+0000 7fb8c7221740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d101b30 con 0x55d60d1a4500 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d19ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60960/0 (socket says 172.21.15.27:60960) 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1000640 1 -- 172.21.15.27:0/2353706574 learned_addr learned my addr 172.21.15.27:0/2353706574 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.988 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/2353706574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1000640 1 --2- 172.21.15.27:0/2353706574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 0x55d60d1a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1a00640 1 -- 172.21.15.27:0/2353706574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 msgr2=0x55d60d1a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/2353706574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 0x55d60d1a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1a00640 1 -- 172.21.15.27:0/2353706574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 msgr2=0x55d60d19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/2353706574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.985+0000 7fb8c1a00640 1 -- 172.21.15.27:0/2353706574 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d60d0ccbd0 con 0x55d60d19f470 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.986+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/2353706574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1a3f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0011510 tx=0x7fb8b00119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a3b04a86875965 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.986+0000 7fb8ba000640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb8a40a1090 0x7fb8a40a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.986+0000 7fb8aea00640 1 -- 172.21.15.27:0/2353706574 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000f5c0 con 0x55d60d19f470 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.986+0000 7fb8aea00640 1 -- 172.21.15.27:0/2353706574 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb8b000fc00 con 0x55d60d19f470 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.986+0000 7fb8aea00640 1 -- 172.21.15.27:0/2353706574 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0019cf0 con 0x55d60d19f470 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.986+0000 7fb8ba000640 1 -- 172.21.15.27:0/826382856 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb8b40cc950 con 0x7fb8bc107bd0 2024-09-13T18:03:51.989 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.986+0000 7fb8c1000640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb8a40a1090 0x7fb8a40a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.986+0000 7fb8c7221740 1 -- 172.21.15.27:0/2353706574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 msgr2=0x55d60d1a3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.986+0000 7fb8c7221740 1 --2- 172.21.15.27:0/2353706574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1a3f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0011510 tx=0x7fb8b00119d0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c1000640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb8a40a1090 0x7fb8a40a3550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80304f0 tx=0x7fb8a8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c7221740 1 -- 172.21.15.27:0/2353706574 shutdown_connections 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c7221740 1 --2- 172.21.15.27:0/2353706574 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 0x55d60d1a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c7221740 1 --2- 172.21.15.27:0/2353706574 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1a3f30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c7221740 1 --2- 172.21.15.27:0/2353706574 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c7221740 1 -- 172.21.15.27:0/2353706574 >> 172.21.15.27:0/2353706574 conn(0x55d60d19a1a0 msgr2=0x55d60d19a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c7221740 1 -- 172.21.15.27:0/2353706574 shutdown_connections 2024-09-13T18:03:51.994 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c7221740 1 -- 172.21.15.27:0/2353706574 wait complete. 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c7221740 1 -- start start 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.987+0000 7fb8c7221740 1 Processor -- start 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1a8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19f470 0x55d60d1a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d1a4500 0x55d60d1afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c7221740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d0a3260 con 0x55d60d19f470 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c7221740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d0a2f00 con 0x55d60d1a4500 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c7221740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60ce68f20 con 0x55d60d19eb30 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c7221740 10 client.0 _ll_register_callbacks cb 0x55d60d0fb1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c1000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19f470 0x55d60d1a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c1000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19f470 0x55d60d1a8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60970/0 (socket says 172.21.15.27:60970) 2024-09-13T18:03:51.995 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c1000640 1 -- 172.21.15.27:0/4106499887 learned_addr learned my addr 172.21.15.27:0/4106499887 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c2400640 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d1a4500 0x55d60d1afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1a8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:40732/0 (socket says 172.21.15.27:40732) 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c1a00640 1 -- 172.21.15.27:0/4106499887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d1a4500 msgr2=0x55d60d1afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d1a4500 0x55d60d1afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c1a00640 1 -- 172.21.15.27:0/4106499887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19f470 msgr2=0x55d60d1a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.988+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19f470 0x55d60d1a8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8c1a00640 1 -- 172.21.15.27:0/4106499887 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b0009d10 con 0x55d60d19eb30 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8c2400640 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d1a4500 0x55d60d1afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8c1000640 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19f470 0x55d60d1a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1a8710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0011ed0 tx=0x7fb8b0019d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a578b57499c1868 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8a3400640 10 client.0 ms_handle_connect on v2:172.21.15.143:3300/0 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8a3400640 1 -- 172.21.15.27:0/4106499887 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000fe60 con 0x55d60d19eb30 2024-09-13T18:03:51.996 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8c7221740 1 -- 172.21.15.27:0/4106499887 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d60d12bcd0 con 0x55d60d19eb30 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8a3400640 1 -- 172.21.15.27:0/4106499887 <== mon.1 v2:172.21.15.143:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb8b000f7d0 con 0x55d60d19eb30 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8a3400640 1 -- 172.21.15.27:0/4106499887 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8b000f990 con 0x55d60d19eb30 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8c7221740 10 client.25195 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.989+0000 7fb8c7221740 1 -- 172.21.15.27:0/4106499887 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d60d1001b0 con 0x55d60d19eb30 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.990+0000 7fb8a3400640 1 -- 172.21.15.27:0/4106499887 <== mon.1 v2:172.21.15.143:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55d60d12bcd0 con 0x55d60d19eb30 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.990+0000 7fb8a3400640 1 -- 172.21.15.27:0/4106499887 <== mon.1 v2:172.21.15.143:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb8b0004c30 con 0x55d60d19eb30 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.990+0000 7fb8c7221740 10 client.25195 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.990+0000 7fb8c7221740 10 client.25195 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.990+0000 7fb8c7221740 20 client.25195 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.990+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55d60d1b4540 0x55d60d1b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.990+0000 7fb8c7221740 4 client.25195 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.990+0000 7fb8c7221740 1 -- 172.21.15.27:0/4106499887 --> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d60cdf53c0 con 0x55d60d1b4540 2024-09-13T18:03:51.997 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.990+0000 7fb8c1000640 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55d60d1b4540 0x55d60d1b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.991+0000 7fb8c1000640 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55d60d1b4540 0x55d60d1b8cb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=af5c3bf3e359f199 server_cookie=15bce831736ccac2 in_seq=0 out_seq=0 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.991+0000 7fb8a3400640 10 client.25195 ms_handle_connect on v2:172.21.15.122:6836/65111779 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.991+0000 7fb8a3400640 1 -- 172.21.15.27:0/4106499887 <== mds.2 v2:172.21.15.122:6836/65111779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55d60cdf53c0 con 0x55d60d1b4540 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.991+0000 7fb8a3400640 10 client.25195 handle_command_reply: tid=0 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 client.25195 shutdown 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 -- 172.21.15.27:0/4106499887 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 msgr2=0x55d60d1a8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1a8710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0011ed0 tx=0x7fb8b0019d40 comp rx=0 tx=0).stop 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 -- 172.21.15.27:0/4106499887 shutdown_connections 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55d60d1b4540 0x55d60d1b8cb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d1a4500 0x55d60d1afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19f470 0x55d60d1a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4106499887 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1a8710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8a3400640 0 client.25195 ms_handle_reset on v2:172.21.15.122:6836/65111779 2024-09-13T18:03:51.998 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 -- 172.21.15.27:0/4106499887 >> 172.21.15.27:0/4106499887 conn(0x55d60d19a1a0 msgr2=0x55d60d19b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:51.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 -- 172.21.15.27:0/4106499887 shutdown_connections 2024-09-13T18:03:51.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 1 -- 172.21.15.27:0/4106499887 wait complete. 2024-09-13T18:03:51.999 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:51.992+0000 7fb8c7221740 20 client.25195 trim_cache size 0 max 16384 2024-09-13T18:03:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c7221740 1 Processor -- start 2024-09-13T18:03:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c7221740 1 -- start start 2024-09-13T18:03:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d1a4500 0x55d60d1a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c7221740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d1a70d0 con 0x55d60d1a4500 2024-09-13T18:03:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c7221740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60cdf53c0 con 0x55d60d19f470 2024-09-13T18:03:52.010 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c7221740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d12bcd0 con 0x55d60d19eb30 2024-09-13T18:03:52.014 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c1000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c2400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d1a4500 0x55d60d1a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:40738/0 (socket says 172.21.15.27:40738) 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c1000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:50520/0 (socket says 172.21.15.27:50520) 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.008+0000 7fb8c1a00640 1 -- 172.21.15.27:0/1882103432 learned_addr learned my addr 172.21.15.27:0/1882103432 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8c1a00640 1 -- 172.21.15.27:0/1882103432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 msgr2=0x55d60d1afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/1882103432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8c1a00640 1 -- 172.21.15.27:0/1882103432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d1a4500 msgr2=0x55d60d1a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/1882103432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d1a4500 0x55d60d1a38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8c1a00640 1 -- 172.21.15.27:0/1882103432 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d60d0a2470 con 0x55d60d19eb30 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8c2400640 1 --2- 172.21.15.27:0/1882103432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d1a4500 0x55d60d1a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/1882103432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1b0700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0011460 tx=0x7fb8b0005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=395e139d393c022c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.015 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8af400640 1 -- 172.21.15.27:0/1882103432 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0019db0 con 0x55d60d19eb30 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8af400640 1 -- 172.21.15.27:0/1882103432 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb8b00198c0 con 0x55d60d19eb30 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.009+0000 7fb8af400640 1 -- 172.21.15.27:0/1882103432 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000fa10 con 0x55d60d19eb30 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 -- 172.21.15.27:0/1882103432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 msgr2=0x55d60d1b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 --2- 172.21.15.27:0/1882103432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1b0700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0011460 tx=0x7fb8b0005fd0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 -- 172.21.15.27:0/1882103432 shutdown_connections 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 --2- 172.21.15.27:0/1882103432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d1a4500 0x55d60d1a38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 --2- 172.21.15.27:0/1882103432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 --2- 172.21.15.27:0/1882103432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d19eb30 0x55d60d1b0700 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 -- 172.21.15.27:0/1882103432 >> 172.21.15.27:0/1882103432 conn(0x55d60d19a1a0 msgr2=0x55d60d1a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 -- 172.21.15.27:0/1882103432 shutdown_connections 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 -- 172.21.15.27:0/1882103432 wait complete. 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 -- start start 2024-09-13T18:03:52.016 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.010+0000 7fb8c7221740 1 Processor -- start 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d1a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1aa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c7221740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 0x55d60d1af490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c7221740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d1af9d0 con 0x55d60d19eb30 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c7221740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d1afb40 con 0x55d60d19f470 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c7221740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60d1afd00 con 0x55d60d1a4500 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c7221740 10 client.0 _ll_register_callbacks cb 0x7fb8b001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d1a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d1a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:60982/0 (socket says 172.21.15.27:60982) 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1a00640 1 -- 172.21.15.27:0/4134052090 learned_addr learned my addr 172.21.15.27:0/4134052090 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c2400640 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 0x55d60d1af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1000640 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.017 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1a00640 1 -- 172.21.15.27:0/4134052090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 msgr2=0x55d60d1af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 0x55d60d1af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1a00640 1 -- 172.21.15.27:0/4134052090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 msgr2=0x55d60d1aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1a00640 1 -- 172.21.15.27:0/4134052090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc1a0490 con 0x55d60d19eb30 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.011+0000 7fb8c1000640 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.012+0000 7fb8c1a00640 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d1a9fc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000a010 tx=0x7fb8b000fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867af3914a2ff066 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.012+0000 7fb8a3400640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.012+0000 7fb8a3400640 1 -- 172.21.15.27:0/4134052090 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0005450 con 0x55d60d19eb30 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.012+0000 7fb8a3400640 1 -- 172.21.15.27:0/4134052090 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb8b0000e40 con 0x55d60d19eb30 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.012+0000 7fb8c7221740 1 -- 172.21.15.27:0/4134052090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8b000fc00 con 0x55d60d19eb30 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.012+0000 7fb8a3400640 1 -- 172.21.15.27:0/4134052090 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8b0024680 con 0x55d60d19eb30 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.012+0000 7fb8c7221740 10 client.15177 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:52.018 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.012+0000 7fb8c7221740 1 -- 172.21.15.27:0/4134052090 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d60d1001b0 con 0x55d60d19eb30 2024-09-13T18:03:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.012+0000 7fb8a3400640 1 -- 172.21.15.27:0/4134052090 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb8b000fc00 con 0x55d60d19eb30 2024-09-13T18:03:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.013+0000 7fb8a3400640 1 -- 172.21.15.27:0/4134052090 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb8b0046720 con 0x55d60d19eb30 2024-09-13T18:03:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.013+0000 7fb8c7221740 10 client.15177 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.013+0000 7fb8c7221740 10 client.15177 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-13T18:03:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.013+0000 7fb8c7221740 20 client.15177 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.013+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55d60d20eca0 0x55d60d20b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.013+0000 7fb8c7221740 4 client.15177 mds_command: new command op to 24533 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:52.019 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.013+0000 7fb8c7221740 1 -- 172.21.15.27:0/4134052090 --> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d60ce066c0 con 0x55d60d20eca0 2024-09-13T18:03:52.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.013+0000 7fb8c1000640 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55d60d20eca0 0x55d60d20b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.020 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c1000640 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55d60d20eca0 0x55d60d20b660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2ee3cc451f610e57 server_cookie=254d49f555306961 in_seq=0 out_seq=0 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8a3400640 10 client.15177 ms_handle_connect on v2:172.21.15.122:6836/65111779 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8a3400640 1 -- 172.21.15.27:0/4134052090 <== mds.2 v2:172.21.15.122:6836/65111779 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x55d60ce066c0 con 0x55d60d20eca0 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8a3400640 10 client.15177 handle_command_reply: tid=0 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 client.15177 shutdown 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 -- 172.21.15.27:0/4134052090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 msgr2=0x55d60d1a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d1a9fc0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000a010 tx=0x7fb8b000fb60 comp rx=0 tx=0).stop 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 -- 172.21.15.27:0/4134052090 shutdown_connections 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.122:6836/65111779,v1:172.21.15.122:6837/65111779] conn(0x55d60d20eca0 0x55d60d20b660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x55d60d1a4500 0x55d60d1af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x55d60d19f470 0x55d60d1aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8a3400640 0 client.15177 ms_handle_reset on v2:172.21.15.122:6836/65111779 2024-09-13T18:03:52.021 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 --2- 172.21.15.27:0/4134052090 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x55d60d19eb30 0x55d60d1a9fc0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 -- 172.21.15.27:0/4134052090 >> 172.21.15.27:0/4134052090 conn(0x55d60d19a1a0 msgr2=0x55d60d1a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 -- 172.21.15.27:0/4134052090 shutdown_connections 2024-09-13T18:03:52.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 1 -- 172.21.15.27:0/4134052090 wait complete. 2024-09-13T18:03:52.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.014+0000 7fb8c7221740 20 client.15177 trim_cache size 0 max 16384 2024-09-13T18:03:52.022 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:52.022 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:52.022 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 2, 2024-09-13T18:03:52.022 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24533, 2024-09-13T18:03:52.022 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:52.023 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:52.023 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:52.023 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 121.655786558, 2024-09-13T18:03:52.023 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:52.023 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:52.023 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:52.023 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 143.899342332 2024-09-13T18:03:52.023 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 -- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb8a40a1090 msgr2=0x7fb8a40a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb8a40a1090 0x7fb8a40a3550 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80304f0 tx=0x7fb8a8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 -- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8bc107bd0 msgr2=0x7fb8bc19f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8bc107bd0 0x7fb8bc19f640 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb8b400efc0 tx=0x7fb8b400c800 comp rx=0 tx=0).stop 2024-09-13T18:03:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 -- 172.21.15.27:0/826382856 shutdown_connections 2024-09-13T18:03:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fb8a40a1090 0x7fb8a40a3550 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fb8bc107bd0 0x7fb8bc19f640 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fb8bc0744f0 0x7fb8bc1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.024 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 --2- 172.21.15.27:0/826382856 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fb8bc072f10 0x7fb8bc198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 -- 172.21.15.27:0/826382856 >> 172.21.15.27:0/826382856 conn(0x7fb8bc0fb4c0 msgr2=0x7fb8bc103b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 -- 172.21.15.27:0/826382856 shutdown_connections 2024-09-13T18:03:52.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.015+0000 7fb8c4400640 1 -- 172.21.15.27:0/826382856 wait complete. 2024-09-13T18:03:52.033 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:03:52.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.193+0000 7f54ca200640 1 -- 172.21.15.27:0/1129603428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54c40fe3f0 msgr2=0x7f54c4100000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.195 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.193+0000 7f54ca200640 1 --2- 172.21.15.27:0/1129603428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54c40fe3f0 0x7f54c4100000 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009ca0 tx=0x7f54bc02a8c0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.193+0000 7f54ca200640 1 -- 172.21.15.27:0/1129603428 shutdown_connections 2024-09-13T18:03:52.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.193+0000 7f54ca200640 1 --2- 172.21.15.27:0/1129603428 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54c40fe3f0 0x7f54c4100000 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.193+0000 7f54ca200640 1 --2- 172.21.15.27:0/1129603428 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54c40fda30 0x7f54c40fdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.193+0000 7f54ca200640 1 --2- 172.21.15.27:0/1129603428 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54c40fef60 0x7f54c40ff360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.193+0000 7f54ca200640 1 -- 172.21.15.27:0/1129603428 >> 172.21.15.27:0/1129603428 conn(0x7f54c40f9740 msgr2=0x7f54c40fbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.193+0000 7f54ca200640 1 -- 172.21.15.27:0/1129603428 shutdown_connections 2024-09-13T18:03:52.196 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.193+0000 7f54ca200640 1 -- 172.21.15.27:0/1129603428 wait complete. 2024-09-13T18:03:52.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.194+0000 7f54ca200640 1 Processor -- start 2024-09-13T18:03:52.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.194+0000 7f54ca200640 1 -- start start 2024-09-13T18:03:52.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.194+0000 7f54ca200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54c40fda30 0x7f54c4197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.194+0000 7f54ca200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54c40fe3f0 0x7f54c4198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54ca200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54c40fef60 0x7f54c419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54ca200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c419fac0 con 0x7f54c40fef60 2024-09-13T18:03:52.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54ca200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c419fc30 con 0x7f54c40fda30 2024-09-13T18:03:52.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54ca200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c419fdf0 con 0x7f54c40fe3f0 2024-09-13T18:03:52.198 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54c40fef60 0x7f54c419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c3400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54c40fda30 0x7f54c4197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54c40fef60 0x7f54c419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:32780/0 (socket says 172.21.15.27:32780) 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c2a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54c40fe3f0 0x7f54c4198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c3e00640 1 -- 172.21.15.27:0/1359189837 learned_addr learned my addr 172.21.15.27:0/1359189837 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c3400640 1 -- 172.21.15.27:0/1359189837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54c40fe3f0 msgr2=0x7f54c4198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c3400640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54c40fe3f0 0x7f54c4198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c3400640 1 -- 172.21.15.27:0/1359189837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54c40fef60 msgr2=0x7f54c419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c3400640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54c40fef60 0x7f54c419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c3400640 1 -- 172.21.15.27:0/1359189837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc009900 con 0x7f54c40fda30 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.195+0000 7f54c2a00640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54c40fe3f0 0x7f54c4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.196+0000 7f54c3400640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54c40fda30 0x7f54c4197fd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f54b400e9f0 tx=0x7f54b400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.196+0000 7f54bbe00640 1 -- 172.21.15.27:0/1359189837 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b400ccc0 con 0x7f54c40fda30 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.196+0000 7f54bbe00640 1 -- 172.21.15.27:0/1359189837 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f54b400ce20 con 0x7f54c40fda30 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.196+0000 7f54bbe00640 1 -- 172.21.15.27:0/1359189837 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4018920 con 0x7f54c40fda30 2024-09-13T18:03:52.199 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.196+0000 7f54ca200640 1 -- 172.21.15.27:0/1359189837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c41a00d0 con 0x7f54c40fda30 2024-09-13T18:03:52.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.196+0000 7f54ca200640 1 -- 172.21.15.27:0/1359189837 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c41a0590 con 0x7f54c40fda30 2024-09-13T18:03:52.200 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.199+0000 7f54bbe00640 1 -- 172.21.15.27:0/1359189837 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f54b4018a80 con 0x7f54c40fda30 2024-09-13T18:03:52.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.199+0000 7f54cd051740 1 Processor -- start 2024-09-13T18:03:52.201 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.199+0000 7f54cd051740 1 -- start start 2024-09-13T18:03:52.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.199+0000 7f54cd051740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7babb30 0x555cb7babf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.199+0000 7f54cd051740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.202 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.199+0000 7f54cd051740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 0x555cb7bb39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.199+0000 7f54cd051740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7b15ab0 con 0x555cb7bac470 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.199+0000 7f54cd051740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7b13240 con 0x555cb7bb1500 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.199+0000 7f54cd051740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7b0eb30 con 0x555cb7babb30 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:32786/0 (socket says 172.21.15.27:32786) 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3400640 1 -- 172.21.15.27:0/3211372860 learned_addr learned my addr 172.21.15.27:0/3211372860 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3e00640 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7babb30 0x555cb7babf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c2a00640 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 0x555cb7bb39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3e00640 1 -- 172.21.15.27:0/3211372860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 msgr2=0x555cb7bb39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3e00640 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 0x555cb7bb39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3e00640 1 -- 172.21.15.27:0/3211372860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 msgr2=0x555cb7bb0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.203 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3e00640 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3e00640 1 -- 172.21.15.27:0/3211372860 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cb7ad9bd0 con 0x555cb7babb30 2024-09-13T18:03:52.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3400640 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:52.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54c3e00640 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7babb30 0x555cb7babf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f54bc005e30 tx=0x7f54bc009880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3c99e7784b1ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.200+0000 7f54bbe00640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f54a80a1090 0x7f54a80a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54b8c00640 1 -- 172.21.15.27:0/3211372860 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc02f5d0 con 0x555cb7babb30 2024-09-13T18:03:52.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54bbe00640 1 -- 172.21.15.27:0/1359189837 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f54b4014070 con 0x7f54c40fda30 2024-09-13T18:03:52.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54b8c00640 1 -- 172.21.15.27:0/3211372860 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f54bc003e50 con 0x555cb7babb30 2024-09-13T18:03:52.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54b8c00640 1 -- 172.21.15.27:0/3211372860 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc02fca0 con 0x555cb7babb30 2024-09-13T18:03:52.204 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54c3400640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f54a80a1090 0x7f54a80a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.207 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54cd051740 1 -- 172.21.15.27:0/3211372860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7babb30 msgr2=0x555cb7babf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54c3400640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f54a80a1090 0x7f54a80a3550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f54b40965b0 tx=0x7f54b40cff90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54cd051740 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7babb30 0x555cb7babf30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f54bc005e30 tx=0x7f54bc009880 comp rx=0 tx=0).stop 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54cd051740 1 -- 172.21.15.27:0/3211372860 shutdown_connections 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54cd051740 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 0x555cb7bb39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54cd051740 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54cd051740 1 --2- 172.21.15.27:0/3211372860 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7babb30 0x555cb7babf30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.201+0000 7f54cd051740 1 -- 172.21.15.27:0/3211372860 >> 172.21.15.27:0/3211372860 conn(0x555cb7ba71a0 msgr2=0x555cb7ba75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.202+0000 7f54cd051740 1 -- 172.21.15.27:0/3211372860 shutdown_connections 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.202+0000 7f54cd051740 1 -- 172.21.15.27:0/3211372860 wait complete. 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.202+0000 7f54cd051740 1 -- start start 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.202+0000 7f54cd051740 1 Processor -- start 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54cd051740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54cd051740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54cd051740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bb1500 0x555cb7bbccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54cd051740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7ab0260 con 0x555cb7bac470 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54cd051740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7aaff00 con 0x555cb7babb30 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54cd051740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7875f20 con 0x555cb7bb1500 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54cd051740 10 client.0 _ll_register_callbacks cb 0x555cb7b081a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:50576/0 (socket says 172.21.15.27:50576) 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c3e00640 1 -- 172.21.15.27:0/2270909614 learned_addr learned my addr 172.21.15.27:0/2270909614 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c2a00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c3e00640 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bb1500 0x555cb7bbccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c2a00640 1 -- 172.21.15.27:0/2270909614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bb1500 msgr2=0x555cb7bbccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.209 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c2a00640 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bb1500 0x555cb7bbccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c2a00640 1 -- 172.21.15.27:0/2270909614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 msgr2=0x555cb7bb5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c2a00640 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.203+0000 7f54c2a00640 1 -- 172.21.15.27:0/2270909614 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c41008c0 con 0x555cb7bac470 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.204+0000 7f54c2a00640 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb5c70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f54c41994e0 tx=0x7f54b000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105fc8dd3f79bafa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.204+0000 7f54ad600640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.204+0000 7f54ad600640 1 -- 172.21.15.27:0/2270909614 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0017070 con 0x555cb7bac470 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.204+0000 7f54cd051740 1 -- 172.21.15.27:0/2270909614 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555cb7b38cd0 con 0x555cb7bac470 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.204+0000 7f54ad600640 1 -- 172.21.15.27:0/2270909614 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f54b0009e30 con 0x555cb7bac470 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.204+0000 7f54ad600640 1 -- 172.21.15.27:0/2270909614 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54b0022030 con 0x555cb7bac470 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.204+0000 7f54cd051740 10 client.15189 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.204+0000 7f54cd051740 1 -- 172.21.15.27:0/2270909614 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555cb7b0d1b0 con 0x555cb7bac470 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.204+0000 7f54ad600640 1 -- 172.21.15.27:0/2270909614 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555cb7b38cd0 con 0x555cb7bac470 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.205+0000 7f54ad600640 1 -- 172.21.15.27:0/2270909614 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f54b0003ad0 con 0x555cb7bac470 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.205+0000 7f54cd051740 10 client.15189 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:52.210 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.205+0000 7f54cd051740 10 client.15189 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:03:52.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.205+0000 7f54cd051740 20 client.15189 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:52.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.205+0000 7f54cd051740 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x555cb7bc1230 0x555cb7bc5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.205+0000 7f54cd051740 4 client.15189 mds_command: new command op to 24556 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:52.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.205+0000 7f54cd051740 1 -- 172.21.15.27:0/2270909614 --> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555cb78023c0 con 0x555cb7bc1230 2024-09-13T18:03:52.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.205+0000 7f54c3e00640 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x555cb7bc1230 0x555cb7bc5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.206+0000 7f54c3e00640 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x555cb7bc1230 0x555cb7bc5ec0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d0344c06f20b025 server_cookie=e8233cf32263b77e in_seq=0 out_seq=0 2024-09-13T18:03:52.211 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.206+0000 7f54ad600640 10 client.15189 ms_handle_connect on v2:172.21.15.27:6840/3673158651 2024-09-13T18:03:52.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.206+0000 7f54ad600640 1 -- 172.21.15.27:0/2270909614 <== mds.1 v2:172.21.15.27:6840/3673158651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x555cb78023c0 con 0x555cb7bc1230 2024-09-13T18:03:52.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.206+0000 7f54ad600640 10 client.15189 handle_command_reply: tid=0 2024-09-13T18:03:52.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.206+0000 7f54cd051740 1 client.15189 shutdown 2024-09-13T18:03:52.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.206+0000 7f54cd051740 1 -- 172.21.15.27:0/2270909614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 msgr2=0x555cb7bb5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.206+0000 7f54cd051740 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb5c70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f54c41994e0 tx=0x7f54b000f790 comp rx=0 tx=0).stop 2024-09-13T18:03:52.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54cd051740 1 -- 172.21.15.27:0/2270909614 shutdown_connections 2024-09-13T18:03:52.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54cd051740 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bb1500 0x555cb7bbccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54cd051740 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bac470 0x555cb7bb5c70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54cd051740 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x555cb7bc1230 0x555cb7bc5ec0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54cd051740 1 --2- 172.21.15.27:0/2270909614 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54cd051740 1 -- 172.21.15.27:0/2270909614 >> 172.21.15.27:0/2270909614 conn(0x555cb7ba71a0 msgr2=0x555cb7ba89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54ad600640 0 client.15189 ms_handle_reset on v2:172.21.15.27:6840/3673158651 2024-09-13T18:03:52.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54cd051740 1 -- 172.21.15.27:0/2270909614 shutdown_connections 2024-09-13T18:03:52.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54cd051740 1 -- 172.21.15.27:0/2270909614 wait complete. 2024-09-13T18:03:52.213 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.207+0000 7f54cd051740 20 client.15189 trim_cache size 0 max 16384 2024-09-13T18:03:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.222+0000 7f54cd051740 1 Processor -- start 2024-09-13T18:03:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.222+0000 7f54cd051740 1 -- start start 2024-09-13T18:03:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.222+0000 7f54cd051740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.222+0000 7f54cd051740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bbcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.222+0000 7f54cd051740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bb1500 0x555cb7bb5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.224 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.222+0000 7f54cd051740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb78023c0 con 0x555cb7bb1500 2024-09-13T18:03:52.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.222+0000 7f54cd051740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7b38cd0 con 0x555cb7babb30 2024-09-13T18:03:52.225 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.222+0000 7f54cd051740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7bacd30 con 0x555cb7bac470 2024-09-13T18:03:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bb1500 0x555cb7bb5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c2a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bbcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c2a00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bbcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:40818/0 (socket says 172.21.15.27:40818) 2024-09-13T18:03:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c2a00640 1 -- 172.21.15.27:0/4260165249 learned_addr learned my addr 172.21.15.27:0/4260165249 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.226 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c3e00640 1 --2- 172.21.15.27:0/4260165249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c2a00640 1 -- 172.21.15.27:0/4260165249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 msgr2=0x555cb7bb54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c2a00640 1 --2- 172.21.15.27:0/4260165249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c2a00640 1 -- 172.21.15.27:0/4260165249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bb1500 msgr2=0x555cb7bb5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c2a00640 1 --2- 172.21.15.27:0/4260165249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bb1500 0x555cb7bb5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c2a00640 1 -- 172.21.15.27:0/4260165249 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cb7aaf470 con 0x555cb7bac470 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c3e00640 1 --2- 172.21.15.27:0/4260165249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.223+0000 7f54c2a00640 1 --2- 172.21.15.27:0/4260165249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bbcc70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54b0001eb0 tx=0x7f54b0009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6accc1daa6648e74 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54b9600640 1 -- 172.21.15.27:0/4260165249 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0017040 con 0x555cb7bac470 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54b9600640 1 -- 172.21.15.27:0/4260165249 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f54b00055a0 con 0x555cb7bac470 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54b9600640 1 -- 172.21.15.27:0/4260165249 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b0022040 con 0x555cb7bac470 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54cd051740 1 -- 172.21.15.27:0/4260165249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 msgr2=0x555cb7bbcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54cd051740 1 --2- 172.21.15.27:0/4260165249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bbcc70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f54b0001eb0 tx=0x7f54b0009be0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.227 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54cd051740 1 -- 172.21.15.27:0/4260165249 shutdown_connections 2024-09-13T18:03:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54cd051740 1 --2- 172.21.15.27:0/4260165249 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7bb1500 0x555cb7bb5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54cd051740 1 --2- 172.21.15.27:0/4260165249 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bbcc70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54cd051740 1 --2- 172.21.15.27:0/4260165249 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7babb30 0x555cb7bb54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54cd051740 1 -- 172.21.15.27:0/4260165249 >> 172.21.15.27:0/4260165249 conn(0x555cb7ba71a0 msgr2=0x555cb7bad330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54cd051740 1 -- 172.21.15.27:0/4260165249 shutdown_connections 2024-09-13T18:03:52.228 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.224+0000 7f54cd051740 1 -- 172.21.15.27:0/4260165249 wait complete. 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.225+0000 7f54cd051740 1 -- start start 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.225+0000 7f54cd051740 1 Processor -- start 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.225+0000 7f54cd051740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7babb30 0x555cb7bb7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.225+0000 7f54cd051740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bb7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.225+0000 7f54cd051740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 0x555cb7c17b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.225+0000 7f54cd051740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7bbcdb0 con 0x555cb7babb30 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.225+0000 7f54cd051740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7bbcf20 con 0x555cb7bb1500 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.225+0000 7f54cd051740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cb7c180c0 con 0x555cb7bac470 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54cd051740 10 client.0 _ll_register_callbacks cb 0x7f54b0009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7babb30 0x555cb7bb7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7babb30 0x555cb7bb7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:32802/0 (socket says 172.21.15.27:32802) 2024-09-13T18:03:52.232 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 -- 172.21.15.27:0/516790067 learned_addr learned my addr 172.21.15.27:0/516790067 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c2a00640 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bb7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 0x555cb7c17b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 -- 172.21.15.27:0/516790067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 msgr2=0x555cb7bb7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bb7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 -- 172.21.15.27:0/516790067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 msgr2=0x555cb7c17b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 0x555cb7c17b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 -- 172.21.15.27:0/516790067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555cb7b0d1b0 con 0x555cb7babb30 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54c3e00640 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7babb30 0x555cb7bb7840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f54bc031040 tx=0x7f54bc031c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a38458b1fda76e5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.226+0000 7f54ad600640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54ad600640 1 -- 172.21.15.27:0/516790067 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54bc058ea0 con 0x555cb7babb30 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54ad600640 1 -- 172.21.15.27:0/516790067 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f54bc05f020 con 0x555cb7babb30 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54cd051740 1 -- 172.21.15.27:0/516790067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54bc003e50 con 0x555cb7babb30 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54ad600640 1 -- 172.21.15.27:0/516790067 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54bc031450 con 0x555cb7babb30 2024-09-13T18:03:52.233 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54cd051740 10 client.15195 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54cd051740 1 -- 172.21.15.27:0/516790067 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555cb7ad4980 con 0x555cb7babb30 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54ad600640 1 -- 172.21.15.27:0/516790067 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f54bc003e50 con 0x555cb7babb30 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54ad600640 1 -- 172.21.15.27:0/516790067 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f54bc0305c0 con 0x555cb7babb30 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54cd051740 10 client.15195 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.227+0000 7f54cd051740 10 client.15195 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.228+0000 7f54cd051740 20 client.15195 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.228+0000 7f54cd051740 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x555cb7c1cc20 0x555cb7c19570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.228+0000 7f54cd051740 4 client.15195 mds_command: new command op to 24556 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.228+0000 7f54cd051740 1 -- 172.21.15.27:0/516790067 --> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555cb78136c0 con 0x555cb7c1cc20 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.228+0000 7f54c2a00640 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x555cb7c1cc20 0x555cb7c19570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.228+0000 7f54c2a00640 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x555cb7c1cc20 0x555cb7c19570 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b9e29306ace24b0 server_cookie=a7e0ae35001a33b6 in_seq=0 out_seq=0 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.228+0000 7f54ad600640 10 client.15195 ms_handle_connect on v2:172.21.15.27:6840/3673158651 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.228+0000 7f54ad600640 1 -- 172.21.15.27:0/516790067 <== mds.1 v2:172.21.15.27:6840/3673158651 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x555cb78136c0 con 0x555cb7c1cc20 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.228+0000 7f54ad600640 10 client.15195 handle_command_reply: tid=0 2024-09-13T18:03:52.234 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 client.15195 shutdown 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 -- 172.21.15.27:0/516790067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7babb30 msgr2=0x555cb7bb7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7babb30 0x555cb7bb7840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f54bc031040 tx=0x7f54bc031c80 comp rx=0 tx=0).stop 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 -- 172.21.15.27:0/516790067 shutdown_connections 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.27:6840/3673158651,v1:172.21.15.27:6841/3673158651] conn(0x555cb7c1cc20 0x555cb7c19570 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x555cb7bb1500 0x555cb7c17b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x555cb7bac470 0x555cb7bb7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 --2- 172.21.15.27:0/516790067 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x555cb7babb30 0x555cb7bb7840 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54ad600640 0 client.15195 ms_handle_reset on v2:172.21.15.27:6840/3673158651 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 -- 172.21.15.27:0/516790067 >> 172.21.15.27:0/516790067 conn(0x555cb7ba71a0 msgr2=0x555cb7bb54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 -- 172.21.15.27:0/516790067 shutdown_connections 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 1 -- 172.21.15.27:0/516790067 wait complete. 2024-09-13T18:03:52.235 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.229+0000 7f54cd051740 20 client.15195 trim_cache size 0 max 16384 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 1, 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24556, 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 122.884701784, 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 134.77196898299999 2024-09-13T18:03:52.236 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 -- 172.21.15.27:0/1359189837 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f54a80a1090 msgr2=0x7f54a80a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f54a80a1090 0x7f54a80a3550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f54b40965b0 tx=0x7f54b40cff90 comp rx=0 tx=0).stop 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 -- 172.21.15.27:0/1359189837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54c40fda30 msgr2=0x7f54c4197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54c40fda30 0x7f54c4197fd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f54b400e9f0 tx=0x7f54b400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 -- 172.21.15.27:0/1359189837 shutdown_connections 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f54a80a1090 0x7f54a80a3550 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f54c40fef60 0x7f54c419f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f54c40fe3f0 0x7f54c4198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 --2- 172.21.15.27:0/1359189837 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f54c40fda30 0x7f54c4197fd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.237 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 -- 172.21.15.27:0/1359189837 >> 172.21.15.27:0/1359189837 conn(0x7f54c40f9740 msgr2=0x7f54c40fae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 -- 172.21.15.27:0/1359189837 shutdown_connections 2024-09-13T18:03:52.238 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.230+0000 7f54ca200640 1 -- 172.21.15.27:0/1359189837 wait complete. 2024-09-13T18:03:52.247 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T18:03:52.296 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:52 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2905997274' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:52.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.406+0000 7fe975000640 1 -- 172.21.15.27:0/1135763131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970101f90 msgr2=0x7fe970102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.408 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.406+0000 7fe975000640 1 --2- 172.21.15.27:0/1135763131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970101f90 0x7fe970102390 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe960009900 tx=0x7fe96002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.406+0000 7fe975000640 1 -- 172.21.15.27:0/1135763131 shutdown_connections 2024-09-13T18:03:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.406+0000 7fe975000640 1 --2- 172.21.15.27:0/1135763131 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe970103b40 0x7fe97010a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.406+0000 7fe975000640 1 --2- 172.21.15.27:0/1135763131 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe970103180 0x7fe970103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.406+0000 7fe975000640 1 --2- 172.21.15.27:0/1135763131 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970101f90 0x7fe970102390 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.406+0000 7fe975000640 1 -- 172.21.15.27:0/1135763131 >> 172.21.15.27:0/1135763131 conn(0x7fe9700fd6d0 msgr2=0x7fe9700ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.406+0000 7fe975000640 1 -- 172.21.15.27:0/1135763131 shutdown_connections 2024-09-13T18:03:52.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.406+0000 7fe975000640 1 -- 172.21.15.27:0/1135763131 wait complete. 2024-09-13T18:03:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.407+0000 7fe975000640 1 Processor -- start 2024-09-13T18:03:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.407+0000 7fe975000640 1 -- start start 2024-09-13T18:03:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe975000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe970101f90 0x7fe970198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe975000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970103180 0x7fe970198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.411 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe975000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe970103b40 0x7fe97019f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe975000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97019fb10 con 0x7fe970103180 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe975000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97019fc80 con 0x7fe970101f90 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe975000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97019fe40 con 0x7fe970103b40 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe965400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970103180 0x7fe970198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe965400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970103180 0x7fe970198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:32824/0 (socket says 172.21.15.27:32824) 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe965400640 1 -- 172.21.15.27:0/3824430890 learned_addr learned my addr 172.21.15.27:0/3824430890 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe96de00640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe970101f90 0x7fe970198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe96e800640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe970103b40 0x7fe97019f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe965400640 1 -- 172.21.15.27:0/3824430890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe970103b40 msgr2=0x7fe97019f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe965400640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe970103b40 0x7fe97019f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe965400640 1 -- 172.21.15.27:0/3824430890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe970101f90 msgr2=0x7fe970198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe965400640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe970101f90 0x7fe970198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe965400640 1 -- 172.21.15.27:0/3824430890 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe960009560 con 0x7fe970103180 2024-09-13T18:03:52.412 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.408+0000 7fe96de00640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe970101f90 0x7fe970198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.409+0000 7fe965400640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970103180 0x7fe970198560 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe95800d950 tx=0x7fe95800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.409+0000 7fe967400640 1 -- 172.21.15.27:0/3824430890 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958009c30 con 0x7fe970103180 2024-09-13T18:03:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.409+0000 7fe967400640 1 -- 172.21.15.27:0/3824430890 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe958009d90 con 0x7fe970103180 2024-09-13T18:03:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.409+0000 7fe975000640 1 -- 172.21.15.27:0/3824430890 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9701a0120 con 0x7fe970103180 2024-09-13T18:03:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.409+0000 7fe967400640 1 -- 172.21.15.27:0/3824430890 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800f7e0 con 0x7fe970103180 2024-09-13T18:03:52.413 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.409+0000 7fe975000640 1 -- 172.21.15.27:0/3824430890 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9701a0680 con 0x7fe970103180 2024-09-13T18:03:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.412+0000 7fe977e5f740 1 Processor -- start 2024-09-13T18:03:52.414 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.412+0000 7fe977e5f740 1 -- start start 2024-09-13T18:03:52.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.412+0000 7fe967400640 1 -- 172.21.15.27:0/3824430890 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe958010ad0 con 0x7fe970103180 2024-09-13T18:03:52.415 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.412+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.412+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x5594041c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.412+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe977e5f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940412dab0 con 0x5594041c9500 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe977e5f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940412b240 con 0x5594041c3b30 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe977e5f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x559404126b30 con 0x5594041c4470 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96e800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:50612/0 (socket says 172.21.15.27:50612) 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96e800640 1 -- 172.21.15.27:0/1784284642 learned_addr learned my addr 172.21.15.27:0/1784284642 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe965400640 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96de00640 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x5594041c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96e800640 1 -- 172.21.15.27:0/1784284642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 msgr2=0x5594041c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96e800640 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x5594041c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.416 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96e800640 1 -- 172.21.15.27:0/1784284642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 msgr2=0x5594041cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96e800640 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96e800640 1 -- 172.21.15.27:0/1784284642 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594040f1bd0 con 0x5594041c3b30 2024-09-13T18:03:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe965400640 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.413+0000 7fe96e800640 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041c3f30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe968009ee0 tx=0x7fe968010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2478d0fe5e15ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe95f400640 1 -- 172.21.15.27:0/1784284642 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968004d20 con 0x5594041c3b30 2024-09-13T18:03:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe95f400640 1 -- 172.21.15.27:0/1784284642 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe968004e80 con 0x5594041c3b30 2024-09-13T18:03:52.417 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe95f400640 1 -- 172.21.15.27:0/1784284642 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968012910 con 0x5594041c3b30 2024-09-13T18:03:52.420 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe967400640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9540a1110 0x7fe9540a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe967400640 1 -- 172.21.15.27:0/3824430890 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe9580cc5e0 con 0x7fe970103180 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe977e5f740 1 -- 172.21.15.27:0/1784284642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 msgr2=0x5594041c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041c3f30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe968009ee0 tx=0x7fe968010740 comp rx=0 tx=0).stop 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe96de00640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9540a1110 0x7fe9540a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe977e5f740 1 -- 172.21.15.27:0/1784284642 shutdown_connections 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x5594041c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1784284642 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041c3f30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.414+0000 7fe977e5f740 1 -- 172.21.15.27:0/1784284642 >> 172.21.15.27:0/1784284642 conn(0x5594041bf1a0 msgr2=0x5594041bf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.415+0000 7fe977e5f740 1 -- 172.21.15.27:0/1784284642 shutdown_connections 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.415+0000 7fe977e5f740 1 -- 172.21.15.27:0/1784284642 wait complete. 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.415+0000 7fe977e5f740 1 -- start start 2024-09-13T18:03:52.421 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.415+0000 7fe96de00640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9540a1110 0x7fe9540a35d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe96002a9e0 tx=0x7fe960005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.415+0000 7fe977e5f740 1 Processor -- start 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x5594041cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041d4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe977e5f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594040c8260 con 0x5594041c9500 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe977e5f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594040c7f00 con 0x5594041c3b30 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe977e5f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x559403e8df20 con 0x5594041c4470 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe977e5f740 10 client.0 _ll_register_callbacks cb 0x5594041201a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe96e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041d4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe96e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041d4cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:32842/0 (socket says 172.21.15.27:32842) 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe96e800640 1 -- 172.21.15.27:0/3209201663 learned_addr learned my addr 172.21.15.27:0/3209201663 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.422 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe96de00640 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe965400640 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x5594041cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe96e800640 1 -- 172.21.15.27:0/3209201663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 msgr2=0x5594041cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.416+0000 7fe96e800640 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x5594041cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe96e800640 1 -- 172.21.15.27:0/3209201663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 msgr2=0x5594041cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe96e800640 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe96e800640 1 -- 172.21.15.27:0/3209201663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe968009b40 con 0x5594041c9500 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe96de00640 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe96e800640 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041d4cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe968006010 tx=0x7fe968004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77d0f0888da7b5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe953e00640 10 client.0 ms_handle_connect on v2:172.21.15.27:3300/0 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe953e00640 1 -- 172.21.15.27:0/3209201663 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96801e070 con 0x5594041c9500 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe953e00640 1 -- 172.21.15.27:0/3209201663 <== mon.0 v2:172.21.15.27:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe968005410 con 0x5594041c9500 2024-09-13T18:03:52.423 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe977e5f740 1 -- 172.21.15.27:0/3209201663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559403e1a3c0 con 0x5594041c9500 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.417+0000 7fe953e00640 1 -- 172.21.15.27:0/3209201663 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9680055d0 con 0x5594041c9500 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe977e5f740 10 client.15207 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe977e5f740 1 -- 172.21.15.27:0/3209201663 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5594041251b0 con 0x5594041c9500 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe953e00640 1 -- 172.21.15.27:0/3209201663 <== mon.0 v2:172.21.15.27:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559403e1a3c0 con 0x5594041c9500 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe953e00640 1 -- 172.21.15.27:0/3209201663 <== mon.0 v2:172.21.15.27:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe968024760 con 0x5594041c9500 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe977e5f740 10 client.15207 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe977e5f740 10 client.15207 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe977e5f740 20 client.15207 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe977e5f740 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x5594041d9a00 0x5594041ddb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.424 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe977e5f740 4 client.15207 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:03:52.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe977e5f740 1 -- 172.21.15.27:0/3209201663 --> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559403e2b6c0 con 0x5594041d9a00 2024-09-13T18:03:52.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.418+0000 7fe96de00640 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x5594041d9a00 0x5594041ddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.419+0000 7fe96de00640 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x5594041d9a00 0x5594041ddb80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1798b9bff95f254 server_cookie=b483534e619a068b in_seq=0 out_seq=0 2024-09-13T18:03:52.425 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.419+0000 7fe953e00640 10 client.15207 ms_handle_connect on v2:172.21.15.122:6838/1102491877 2024-09-13T18:03:52.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe953e00640 1 -- 172.21.15.27:0/3209201663 <== mds.0 v2:172.21.15.122:6838/1102491877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x559403e2b6c0 con 0x5594041d9a00 2024-09-13T18:03:52.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe953e00640 10 client.15207 handle_command_reply: tid=0 2024-09-13T18:03:52.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 client.15207 shutdown 2024-09-13T18:03:52.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 -- 172.21.15.27:0/3209201663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 msgr2=0x5594041d4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041d4cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe968006010 tx=0x7fe968004c70 comp rx=0 tx=0).stop 2024-09-13T18:03:52.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 -- 172.21.15.27:0/3209201663 shutdown_connections 2024-09-13T18:03:52.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x5594041d9a00 0x5594041ddb80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.426 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c9500 0x5594041d4cc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x5594041cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 --2- 172.21.15.27:0/3209201663 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041c3b30 0x5594041cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 -- 172.21.15.27:0/3209201663 >> 172.21.15.27:0/3209201663 conn(0x5594041bf1a0 msgr2=0x5594041c09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe953e00640 0 client.15207 ms_handle_reset on v2:172.21.15.122:6838/1102491877 2024-09-13T18:03:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 -- 172.21.15.27:0/3209201663 shutdown_connections 2024-09-13T18:03:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 1 -- 172.21.15.27:0/3209201663 wait complete. 2024-09-13T18:03:52.427 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.420+0000 7fe977e5f740 20 client.15207 trim_cache size 0 max 16384 2024-09-13T18:03:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe977e5f740 1 Processor -- start 2024-09-13T18:03:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe977e5f740 1 -- start start 2024-09-13T18:03:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c3b30 0x5594041d4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c4470 0x5594041e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe977e5f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594041c4d30 con 0x5594041c4470 2024-09-13T18:03:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe977e5f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594041b3d80 con 0x5594041bf1a0 2024-09-13T18:03:52.438 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe977e5f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594041c5970 con 0x5594041c3b30 2024-09-13T18:03:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe96de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe96e800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c4470 0x5594041e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe96de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:50620/0 (socket says 172.21.15.27:50620) 2024-09-13T18:03:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe96de00640 1 -- 172.21.15.27:0/2107705672 learned_addr learned my addr 172.21.15.27:0/2107705672 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.436+0000 7fe965400640 1 --2- 172.21.15.27:0/2107705672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c3b30 0x5594041d4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe96de00640 1 -- 172.21.15.27:0/2107705672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c3b30 msgr2=0x5594041d4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe96de00640 1 --2- 172.21.15.27:0/2107705672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c3b30 0x5594041d4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe96de00640 1 -- 172.21.15.27:0/2107705672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c4470 msgr2=0x5594041e1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.440 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe96de00640 1 --2- 172.21.15.27:0/2107705672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c4470 0x5594041e1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe96de00640 1 -- 172.21.15.27:0/2107705672 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594040c7470 con 0x5594041bf1a0 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe965400640 1 --2- 172.21.15.27:0/2107705672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c3b30 0x5594041d4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe96de00640 1 --2- 172.21.15.27:0/2107705672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041cdc00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe960009900 tx=0x7fe96003f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94776c9187163a64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe95fe00640 1 -- 172.21.15.27:0/2107705672 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96004f070 con 0x5594041bf1a0 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe95fe00640 1 -- 172.21.15.27:0/2107705672 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe960041070 con 0x5594041bf1a0 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.437+0000 7fe95fe00640 1 -- 172.21.15.27:0/2107705672 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960050860 con 0x5594041bf1a0 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 -- 172.21.15.27:0/2107705672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 msgr2=0x5594041cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 --2- 172.21.15.27:0/2107705672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041cdc00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe960009900 tx=0x7fe96003f000 comp rx=0 tx=0).stop 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 -- 172.21.15.27:0/2107705672 shutdown_connections 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 --2- 172.21.15.27:0/2107705672 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c4470 0x5594041e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 --2- 172.21.15.27:0/2107705672 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c3b30 0x5594041d4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 --2- 172.21.15.27:0/2107705672 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041cdc00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 -- 172.21.15.27:0/2107705672 >> 172.21.15.27:0/2107705672 conn(0x5594041cbc60 msgr2=0x5594041cd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.441 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 -- 172.21.15.27:0/2107705672 shutdown_connections 2024-09-13T18:03:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 -- 172.21.15.27:0/2107705672 wait complete. 2024-09-13T18:03:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 -- start start 2024-09-13T18:03:52.442 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.438+0000 7fe977e5f740 1 Processor -- start 2024-09-13T18:03:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041d1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c3b30 0x5594041d1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe977e5f740 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x55940422f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe977e5f740 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594041d2650 con 0x5594041c3b30 2024-09-13T18:03:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe977e5f740 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940422fd80 con 0x5594041bf1a0 2024-09-13T18:03:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe977e5f740 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940422fec0 con 0x5594041c4470 2024-09-13T18:03:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe977e5f740 10 client.0 _ll_register_callbacks cb 0x7fe960009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:03:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe96de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041d1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.445 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe965400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c3b30 0x5594041d1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe96de00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041d1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:50632/0 (socket says 172.21.15.27:50632) 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe96de00640 1 -- 172.21.15.27:0/1777699432 learned_addr learned my addr 172.21.15.27:0/1777699432 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe96e800640 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x55940422f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe96de00640 1 -- 172.21.15.27:0/1777699432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 msgr2=0x55940422f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe96de00640 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x55940422f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe96de00640 1 -- 172.21.15.27:0/1777699432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c3b30 msgr2=0x5594041d1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe96de00640 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c3b30 0x5594041d1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe96de00640 1 -- 172.21.15.27:0/1777699432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97010acd0 con 0x5594041bf1a0 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.439+0000 7fe965400640 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c3b30 0x5594041d1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.440+0000 7fe96de00640 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041d1a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe960054040 tx=0x7fe960032b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d561df03436cace1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.440+0000 7fe953e00640 10 client.0 ms_handle_connect on v2:172.21.15.122:3300/0 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.440+0000 7fe953e00640 1 -- 172.21.15.27:0/1777699432 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96004f050 con 0x5594041bf1a0 2024-09-13T18:03:52.446 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.440+0000 7fe977e5f740 1 -- 172.21.15.27:0/1777699432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559404150cd0 con 0x5594041bf1a0 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.440+0000 7fe953e00640 1 -- 172.21.15.27:0/1777699432 <== mon.2 v2:172.21.15.122:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe960043070 con 0x5594041bf1a0 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.440+0000 7fe953e00640 1 -- 172.21.15.27:0/1777699432 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9600507e0 con 0x5594041bf1a0 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.440+0000 7fe977e5f740 10 client.25265 fetch_fsmap learned FSMap version 26 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.440+0000 7fe977e5f740 1 -- 172.21.15.27:0/1777699432 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5594040ec980 con 0x5594041bf1a0 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.441+0000 7fe953e00640 1 -- 172.21.15.27:0/1777699432 <== mon.2 v2:172.21.15.122:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559404150cd0 con 0x5594041bf1a0 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.441+0000 7fe953e00640 1 -- 172.21.15.27:0/1777699432 <== mon.2 v2:172.21.15.122:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe960046030 con 0x5594041bf1a0 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.441+0000 7fe977e5f740 10 client.25265 fetch_fsmap finished waiting for FSMap version 26 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.441+0000 7fe977e5f740 10 client.25265 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.441+0000 7fe977e5f740 20 client.25265 populate_metadata read hostname 'smithi027' 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.441+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x5594041c9500 0x559404231690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.441+0000 7fe977e5f740 4 client.25265 mds_command: new command op to 24584 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.441+0000 7fe977e5f740 1 -- 172.21.15.27:0/1777699432 --> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559403e7ed10 con 0x5594041c9500 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.441+0000 7fe965400640 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x5594041c9500 0x559404231690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:52.447 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe965400640 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x5594041c9500 0x559404231690 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd4aed02aef42d4a server_cookie=47ac14eec675688e in_seq=0 out_seq=0 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe953e00640 10 client.25265 ms_handle_connect on v2:172.21.15.122:6838/1102491877 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe953e00640 1 -- 172.21.15.27:0/1777699432 <== mds.0 v2:172.21.15.122:6838/1102491877 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x559403e7ed10 con 0x5594041c9500 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe953e00640 10 client.25265 handle_command_reply: tid=0 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 client.25265 shutdown 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 -- 172.21.15.27:0/1777699432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 msgr2=0x5594041d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041d1a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe960054040 tx=0x7fe960032b80 comp rx=0 tx=0).stop 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 -- 172.21.15.27:0/1777699432 shutdown_connections 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x5594041c4470 0x55940422f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.122:6838/1102491877,v1:172.21.15.122:6839/1102491877] conn(0x5594041c9500 0x559404231690 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x5594041c3b30 0x5594041d1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 --2- 172.21.15.27:0/1777699432 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x5594041bf1a0 0x5594041d1a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 -- 172.21.15.27:0/1777699432 >> 172.21.15.27:0/1777699432 conn(0x5594041cbc60 msgr2=0x5594041c8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.448 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe953e00640 0 client.25265 ms_handle_reset on v2:172.21.15.122:6838/1102491877 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 -- 172.21.15.27:0/1777699432 shutdown_connections 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 1 -- 172.21.15.27:0/1777699432 wait complete. 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.442+0000 7fe977e5f740 20 client.25265 trim_cache size 0 max 16384 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stdout: "cluster_fsid": "f5527e2e-71f8-11ef-bceb-c7b262605968", 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stdout: "whoami": 0, 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 24584, 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stdout: "want_state": "up:active", 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stdout: "state": "up:active", 2024-09-13T18:03:52.449 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs", 2024-09-13T18:03:52.450 INFO:teuthology.orchestra.run.smithi027.stdout: "rank_uptime": 126.118476957, 2024-09-13T18:03:52.450 INFO:teuthology.orchestra.run.smithi027.stdout: "mdsmap_epoch": 26, 2024-09-13T18:03:52.450 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch": 88, 2024-09-13T18:03:52.450 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_epoch_barrier": 86, 2024-09-13T18:03:52.450 INFO:teuthology.orchestra.run.smithi027.stdout: "uptime": 132.38008157799999 2024-09-13T18:03:52.450 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:03:52.450 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 -- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9540a1110 msgr2=0x7fe9540a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9540a1110 0x7fe9540a35d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe96002a9e0 tx=0x7fe960005b50 comp rx=0 tx=0).stop 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 -- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970103180 msgr2=0x7fe970198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970103180 0x7fe970198560 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe95800d950 tx=0x7fe95800de10 comp rx=0 tx=0).stop 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 -- 172.21.15.27:0/3824430890 shutdown_connections 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe9540a1110 0x7fe9540a35d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe970103b40 0x7fe97019f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe970103180 0x7fe970198560 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 --2- 172.21.15.27:0/3824430890 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe970101f90 0x7fe970198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 -- 172.21.15.27:0/3824430890 >> 172.21.15.27:0/3824430890 conn(0x7fe9700fd6d0 msgr2=0x7fe9701065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 -- 172.21.15.27:0/3824430890 shutdown_connections 2024-09-13T18:03:52.451 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:52.443+0000 7fe975000640 1 -- 172.21.15.27:0/3824430890 wait complete. 2024-09-13T18:03:52.460 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:03:52.469 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:03:52.469 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:03:52.469 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:03:52.469 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T18:03:52.492 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T18:03:52.492 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-13T18:03:52.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:52.493 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-09-13T18:03:52.493 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:52 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2905997274' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:52.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:52 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2905997274' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:03:52.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:52.529 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2024-09-13T18:03:52.631 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2024-09-13T18:03:52.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:03:52.635 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'rbytes': False, 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-13T18:03:52.635 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:03:52.635 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:03:52.635 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T18:03:52.960 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:03:53.425 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:53 smithi027 ceph-mon[30611]: pgmap v356: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:03:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:53 smithi122 ceph-mon[35310]: pgmap v356: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:03:53.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:53 smithi143 ceph-mon[38210]: pgmap v356: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.921+0000 7f1c43e00640 1 -- 172.21.15.27:0/172203077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c107330 msgr2=0x7f1c3c10eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.921+0000 7f1c43e00640 1 --2- 172.21.15.27:0/172203077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c107330 0x7f1c3c10eeb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009890 tx=0x7f1c3402a360 comp rx=0 tx=0).stop 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.921+0000 7f1c43e00640 1 -- 172.21.15.27:0/172203077 shutdown_connections 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.921+0000 7f1c43e00640 1 --2- 172.21.15.27:0/172203077 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c107330 0x7f1c3c10eeb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.921+0000 7f1c43e00640 1 --2- 172.21.15.27:0/172203077 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c102bb0 0x7f1c3c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.921+0000 7f1c43e00640 1 --2- 172.21.15.27:0/172203077 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3c102200 0x7f1c3c1025e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.921+0000 7f1c43e00640 1 -- 172.21.15.27:0/172203077 >> 172.21.15.27:0/172203077 conn(0x7f1c3c0fdc60 msgr2=0x7f1c3c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.921+0000 7f1c43e00640 1 -- 172.21.15.27:0/172203077 shutdown_connections 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.921+0000 7f1c43e00640 1 -- 172.21.15.27:0/172203077 wait complete. 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.922+0000 7f1c43e00640 1 Processor -- start 2024-09-13T18:03:55.052 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c43e00640 1 -- start start 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c43e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c102200 0x7f1c3c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c43e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3c102bb0 0x7f1c3c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c43e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c107330 0x7f1c3c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c43e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c19d460 con 0x7f1c3c107330 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c43e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c19d5d0 con 0x7f1c3c102200 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c43e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c19d740 con 0x7f1c3c102bb0 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c41400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c102200 0x7f1c3c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c41e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c107330 0x7f1c3c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c41400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c102200 0x7f1c3c198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:50648/0 (socket says 172.21.15.27:50648) 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c41400640 1 -- 172.21.15.27:0/4082552399 learned_addr learned my addr 172.21.15.27:0/4082552399 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.923+0000 7f1c40a00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3c102bb0 0x7f1c3c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c41e00640 1 -- 172.21.15.27:0/4082552399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3c102bb0 msgr2=0x7f1c3c198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:55.053 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c41e00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3c102bb0 0x7f1c3c198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c41e00640 1 -- 172.21.15.27:0/4082552399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c102200 msgr2=0x7f1c3c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c41e00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c102200 0x7f1c3c198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c41e00640 1 -- 172.21.15.27:0/4082552399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c34009490 con 0x7f1c3c107330 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c41400640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c102200 0x7f1c3c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c41e00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c107330 0x7f1c3c19ce60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c3402a950 tx=0x7f1c34030f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c3a000640 1 -- 172.21.15.27:0/4082552399 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34030840 con 0x7f1c3c107330 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c3a000640 1 -- 172.21.15.27:0/4082552399 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1c34033e30 con 0x7f1c3c107330 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c3a000640 1 -- 172.21.15.27:0/4082552399 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34003d20 con 0x7f1c3c107330 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.924+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3c19d9c0 con 0x7f1c3c107330 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.925+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c1a5110 con 0x7f1c3c107330 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.926+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c1036e0 con 0x7f1c3c107330 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.927+0000 7f1c3a000640 1 -- 172.21.15.27:0/4082552399 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1c34039040 con 0x7f1c3c107330 2024-09-13T18:03:55.054 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.929+0000 7f1c3a000640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1c240a1100 0x7f1c240a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:55.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.929+0000 7f1c3a000640 1 -- 172.21.15.27:0/4082552399 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1c340ece00 con 0x7f1c3c107330 2024-09-13T18:03:55.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.929+0000 7f1c41400640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1c240a1100 0x7f1c240a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:55.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.930+0000 7f1c41400640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1c240a1100 0x7f1c240a35c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000f7d0 tx=0x7f1c30009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:55.055 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:54.933+0000 7f1c3a000640 1 -- 172.21.15.27:0/4082552399 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1c340b65a0 con 0x7f1c3c107330 2024-09-13T18:03:55.156 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.154+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c3c1025e0 con 0x7f1c3c107330 2024-09-13T18:03:55.157 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.155+0000 7f1c3a000640 1 -- 172.21.15.27:0/4082552399 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1c34037060 con 0x7f1c3c107330 2024-09-13T18:03:55.157 INFO:teuthology.orchestra.run.smithi027.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:03:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1c240a1100 msgr2=0x7f1c240a35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1c240a1100 0x7f1c240a35c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000f7d0 tx=0x7f1c30009500 comp rx=0 tx=0).stop 2024-09-13T18:03:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c107330 msgr2=0x7f1c3c19ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:55.159 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c107330 0x7f1c3c19ce60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1c3402a950 tx=0x7f1c34030f80 comp rx=0 tx=0).stop 2024-09-13T18:03:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 shutdown_connections 2024-09-13T18:03:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f1c240a1100 0x7f1c240a35c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1c3c107330 0x7f1c3c19ce60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f1c3c102bb0 0x7f1c3c198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 --2- 172.21.15.27:0/4082552399 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1c3c102200 0x7f1c3c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 >> 172.21.15.27:0/4082552399 conn(0x7f1c3c0fdc60 msgr2=0x7f1c3c0ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 shutdown_connections 2024-09-13T18:03:55.160 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:55.157+0000 7f1c43e00640 1 -- 172.21.15.27:0/4082552399 wait complete. 2024-09-13T18:03:55.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:55 smithi027 ceph-mon[30611]: pgmap v357: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-13T18:03:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:55 smithi122 ceph-mon[35310]: pgmap v357: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-13T18:03:55.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:55 smithi143 ceph-mon[38210]: pgmap v357: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 12 op/s 2024-09-13T18:03:55.954 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:03:55.954 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:03:55.954 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2024-09-13T18:03:55.954 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:03:55.954 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:03:55.954 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:03:55.954 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:03:55.954 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:03:55.955 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:03:55.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:55.955 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2024-09-13T18:03:55.993 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:03:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:03:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:03:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:03:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2024-09-13T18:03:55.993 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f0 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f1 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f0 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42104sec preferred_lft 42104sec 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:03:55.994 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2024-09-13T18:03:55.995 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f1 2024-09-13T18:03:55.995 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:03:55.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:55.995 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-09-13T18:03:55.995 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-13T18:03:55.995 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:03:55.995 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr flush dev ceph-brx 2024-09-13T18:03:55.995 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set ceph-brx up 2024-09-13T18:03:55.995 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:03:55.996 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-13T18:03:56.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:56 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/4082552399' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:03:56.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:56.407 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:03:56.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:56 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/4082552399' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:03:56.467 INFO:teuthology.orchestra.run.smithi027.stdout:1 2024-09-13T18:03:56.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:56.470 DEBUG:teuthology.orchestra.run.smithi027:> route 2024-09-13T18:03:56.521 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2024-09-13T18:03:56.522 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:03:56.522 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-13T18:03:56.522 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-13T18:03:56.522 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:03:56.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:56.522 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-09-13T18:03:56.522 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-13T18:03:56.522 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T18:03:56.523 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T18:03:56.523 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T18:03:56.523 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-13T18:03:56.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:56 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/4082552399' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T18:03:57.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:57.107 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-09-13T18:03:57.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:57.143 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2024-09-13T18:03:57.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:57.221 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-09-13T18:03:57.221 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-13T18:03:57.221 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:03:57.221 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:03:57.221 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-13T18:03:57.350 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:03:57.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:57.351 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-09-13T18:03:57.351 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-13T18:03:57.351 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:03:57.351 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:03:57.351 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:03:57.351 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:03:57.351 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:03:57.351 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-13T18:03:57.404 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:57 smithi027 ceph-mon[30611]: pgmap v358: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:03:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:57 smithi122 ceph-mon[35310]: pgmap v358: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:03:57.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:57 smithi143 ceph-mon[38210]: pgmap v358: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:03:57.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:57.556 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2024-09-13T18:03:57.556 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2024-09-13T18:03:57.556 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2024-09-13T18:03:57.556 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:03:57.556 DEBUG:teuthology.orchestra.run.smithi027:> ') 2024-09-13T18:03:57.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:03:57.675 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:03:57.711 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:03:57.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:03:57.711 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:03:57.786 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-13T18:03:57.786 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-13T18:03:57.786 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/86d1e91a-8df4-474f-9b97-2d9090f9f3e5 2024-09-13T18:03:57.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:57.786 DEBUG:teuthology.orchestra.run.smithi027:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/86d1e91a-8df4-474f-9b97-2d9090f9f3e5 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-13T18:03:57.928 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-13T18:03:57.929 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-13T18:03:58.566 INFO:teuthology.orchestra.run.smithi027.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-13T18:03:58.566 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-13T18:03:58.566 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: resolved to: "172.21.15.27:3300,172.21.15.122:3300,172.21.15.143:3300" 2024-09-13T18:03:58.566 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: trying mount with new device syntax: 0@f5527e2e-71f8-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/86d1e91a-8df4-474f-9b97-2d9090f9f3e5 2024-09-13T18:03:58.566 INFO:teuthology.orchestra.run.smithi027.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.27:3300/172.21.15.122:3300/172.21.15.143:3300" will pass to kernel 2024-09-13T18:03:58.568 INFO:teuthology.orchestra.run.smithi027.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:03:58.568 INFO:teuthology.orchestra.run.smithi027.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:03:58.568 INFO:teuthology.orchestra.run.smithi027.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:03:58.568 INFO:teuthology.orchestra.run.smithi027.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:03:58.568 INFO:teuthology.orchestra.run.smithi027.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:03:58.572 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:03:58.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:58.572 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:03:58.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:58.632 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:03:58.672 INFO:teuthology.orchestra.run.smithi027.stdout:client25274 2024-09-13T18:03:58.672 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T18:03:58.672 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:03:58.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:58.749 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:03:58.829 INFO:teuthology.orchestra.run.smithi027.stdout:client25274 2024-09-13T18:03:58.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:58.830 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:03:58.909 INFO:teuthology.orchestra.run.smithi027.stdout:client25274 2024-09-13T18:03:58.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:03:58.910 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968.client25274/status') 2024-09-13T18:03:59.007 INFO:teuthology.orchestra.run.smithi027.stdout:instance: client.25274 (3)172.21.15.27:0/2459375879 2024-09-13T18:03:59.007 INFO:teuthology.orchestra.run.smithi027.stdout:blocklisted: false 2024-09-13T18:03:59.007 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records in 2024-09-13T18:03:59.007 INFO:teuthology.orchestra.run.smithi027.stderr:0+1 records out 2024-09-13T18:03:59.007 INFO:teuthology.orchestra.run.smithi027.stderr:71 bytes copied, 5.9747e-05 s, 1.2 MB/s 2024-09-13T18:03:59.010 INFO:teuthology.run_tasks:Running task exec... 2024-09-13T18:03:59.021 INFO:teuthology.task.exec:Executing custom commands... 2024-09-13T18:03:59.021 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi027.front.sepia.ceph.com 2024-09-13T18:03:59.021 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-13T18:03:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.177+0000 7fde5d200640 1 -- 172.21.15.27:0/2911100689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58074e70 msgr2=0x7fde58075270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.177+0000 7fde5d200640 1 --2- 172.21.15.27:0/2911100689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58074e70 0x7fde58075270 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fde48009900 tx=0x7fde4802a410 comp rx=0 tx=0).stop 2024-09-13T18:03:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.177+0000 7fde5d200640 1 -- 172.21.15.27:0/2911100689 shutdown_connections 2024-09-13T18:03:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.177+0000 7fde5d200640 1 --2- 172.21.15.27:0/2911100689 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde58076a50 0x7fde580772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:59.179 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.177+0000 7fde5d200640 1 --2- 172.21.15.27:0/2911100689 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde580760b0 0x7fde58076510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.177+0000 7fde5d200640 1 --2- 172.21.15.27:0/2911100689 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58074e70 0x7fde58075270 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.177+0000 7fde5d200640 1 -- 172.21.15.27:0/2911100689 >> 172.21.15.27:0/2911100689 conn(0x7fde580fd6b0 msgr2=0x7fde580ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:03:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.177+0000 7fde5d200640 1 -- 172.21.15.27:0/2911100689 shutdown_connections 2024-09-13T18:03:59.180 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.177+0000 7fde5d200640 1 -- 172.21.15.27:0/2911100689 wait complete. 2024-09-13T18:03:59.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.178+0000 7fde5d200640 1 Processor -- start 2024-09-13T18:03:59.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.178+0000 7fde5d200640 1 -- start start 2024-09-13T18:03:59.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.178+0000 7fde5d200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde58074e70 0x7fde5819c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:59.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.178+0000 7fde5d200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde580760b0 0x7fde5819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:59.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.178+0000 7fde5d200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58076a50 0x7fde581a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:59.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.178+0000 7fde5d200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581a3f40 con 0x7fde58076a50 2024-09-13T18:03:59.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.178+0000 7fde5d200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581a40b0 con 0x7fde58074e70 2024-09-13T18:03:59.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.178+0000 7fde5d200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde581a4270 con 0x7fde580760b0 2024-09-13T18:03:59.182 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde580760b0 0x7fde5819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde56800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58076a50 0x7fde581a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde580760b0 0x7fde5819c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:40902/0 (socket says 172.21.15.27:40902) 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55400640 1 -- 172.21.15.27:0/1117542522 learned_addr learned my addr 172.21.15.27:0/1117542522 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55e00640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde58074e70 0x7fde5819c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55400640 1 -- 172.21.15.27:0/1117542522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde58074e70 msgr2=0x7fde5819c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55400640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde58074e70 0x7fde5819c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55400640 1 -- 172.21.15.27:0/1117542522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58076a50 msgr2=0x7fde581a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55400640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58076a50 0x7fde581a3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55400640 1 -- 172.21.15.27:0/1117542522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48009560 con 0x7fde580760b0 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55e00640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde58074e70 0x7fde5819c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.179+0000 7fde55400640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde580760b0 0x7fde5819c990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fde4400e9f0 tx=0x7fde4400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.180+0000 7fde4ea00640 1 -- 172.21.15.27:0/1117542522 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44009720 con 0x7fde580760b0 2024-09-13T18:03:59.183 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.180+0000 7fde4ea00640 1 -- 172.21.15.27:0/1117542522 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fde4400cd80 con 0x7fde580760b0 2024-09-13T18:03:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.180+0000 7fde4ea00640 1 -- 172.21.15.27:0/1117542522 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44010690 con 0x7fde580760b0 2024-09-13T18:03:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.180+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde581a4550 con 0x7fde580760b0 2024-09-13T18:03:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.180+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde581a4a10 con 0x7fde580760b0 2024-09-13T18:03:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.181+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5810ead0 con 0x7fde580760b0 2024-09-13T18:03:59.184 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.183+0000 7fde4ea00640 1 -- 172.21.15.27:0/1117542522 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fde440046c0 con 0x7fde580760b0 2024-09-13T18:03:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.184+0000 7fde4ea00640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1110 0x7fde3c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:03:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.184+0000 7fde4ea00640 1 -- 172.21.15.27:0/1117542522 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fde44014070 con 0x7fde580760b0 2024-09-13T18:03:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.184+0000 7fde55e00640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1110 0x7fde3c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:03:59.186 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.185+0000 7fde55e00640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1110 0x7fde3c0a35d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fde48006010 tx=0x7fde48000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:03:59.188 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.186+0000 7fde4ea00640 1 -- 172.21.15.27:0/1117542522 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fde44096c10 con 0x7fde580760b0 2024-09-13T18:03:59.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:03:59 smithi027 ceph-mon[30611]: pgmap v359: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:03:59.409 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:03:59.408+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7fde58111db0 con 0x7fde580760b0 2024-09-13T18:03:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:03:59 smithi122 ceph-mon[35310]: pgmap v359: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:03:59.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:03:59 smithi143 ceph-mon[38210]: pgmap v359: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:04:00.164 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.162+0000 7fde4ea00640 1 -- 172.21.15.27:0/1117542522 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7fde4409a230 con 0x7fde580760b0 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1110 msgr2=0x7fde3c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1110 0x7fde3c0a35d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fde48006010 tx=0x7fde48000bc0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde580760b0 msgr2=0x7fde5819c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde580760b0 0x7fde5819c990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fde4400e9f0 tx=0x7fde4400edf0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 shutdown_connections 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde3c0a1110 0x7fde3c0a35d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde58076a50 0x7fde581a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde580760b0 0x7fde5819c990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 --2- 172.21.15.27:0/1117542522 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde58074e70 0x7fde5819c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 >> 172.21.15.27:0/1117542522 conn(0x7fde580fd6b0 msgr2=0x7fde580fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 shutdown_connections 2024-09-13T18:04:00.167 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.165+0000 7fde5d200640 1 -- 172.21.15.27:0/1117542522 wait complete. 2024-09-13T18:04:00.185 DEBUG:teuthology.orchestra.run.smithi027:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-13T18:04:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.343+0000 7f8396400640 1 -- 172.21.15.27:0/798835092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 msgr2=0x7f839010a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:04:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.343+0000 7f8396400640 1 --2- 172.21.15.27:0/798835092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 0x7f839010a1b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8388009be0 tx=0x7f838802a6c0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.344+0000 7f8396400640 1 -- 172.21.15.27:0/798835092 shutdown_connections 2024-09-13T18:04:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.344+0000 7f8396400640 1 --2- 172.21.15.27:0/798835092 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 0x7f839010a1b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.344+0000 7f8396400640 1 --2- 172.21.15.27:0/798835092 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8390102f60 0x7f83901033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.344+0000 7f8396400640 1 --2- 172.21.15.27:0/798835092 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8390101d70 0x7f8390102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.344+0000 7f8396400640 1 -- 172.21.15.27:0/798835092 >> 172.21.15.27:0/798835092 conn(0x7f83900fd4d0 msgr2=0x7f83900ff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:04:00.346 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.344+0000 7f8396400640 1 -- 172.21.15.27:0/798835092 shutdown_connections 2024-09-13T18:04:00.347 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.344+0000 7f8396400640 1 -- 172.21.15.27:0/798835092 wait complete. 2024-09-13T18:04:00.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8396400640 1 Processor -- start 2024-09-13T18:04:00.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8396400640 1 -- start start 2024-09-13T18:04:00.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8396400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8390101d70 0x7f8390197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:04:00.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8396400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8390102f60 0x7f8390198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:04:00.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8396400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 0x7f839019f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:04:00.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8396400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839019f820 con 0x7f8390102f60 2024-09-13T18:04:00.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8396400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839019f990 con 0x7f8390103920 2024-09-13T18:04:00.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8396400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839019fb50 con 0x7f8390101d70 2024-09-13T18:04:00.349 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f838fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8390102f60 0x7f8390198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8395a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 0x7f839019f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8395a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 0x7f839019f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:46568/0 (socket says 172.21.15.27:46568) 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8395a00640 1 -- 172.21.15.27:0/3350393116 learned_addr learned my addr 172.21.15.27:0/3350393116 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.345+0000 7f8395000640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8390101d70 0x7f8390197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f8395a00640 1 -- 172.21.15.27:0/3350393116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8390101d70 msgr2=0x7f8390197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f8395a00640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8390101d70 0x7f8390197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f8395a00640 1 -- 172.21.15.27:0/3350393116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8390102f60 msgr2=0x7f8390198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f8395a00640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8390102f60 0x7f8390198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f8395a00640 1 -- 172.21.15.27:0/3350393116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8384009560 con 0x7f8390103920 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f8395000640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8390101d70 0x7f8390197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f8395a00640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 0x7f839019f2b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8388034040 tx=0x7f8388031000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f838d600640 1 -- 172.21.15.27:0/3350393116 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388003db0 con 0x7f8390103920 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f838d600640 1 -- 172.21.15.27:0/3350393116 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8388004520 con 0x7f8390103920 2024-09-13T18:04:00.350 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8388009840 con 0x7f8390103920 2024-09-13T18:04:00.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.346+0000 7f838d600640 1 -- 172.21.15.27:0/3350393116 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388031bb0 con 0x7f8390103920 2024-09-13T18:04:00.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.347+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83901a0140 con 0x7f8390103920 2024-09-13T18:04:00.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.347+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8390109110 con 0x7f8390103920 2024-09-13T18:04:00.351 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.349+0000 7f838d600640 1 -- 172.21.15.27:0/3350393116 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 18) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8388038070 con 0x7f8390103920 2024-09-13T18:04:00.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.351+0000 7f838d600640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83780a11b0 0x7f83780a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:04:00.352 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.351+0000 7f838d600640 1 -- 172.21.15.27:0/3350393116 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f83880ecfe0 con 0x7f8390103920 2024-09-13T18:04:00.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.351+0000 7f8395000640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83780a11b0 0x7f83780a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:04:00.353 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.351+0000 7f8395000640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83780a11b0 0x7f83780a3670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8390199210 tx=0x7f8384009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:04:00.356 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.355+0000 7f838d600640 1 -- 172.21.15.27:0/3350393116 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f83880b6690 con 0x7f8390103920 2024-09-13T18:04:00.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:00 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1117542522' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T18:04:00.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:00 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T18:04:00.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:00 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1117542522' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T18:04:00.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:00 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T18:04:00.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:00 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1117542522' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T18:04:00.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:00 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-13T18:04:00.563 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.561+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 --> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7f839002c590 con 0x7f83780a11b0 2024-09-13T18:04:00.591 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.589+0000 7f838d600640 1 -- 172.21.15.27:0/3350393116 <== mgr.14150 v2:172.21.15.27:6800/3586663065 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f839002c590 con 0x7f83780a11b0 2024-09-13T18:04:00.591 INFO:teuthology.orchestra.run.smithi027.stdout:{} 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.591+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83780a11b0 msgr2=0x7f83780a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.591+0000 7f8396400640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83780a11b0 0x7f83780a3670 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8390199210 tx=0x7f8384009260 comp rx=0 tx=0).stop 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.591+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 msgr2=0x7f839019f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.591+0000 7f8396400640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 0x7f839019f2b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8388034040 tx=0x7f8388031000 comp rx=0 tx=0).stop 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.591+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 shutdown_connections 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.592+0000 7f8396400640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f83780a11b0 0x7f83780a3670 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.592+0000 7f8396400640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f8390103920 0x7f839019f2b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.592+0000 7f8396400640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f8390102f60 0x7f8390198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.592+0000 7f8396400640 1 --2- 172.21.15.27:0/3350393116 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f8390101d70 0x7f8390197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.592+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 >> 172.21.15.27:0/3350393116 conn(0x7f83900fd4d0 msgr2=0x7f83901062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:04:00.594 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.592+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 shutdown_connections 2024-09-13T18:04:00.595 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:04:00.592+0000 7f8396400640 1 -- 172.21.15.27:0/3350393116 wait complete. 2024-09-13T18:04:00.610 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-13T18:04:00.621 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T18:04:00.644 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:04:00.644 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:04:00.644 INFO:tasks.workunit:timeout=3h 2024-09-13T18:04:00.644 INFO:tasks.workunit:cleanup=True 2024-09-13T18:04:00.645 DEBUG:teuthology.orchestra.run.smithi027:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:04:00.681 INFO:teuthology.orchestra.run.smithi027.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T18:04:00.681 INFO:teuthology.orchestra.run.smithi027.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T18:04:00.682 INFO:teuthology.orchestra.run.smithi027.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-13T18:04:00.682 INFO:teuthology.orchestra.run.smithi027.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:04:00.682 INFO:teuthology.orchestra.run.smithi027.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T18:04:00.682 INFO:teuthology.orchestra.run.smithi027.stdout:Access: 2024-09-13 18:01:53.316933372 +0000 2024-09-13T18:04:00.682 INFO:teuthology.orchestra.run.smithi027.stdout:Modify: 2024-09-13 18:01:53.316933372 +0000 2024-09-13T18:04:00.682 INFO:teuthology.orchestra.run.smithi027.stdout:Change: 2024-09-13 18:03:58.625254405 +0000 2024-09-13T18:04:00.682 INFO:teuthology.orchestra.run.smithi027.stdout: Birth: 2024-09-13 18:01:53.316933372 +0000 2024-09-13T18:04:00.682 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:04:00.682 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T18:04:00.794 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:04:00.833 INFO:tasks.workunit.client.0.smithi027.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:04:01.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:04:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:04:00.567+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:04:01.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:04:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:04:00.567+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:04:01.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:04:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:04:00.567+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:04:01.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:04:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:04:00.567+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:04:01.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:04:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:04:00.567+0000 7f4e87e00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-13T18:04:01.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:01 smithi122 ceph-mon[35310]: pgmap v360: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:04:01.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:01 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-13T18:04:01.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:01 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:04:01.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:01 smithi143 ceph-mon[38210]: pgmap v360: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:04:01.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:01 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-13T18:04:01.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:01 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:04:01.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:01 smithi027 ceph-mon[30611]: pgmap v360: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:04:01.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:01 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-13T18:04:01.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:01 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:04:02.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:02 smithi122 ceph-mon[35310]: from='client.25286 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:04:02.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:02 smithi143 ceph-mon[38210]: from='client.25286 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:04:02.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:02 smithi027 ceph-mon[30611]: from='client.25286 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T18:04:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:03 smithi122 ceph-mon[35310]: pgmap v361: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:04:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:03 smithi122 ceph-mon[35310]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-13T18:04:03.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:03 smithi143 ceph-mon[38210]: pgmap v361: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:04:03.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:03 smithi143 ceph-mon[38210]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-13T18:04:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:03 smithi027 ceph-mon[30611]: pgmap v361: 97 pgs: 97 active+clean; 641 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:04:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:03 smithi027 ceph-mon[30611]: mgrmap e19: x(active, since 9m), standbys: z, y 2024-09-13T18:04:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:05 smithi122 ceph-mon[35310]: pgmap v362: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-13T18:04:05.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:05 smithi143 ceph-mon[38210]: pgmap v362: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-13T18:04:05.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:05 smithi027 ceph-mon[30611]: pgmap v362: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2024-09-13T18:04:07.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:07 smithi122 ceph-mon[35310]: pgmap v363: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-13T18:04:07.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:07 smithi143 ceph-mon[38210]: pgmap v363: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-13T18:04:07.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:07 smithi027 ceph-mon[30611]: pgmap v363: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 2.3 KiB/s wr, 10 op/s 2024-09-13T18:04:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:09 smithi122 ceph-mon[35310]: pgmap v364: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2024-09-13T18:04:09.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:09 smithi143 ceph-mon[38210]: pgmap v364: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2024-09-13T18:04:09.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:09 smithi027 ceph-mon[30611]: pgmap v364: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.4 KiB/s wr, 13 op/s 2024-09-13T18:04:10.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:10 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:04:10.482 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:10 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:04:10.533 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:10 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:04:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:11 smithi122 ceph-mon[35310]: pgmap v365: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-13T18:04:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:11 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:11 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:11 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:11 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:11 smithi143 ceph-mon[38210]: pgmap v365: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-13T18:04:11.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:11 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:11 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:11 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:11 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:11 smithi027 ceph-mon[30611]: pgmap v365: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.5 KiB/s wr, 12 op/s 2024-09-13T18:04:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:11 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:11 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:11 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:11.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:11 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:13.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:12 smithi027 ceph-mon[30611]: pgmap v366: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-13T18:04:13.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:13.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:13.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:04:13.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:04:13.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:13.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:12 smithi122 ceph-mon[35310]: pgmap v366: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-13T18:04:13.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:13.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:13.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:04:13.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:04:13.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:13.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:12 smithi143 ceph-mon[38210]: pgmap v366: 97 pgs: 97 active+clean; 656 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-09-13T18:04:13.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:13.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:13.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:04:13.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:04:13.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:04:15.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:14 smithi027 ceph-mon[30611]: pgmap v367: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-09-13T18:04:15.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:14 smithi122 ceph-mon[35310]: pgmap v367: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-09-13T18:04:15.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:14 smithi143 ceph-mon[38210]: pgmap v367: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 2.7 KiB/s wr, 14 op/s 2024-09-13T18:04:17.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:16 smithi027 ceph-mon[30611]: pgmap v368: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-13T18:04:17.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:16 smithi122 ceph-mon[35310]: pgmap v368: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-13T18:04:17.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:16 smithi143 ceph-mon[38210]: pgmap v368: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-13T18:04:19.056 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:18 smithi027 ceph-mon[30611]: pgmap v369: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T18:04:19.077 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:18 smithi143 ceph-mon[38210]: pgmap v369: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T18:04:19.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:18 smithi122 ceph-mon[35310]: pgmap v369: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-13T18:04:21.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:20 smithi122 ceph-mon[35310]: pgmap v370: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:04:21.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:20 smithi143 ceph-mon[38210]: pgmap v370: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:04:21.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:20 smithi027 ceph-mon[30611]: pgmap v370: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:04:23.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:22 smithi122 ceph-mon[35310]: pgmap v371: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-13T18:04:23.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:22 smithi143 ceph-mon[38210]: pgmap v371: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-13T18:04:23.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:22 smithi027 ceph-mon[30611]: pgmap v371: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-13T18:04:25.057 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:24 smithi027 ceph-mon[30611]: pgmap v372: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T18:04:25.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:24 smithi122 ceph-mon[35310]: pgmap v372: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T18:04:25.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:24 smithi143 ceph-mon[38210]: pgmap v372: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T18:04:27.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:26 smithi122 ceph-mon[35310]: pgmap v373: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:04:27.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:26 smithi143 ceph-mon[38210]: pgmap v373: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:04:27.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:26 smithi027 ceph-mon[30611]: pgmap v373: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:04:29.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:28 smithi122 ceph-mon[35310]: pgmap v374: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:04:29.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:28 smithi143 ceph-mon[38210]: pgmap v374: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:04:29.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:28 smithi027 ceph-mon[30611]: pgmap v374: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:04:31.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:30 smithi122 ceph-mon[35310]: pgmap v375: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:04:31.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:30 smithi143 ceph-mon[38210]: pgmap v375: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:04:31.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:30 smithi027 ceph-mon[30611]: pgmap v375: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:04:33.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:32 smithi122 ceph-mon[35310]: pgmap v376: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:04:33.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:32 smithi143 ceph-mon[38210]: pgmap v376: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:04:33.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:32 smithi027 ceph-mon[30611]: pgmap v376: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:04:35.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:34 smithi122 ceph-mon[35310]: pgmap v377: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:04:35.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:34 smithi143 ceph-mon[38210]: pgmap v377: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:04:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:34 smithi027 ceph-mon[30611]: pgmap v377: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 11 op/s 2024-09-13T18:04:37.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:36 smithi122 ceph-mon[35310]: pgmap v378: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:04:37.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:36 smithi143 ceph-mon[38210]: pgmap v378: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:04:37.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:36 smithi027 ceph-mon[30611]: pgmap v378: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-09-13T18:04:39.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:38 smithi122 ceph-mon[35310]: pgmap v379: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:04:39.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:38 smithi143 ceph-mon[38210]: pgmap v379: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:04:39.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:38 smithi027 ceph-mon[30611]: pgmap v379: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 11 op/s 2024-09-13T18:04:41.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:40 smithi122 ceph-mon[35310]: pgmap v380: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:04:41.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:40 smithi143 ceph-mon[38210]: pgmap v380: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:04:41.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:40 smithi027 ceph-mon[30611]: pgmap v380: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-13T18:04:43.109 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:42 smithi027 ceph-mon[30611]: pgmap v381: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:04:43.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:42 smithi122 ceph-mon[35310]: pgmap v381: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:04:43.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:42 smithi143 ceph-mon[38210]: pgmap v381: 97 pgs: 97 active+clean; 657 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-13T18:04:45.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:44 smithi122 ceph-mon[35310]: pgmap v382: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:04:45.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:44 smithi143 ceph-mon[38210]: pgmap v382: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:04:45.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:44 smithi027 ceph-mon[30611]: pgmap v382: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:04:47.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:46 smithi122 ceph-mon[35310]: pgmap v383: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:04:47.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:46 smithi143 ceph-mon[38210]: pgmap v383: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:04:47.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:46 smithi027 ceph-mon[30611]: pgmap v383: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:04:49.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:48 smithi122 ceph-mon[35310]: pgmap v384: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-13T18:04:49.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:48 smithi143 ceph-mon[38210]: pgmap v384: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-13T18:04:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:48 smithi027 ceph-mon[30611]: pgmap v384: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 682 B/s wr, 11 op/s 2024-09-13T18:04:51.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:50 smithi122 ceph-mon[35310]: pgmap v385: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:04:51.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:50 smithi143 ceph-mon[38210]: pgmap v385: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:04:51.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:50 smithi027 ceph-mon[30611]: pgmap v385: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 682 B/s wr, 9 op/s 2024-09-13T18:04:53.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:52 smithi122 ceph-mon[35310]: pgmap v386: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-13T18:04:53.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:52 smithi143 ceph-mon[38210]: pgmap v386: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-13T18:04:53.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:52 smithi027 ceph-mon[30611]: pgmap v386: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 8 op/s 2024-09-13T18:04:55.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:54 smithi122 ceph-mon[35310]: pgmap v387: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-13T18:04:55.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:54 smithi143 ceph-mon[38210]: pgmap v387: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-13T18:04:55.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:54 smithi027 ceph-mon[30611]: pgmap v387: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-13T18:04:57.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:56 smithi122 ceph-mon[35310]: pgmap v388: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T18:04:57.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:56 smithi143 ceph-mon[38210]: pgmap v388: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T18:04:57.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:56 smithi027 ceph-mon[30611]: pgmap v388: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T18:04:59.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:04:58 smithi122 ceph-mon[35310]: pgmap v389: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:04:59.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:04:58 smithi143 ceph-mon[38210]: pgmap v389: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:04:59.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:04:58 smithi027 ceph-mon[30611]: pgmap v389: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:05:01.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:00 smithi122 ceph-mon[35310]: pgmap v390: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:05:01.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:00 smithi143 ceph-mon[38210]: pgmap v390: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:05:01.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:00 smithi027 ceph-mon[30611]: pgmap v390: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:05:03.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:02 smithi122 ceph-mon[35310]: pgmap v391: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:05:03.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:02 smithi143 ceph-mon[38210]: pgmap v391: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:05:03.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:02 smithi027 ceph-mon[30611]: pgmap v391: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:05:05.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:04 smithi122 ceph-mon[35310]: pgmap v392: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:05:05.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:04 smithi143 ceph-mon[38210]: pgmap v392: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:05:05.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:04 smithi027 ceph-mon[30611]: pgmap v392: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:05:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:06 smithi122 ceph-mon[35310]: pgmap v393: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:05:07.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:06 smithi122 ceph-mon[35310]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-13T18:05:07.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:06 smithi143 ceph-mon[38210]: pgmap v393: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:05:07.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:06 smithi143 ceph-mon[38210]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-13T18:05:07.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:06 smithi027 ceph-mon[30611]: pgmap v393: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:05:07.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:06 smithi027 ceph-mon[30611]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-13T18:05:09.213 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:08 smithi122 ceph-mon[35310]: pgmap v394: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:05:09.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:08 smithi143 ceph-mon[38210]: pgmap v394: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:05:09.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:08 smithi027 ceph-mon[30611]: pgmap v394: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 597 B/s wr, 12 op/s 2024-09-13T18:05:09.537 INFO:tasks.workunit.client.0.smithi027.stderr:Updating files: 58% (7437/12697) Updating files: 59% (7492/12697) Updating files: 60% (7619/12697) Updating files: 61% (7746/12697) Updating files: 62% (7873/12697) Updating files: 63% (8000/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 95% (12093/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T18:05:10.730 INFO:tasks.workunit.client.0.smithi027.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr: git switch -c 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr:Or undo this operation with: 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-13T18:05:10.731 INFO:tasks.workunit.client.0.smithi027.stderr: git switch - 2024-09-13T18:05:10.732 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-13T18:05:10.732 INFO:tasks.workunit.client.0.smithi027.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:05:10.732 INFO:tasks.workunit.client.0.smithi027.stderr: 2024-09-13T18:05:10.732 INFO:tasks.workunit.client.0.smithi027.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:05:10.746 DEBUG:teuthology.orchestra.run.smithi027:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:05:10.835 INFO:tasks.workunit.client.0.smithi027.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:05:10.840 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:05:10.840 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:05:11.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:10 smithi122 ceph-mon[35310]: pgmap v395: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-13T18:05:11.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:10 smithi143 ceph-mon[38210]: pgmap v395: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-13T18:05:11.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:10 smithi027 ceph-mon[30611]: pgmap v395: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-13T18:05:11.605 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:05:11.708 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:05:11.776 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:05:11.780 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:05:11.780 INFO:tasks.workunit.client.0.smithi027.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:05:11.848 INFO:tasks.workunit.client.0.smithi027.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:05:11.855 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T18:05:11.855 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:05:11.891 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-13T18:05:11.893 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-13T18:05:11.894 DEBUG:teuthology.orchestra.run.smithi027:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-13T18:05:13.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:12 smithi122 ceph-mon[35310]: pgmap v396: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-13T18:05:13.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:12 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:05:13.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:12 smithi143 ceph-mon[38210]: pgmap v396: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-13T18:05:13.275 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:12 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:05:13.306 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:12 smithi027 ceph-mon[30611]: pgmap v396: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 9 op/s 2024-09-13T18:05:13.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:12 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:05:14.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:05:14.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:05:14.215 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:13 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:05:14.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:05:14.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:13 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:05:14.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:05:14.308 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:13 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:05:14.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ 2024-09-13T18:05:14.872 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-13T18:05:14.873 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-13T18:05:14.875 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-13T18:05:14.876 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-13T18:05:14.877 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-13T18:05:14.879 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-13T18:05:14.880 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-13T18:05:14.881 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-13T18:05:14.882 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-13T18:05:14.883 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-13T18:05:14.884 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-13T18:05:14.885 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-13T18:05:14.887 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-13T18:05:14.888 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-13T18:05:14.889 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-13T18:05:14.890 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-13T18:05:14.891 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-13T18:05:14.892 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-13T18:05:14.893 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-13T18:05:14.895 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-13T18:05:14.896 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-13T18:05:14.897 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-13T18:05:14.898 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-13T18:05:14.899 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-13T18:05:14.901 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-13T18:05:14.902 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-13T18:05:14.903 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-13T18:05:14.904 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-13T18:05:14.905 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-13T18:05:14.906 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-13T18:05:14.907 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-13T18:05:14.908 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-13T18:05:14.909 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-13T18:05:14.910 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-13T18:05:14.911 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-13T18:05:14.913 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-13T18:05:14.913 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-13T18:05:14.914 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-13T18:05:14.915 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-13T18:05:14.916 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-13T18:05:14.917 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-13T18:05:14.919 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-13T18:05:14.920 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-13T18:05:14.921 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-13T18:05:14.923 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-13T18:05:14.923 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-13T18:05:14.924 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-13T18:05:14.925 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-13T18:05:14.926 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-13T18:05:14.927 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-13T18:05:14.928 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-13T18:05:14.930 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-13T18:05:14.931 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-13T18:05:14.932 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-13T18:05:14.933 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-13T18:05:14.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-13T18:05:14.935 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-13T18:05:14.936 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-13T18:05:14.937 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-13T18:05:14.938 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-13T18:05:14.939 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-13T18:05:14.940 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-13T18:05:14.941 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-13T18:05:14.942 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-13T18:05:14.944 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-13T18:05:14.944 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-13T18:05:14.945 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-13T18:05:14.946 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-13T18:05:14.947 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-13T18:05:14.948 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-13T18:05:14.949 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-13T18:05:14.950 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-13T18:05:14.952 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-13T18:05:14.953 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-13T18:05:14.953 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-13T18:05:14.954 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-13T18:05:14.956 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-13T18:05:14.957 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-13T18:05:14.958 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-13T18:05:14.959 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-13T18:05:14.960 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-13T18:05:14.961 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-13T18:05:14.962 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-13T18:05:14.963 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-13T18:05:14.964 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-13T18:05:14.965 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-13T18:05:14.969 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-13T18:05:14.969 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-13T18:05:14.969 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-13T18:05:14.969 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-13T18:05:14.970 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-13T18:05:14.971 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-13T18:05:14.972 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-13T18:05:14.973 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-13T18:05:14.974 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-13T18:05:14.975 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-13T18:05:14.976 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-13T18:05:14.977 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-13T18:05:14.978 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-13T18:05:14.979 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-13T18:05:14.980 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-13T18:05:14.982 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-13T18:05:14.983 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-13T18:05:14.984 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-13T18:05:14.985 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-13T18:05:14.986 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-13T18:05:14.987 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-13T18:05:14.988 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-13T18:05:14.989 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-13T18:05:14.990 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-13T18:05:14.991 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-13T18:05:14.992 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-13T18:05:14.993 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-13T18:05:14.994 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-13T18:05:14.995 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-13T18:05:14.996 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-13T18:05:14.997 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-13T18:05:14.998 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-13T18:05:14.999 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-13T18:05:15.000 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-13T18:05:15.000 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-13T18:05:15.001 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-13T18:05:15.003 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-13T18:05:15.003 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-13T18:05:15.004 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-13T18:05:15.005 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-13T18:05:15.006 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-13T18:05:15.007 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-13T18:05:15.009 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-13T18:05:15.009 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-13T18:05:15.010 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-13T18:05:15.011 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-13T18:05:15.012 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-13T18:05:15.013 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-13T18:05:15.014 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-13T18:05:15.015 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-13T18:05:15.016 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-13T18:05:15.017 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-13T18:05:15.017 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-13T18:05:15.018 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-13T18:05:15.019 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-13T18:05:15.020 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-13T18:05:15.021 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-13T18:05:15.021 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-13T18:05:15.022 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-13T18:05:15.023 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-13T18:05:15.024 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-13T18:05:15.025 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-13T18:05:15.025 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-13T18:05:15.026 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-13T18:05:15.027 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-13T18:05:15.028 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-13T18:05:15.029 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-13T18:05:15.030 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-13T18:05:15.031 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-13T18:05:15.033 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-13T18:05:15.033 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-13T18:05:15.034 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-13T18:05:15.035 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-13T18:05:15.036 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-13T18:05:15.037 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-13T18:05:15.038 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-13T18:05:15.039 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-13T18:05:15.040 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-13T18:05:15.041 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-13T18:05:15.042 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-13T18:05:15.043 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-13T18:05:15.044 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-13T18:05:15.045 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-13T18:05:15.045 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-13T18:05:15.046 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-13T18:05:15.047 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-13T18:05:15.048 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-13T18:05:15.049 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-13T18:05:15.049 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-13T18:05:15.050 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-13T18:05:15.051 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-13T18:05:15.052 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-13T18:05:15.053 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-13T18:05:15.054 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-13T18:05:15.054 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-13T18:05:15.056 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-13T18:05:15.056 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-13T18:05:15.057 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-13T18:05:15.058 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-13T18:05:15.059 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-13T18:05:15.060 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-13T18:05:15.061 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-13T18:05:15.062 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-13T18:05:15.063 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-13T18:05:15.064 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-13T18:05:15.064 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-13T18:05:15.065 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-13T18:05:15.066 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-13T18:05:15.067 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-13T18:05:15.068 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-13T18:05:15.069 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-13T18:05:15.070 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-13T18:05:15.128 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-13T18:05:15.129 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-13T18:05:15.130 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-13T18:05:15.131 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-13T18:05:15.132 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-13T18:05:15.133 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-13T18:05:15.134 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-13T18:05:15.135 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-13T18:05:15.136 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-13T18:05:15.136 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-13T18:05:15.137 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-13T18:05:15.138 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-13T18:05:15.139 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-13T18:05:15.139 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-13T18:05:15.141 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-13T18:05:15.141 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-13T18:05:15.142 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-13T18:05:15.143 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-13T18:05:15.144 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-13T18:05:15.145 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-13T18:05:15.146 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-13T18:05:15.146 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-13T18:05:15.148 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-13T18:05:15.149 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-13T18:05:15.150 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-13T18:05:15.151 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-13T18:05:15.152 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-13T18:05:15.152 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-13T18:05:15.153 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-13T18:05:15.154 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-13T18:05:15.155 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-13T18:05:15.156 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-13T18:05:15.157 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-13T18:05:15.158 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-13T18:05:15.159 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-13T18:05:15.160 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-13T18:05:15.161 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-13T18:05:15.161 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-13T18:05:15.162 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-13T18:05:15.163 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-13T18:05:15.164 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-13T18:05:15.165 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-13T18:05:15.166 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-13T18:05:15.167 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-13T18:05:15.168 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-13T18:05:15.169 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-13T18:05:15.169 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-13T18:05:15.170 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-13T18:05:15.171 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-13T18:05:15.172 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-13T18:05:15.173 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-13T18:05:15.174 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-13T18:05:15.175 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-13T18:05:15.176 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-13T18:05:15.177 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-13T18:05:15.178 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-13T18:05:15.178 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-13T18:05:15.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-13T18:05:15.180 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-13T18:05:15.181 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-13T18:05:15.182 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-13T18:05:15.183 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-13T18:05:15.188 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-13T18:05:15.188 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/Changes 2024-09-13T18:05:15.188 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-13T18:05:15.188 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-13T18:05:15.189 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-13T18:05:15.189 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-13T18:05:15.190 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-13T18:05:15.191 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-13T18:05:15.192 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-13T18:05:15.193 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-13T18:05:15.194 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-13T18:05:15.195 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-13T18:05:15.196 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-13T18:05:15.197 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-13T18:05:15.198 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-13T18:05:15.199 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-13T18:05:15.200 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-13T18:05:15.201 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-13T18:05:15.203 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-13T18:05:15.204 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-13T18:05:15.205 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-13T18:05:15.205 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-13T18:05:15.206 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-13T18:05:15.207 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-13T18:05:15.208 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-13T18:05:15.209 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-13T18:05:15.210 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-13T18:05:15.211 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-13T18:05:15.212 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-13T18:05:15.213 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-13T18:05:15.215 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-13T18:05:15.215 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-13T18:05:15.216 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-13T18:05:15.217 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-13T18:05:15.218 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-13T18:05:15.219 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-13T18:05:15.220 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-13T18:05:15.221 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-13T18:05:15.222 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-13T18:05:15.223 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-13T18:05:15.224 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-13T18:05:15.224 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-13T18:05:15.225 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-13T18:05:15.226 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-13T18:05:15.227 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-13T18:05:15.228 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-13T18:05:15.229 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-13T18:05:15.230 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-13T18:05:15.231 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-13T18:05:15.233 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-13T18:05:15.235 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-13T18:05:15.235 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-13T18:05:15.236 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-13T18:05:15.237 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-13T18:05:15.238 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-13T18:05:15.239 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-13T18:05:15.240 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-13T18:05:15.241 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-13T18:05:15.242 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-13T18:05:15.243 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-13T18:05:15.244 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-13T18:05:15.247 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-13T18:05:15.248 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-13T18:05:15.249 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-13T18:05:15.249 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-13T18:05:15.250 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-13T18:05:15.251 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-13T18:05:15.252 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-13T18:05:15.253 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-13T18:05:15.254 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-13T18:05:15.255 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-13T18:05:15.256 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-13T18:05:15.257 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-13T18:05:15.258 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-13T18:05:15.259 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-13T18:05:15.260 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-13T18:05:15.261 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-13T18:05:15.262 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-13T18:05:15.263 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-13T18:05:15.263 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-13T18:05:15.264 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-13T18:05:15.265 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-13T18:05:15.266 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-13T18:05:15.268 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-13T18:05:15.268 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-13T18:05:15.269 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-13T18:05:15.270 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-13T18:05:15.271 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-13T18:05:15.272 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-13T18:05:15.272 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-13T18:05:15.273 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-13T18:05:15.274 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-13T18:05:15.275 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-13T18:05:15.276 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-13T18:05:15.277 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-13T18:05:15.278 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-13T18:05:15.278 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-13T18:05:15.280 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-13T18:05:15.280 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-13T18:05:15.281 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-13T18:05:15.283 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-13T18:05:15.284 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-13T18:05:15.285 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-13T18:05:15.286 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-13T18:05:15.287 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-13T18:05:15.288 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-13T18:05:15.289 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-13T18:05:15.290 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-13T18:05:15.291 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-13T18:05:15.292 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-13T18:05:15.293 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-13T18:05:15.294 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-13T18:05:15.295 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-13T18:05:15.296 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-13T18:05:15.297 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-13T18:05:15.298 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-13T18:05:15.298 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-13T18:05:15.300 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-13T18:05:15.300 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-13T18:05:15.301 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-13T18:05:15.302 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-13T18:05:15.304 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-13T18:05:15.304 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-13T18:05:15.306 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-13T18:05:15.307 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-13T18:05:15.307 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-13T18:05:15.309 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-13T18:05:15.309 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-13T18:05:15.310 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-13T18:05:15.311 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-13T18:05:15.312 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-13T18:05:15.313 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-13T18:05:15.314 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-13T18:05:15.315 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-13T18:05:15.315 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-13T18:05:15.316 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-13T18:05:15.317 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-13T18:05:15.318 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-13T18:05:15.319 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-13T18:05:15.320 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-13T18:05:15.321 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-13T18:05:15.322 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-13T18:05:15.324 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-13T18:05:15.324 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-13T18:05:15.325 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-13T18:05:15.326 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-13T18:05:15.327 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-13T18:05:15.328 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-13T18:05:15.329 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-13T18:05:15.330 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-13T18:05:15.331 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-13T18:05:15.332 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-13T18:05:15.333 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-13T18:05:15.334 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-13T18:05:15.335 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-13T18:05:15.336 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-13T18:05:15.336 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-13T18:05:15.337 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-13T18:05:15.338 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-13T18:05:15.339 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-13T18:05:15.340 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-13T18:05:15.341 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-13T18:05:15.342 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-13T18:05:15.343 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-13T18:05:15.344 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-13T18:05:15.345 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-13T18:05:15.345 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-13T18:05:15.347 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-13T18:05:15.347 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-13T18:05:15.348 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-13T18:05:15.349 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-13T18:05:15.350 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-13T18:05:15.351 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-13T18:05:15.352 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-13T18:05:15.353 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-13T18:05:15.354 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-13T18:05:15.355 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-13T18:05:15.355 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-13T18:05:15.356 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-13T18:05:15.357 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-13T18:05:15.358 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-13T18:05:15.359 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-13T18:05:15.359 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-13T18:05:15.360 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-13T18:05:15.361 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-13T18:05:15.362 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-13T18:05:15.363 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-13T18:05:15.364 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-13T18:05:15.365 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-13T18:05:15.366 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-13T18:05:15.367 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-13T18:05:15.368 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-13T18:05:15.369 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-13T18:05:15.370 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-13T18:05:15.371 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-13T18:05:15.371 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-13T18:05:15.372 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-13T18:05:15.373 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-13T18:05:15.374 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-13T18:05:15.375 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-13T18:05:15.376 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-13T18:05:15.381 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-13T18:05:15.381 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-13T18:05:15.381 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-13T18:05:15.381 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-13T18:05:15.382 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-13T18:05:15.383 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-13T18:05:15.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:15 smithi122 ceph-mon[35310]: pgmap v397: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-13T18:05:15.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:15 smithi143 ceph-mon[38210]: pgmap v397: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-13T18:05:15.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:15 smithi027 ceph-mon[30611]: pgmap v397: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-13T18:05:17.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:17 smithi122 ceph-mon[35310]: pgmap v398: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-13T18:05:17.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:17 smithi143 ceph-mon[38210]: pgmap v398: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-13T18:05:17.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:17 smithi027 ceph-mon[30611]: pgmap v398: 97 pgs: 97 active+clean; 663 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-13T18:05:19.342 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:19 smithi143 ceph-mon[38210]: pgmap v399: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-09-13T18:05:19.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:19 smithi122 ceph-mon[35310]: pgmap v399: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-09-13T18:05:19.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:19 smithi027 ceph-mon[30611]: pgmap v399: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 14 op/s 2024-09-13T18:05:20.181 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-13T18:05:20.182 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-13T18:05:20.183 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-13T18:05:20.185 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-13T18:05:20.193 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-13T18:05:20.199 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-13T18:05:20.201 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-13T18:05:20.202 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-13T18:05:20.203 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-13T18:05:20.206 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-13T18:05:20.207 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-13T18:05:20.208 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-13T18:05:20.209 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-13T18:05:20.209 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-13T18:05:20.210 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-13T18:05:20.211 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-13T18:05:20.212 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-13T18:05:20.213 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-13T18:05:20.215 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-13T18:05:20.215 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-13T18:05:20.216 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-13T18:05:20.217 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-13T18:05:20.218 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-13T18:05:20.219 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-13T18:05:20.220 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-13T18:05:20.221 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-13T18:05:20.222 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-13T18:05:20.223 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-13T18:05:20.224 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-13T18:05:20.225 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-13T18:05:20.226 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-13T18:05:20.229 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-13T18:05:20.230 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-13T18:05:20.231 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-13T18:05:20.231 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-13T18:05:20.232 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-13T18:05:20.234 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-13T18:05:20.235 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-13T18:05:20.236 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-13T18:05:20.237 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-13T18:05:20.238 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-13T18:05:20.239 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-13T18:05:20.240 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-13T18:05:20.241 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-13T18:05:20.242 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-13T18:05:20.243 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-13T18:05:20.244 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-13T18:05:20.246 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-13T18:05:20.247 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-13T18:05:20.247 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-13T18:05:20.248 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-13T18:05:20.249 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/Makefile 2024-09-13T18:05:20.250 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-13T18:05:20.251 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-13T18:05:20.252 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-13T18:05:20.253 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-13T18:05:20.254 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-13T18:05:20.255 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-13T18:05:20.256 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-13T18:05:20.258 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-13T18:05:20.259 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-13T18:05:20.260 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-13T18:05:20.261 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-13T18:05:20.262 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-13T18:05:20.263 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-13T18:05:20.265 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-13T18:05:20.266 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-13T18:05:20.267 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-13T18:05:20.268 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-13T18:05:20.269 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-13T18:05:20.270 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-13T18:05:20.271 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-13T18:05:20.272 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-13T18:05:20.273 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-13T18:05:20.273 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-13T18:05:20.274 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-13T18:05:20.275 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-13T18:05:20.276 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-13T18:05:20.277 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-13T18:05:20.278 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-13T18:05:20.279 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-13T18:05:20.280 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-13T18:05:20.281 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-13T18:05:20.282 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-13T18:05:20.283 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-13T18:05:20.284 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-13T18:05:20.285 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-13T18:05:20.286 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-13T18:05:20.287 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-13T18:05:20.288 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-13T18:05:20.289 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-13T18:05:20.290 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-13T18:05:20.291 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-13T18:05:20.292 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-13T18:05:20.293 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-13T18:05:20.294 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-13T18:05:20.296 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-13T18:05:20.297 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-13T18:05:20.298 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-13T18:05:20.298 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-13T18:05:20.299 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-13T18:05:20.300 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-13T18:05:20.301 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-13T18:05:20.302 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-13T18:05:20.303 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-13T18:05:20.304 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-13T18:05:20.305 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-13T18:05:20.306 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-13T18:05:20.307 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-13T18:05:20.308 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-13T18:05:20.309 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-13T18:05:20.310 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-13T18:05:20.311 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-13T18:05:20.312 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-13T18:05:20.313 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-13T18:05:20.314 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-13T18:05:20.316 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-13T18:05:20.317 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/ 2024-09-13T18:05:20.321 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-13T18:05:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-13T18:05:20.322 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-13T18:05:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-13T18:05:20.323 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-13T18:05:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-13T18:05:20.324 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-13T18:05:20.325 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-13T18:05:20.326 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-13T18:05:20.327 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-13T18:05:20.328 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-13T18:05:20.329 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-13T18:05:20.330 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-13T18:05:20.331 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-13T18:05:20.332 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-13T18:05:20.333 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/README 2024-09-13T18:05:20.334 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-13T18:05:20.335 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-13T18:05:20.336 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-13T18:05:20.337 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-13T18:05:20.338 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-13T18:05:20.339 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-13T18:05:20.340 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-13T18:05:20.341 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-13T18:05:20.342 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-13T18:05:20.343 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-13T18:05:20.343 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-13T18:05:20.344 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-13T18:05:20.345 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-13T18:05:20.346 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-13T18:05:20.346 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-13T18:05:20.347 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-13T18:05:20.348 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-13T18:05:20.349 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-13T18:05:20.350 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-13T18:05:20.351 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-13T18:05:20.352 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-13T18:05:20.353 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-13T18:05:20.354 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-13T18:05:20.355 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-13T18:05:20.355 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-13T18:05:20.356 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-13T18:05:20.357 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-13T18:05:20.358 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-13T18:05:20.359 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-13T18:05:20.360 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-13T18:05:20.361 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-13T18:05:20.362 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-13T18:05:20.362 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-13T18:05:20.363 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-13T18:05:20.364 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-13T18:05:20.365 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-13T18:05:20.366 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-13T18:05:20.367 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-13T18:05:20.368 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-13T18:05:20.369 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-13T18:05:20.370 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-13T18:05:20.371 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-13T18:05:20.372 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-13T18:05:20.373 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-13T18:05:20.374 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-13T18:05:20.375 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-13T18:05:20.376 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-13T18:05:20.377 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-13T18:05:20.378 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-13T18:05:20.379 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-13T18:05:20.381 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-13T18:05:20.382 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-13T18:05:20.382 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-13T18:05:20.383 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-13T18:05:20.384 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-13T18:05:20.386 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-13T18:05:20.387 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-13T18:05:20.387 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-13T18:05:20.388 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-13T18:05:20.389 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-13T18:05:20.390 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-13T18:05:20.391 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-13T18:05:20.392 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-13T18:05:20.393 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-13T18:05:20.394 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-13T18:05:20.395 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-13T18:05:20.395 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-13T18:05:20.396 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-13T18:05:20.397 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-13T18:05:20.398 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-13T18:05:20.399 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-13T18:05:20.400 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-13T18:05:20.401 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-13T18:05:20.401 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-13T18:05:20.402 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-13T18:05:20.403 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-13T18:05:20.404 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-13T18:05:20.405 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-13T18:05:20.406 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-13T18:05:20.407 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-13T18:05:20.408 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-13T18:05:20.409 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-13T18:05:20.410 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-13T18:05:20.411 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-13T18:05:20.412 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-13T18:05:20.413 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-13T18:05:20.414 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-13T18:05:20.415 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-13T18:05:20.416 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-13T18:05:20.417 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-13T18:05:20.418 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-13T18:05:20.419 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-13T18:05:20.420 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-13T18:05:20.421 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-13T18:05:20.422 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-13T18:05:20.423 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-13T18:05:20.424 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-13T18:05:20.425 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-13T18:05:20.426 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-13T18:05:20.427 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/ 2024-09-13T18:05:20.428 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-13T18:05:20.429 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-13T18:05:20.430 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-13T18:05:20.431 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-13T18:05:20.432 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-13T18:05:20.433 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-13T18:05:20.434 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-13T18:05:20.435 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-13T18:05:20.436 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-13T18:05:20.437 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-13T18:05:20.438 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-13T18:05:20.439 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-13T18:05:20.440 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-13T18:05:20.440 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-13T18:05:20.441 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-13T18:05:20.442 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-13T18:05:20.443 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-13T18:05:20.444 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-13T18:05:20.445 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-13T18:05:20.446 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-13T18:05:20.447 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-13T18:05:20.448 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-13T18:05:20.449 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-13T18:05:20.450 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-13T18:05:20.451 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-13T18:05:20.452 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-13T18:05:20.453 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-13T18:05:20.454 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-13T18:05:20.455 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-13T18:05:20.456 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-13T18:05:20.457 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-13T18:05:20.458 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-13T18:05:20.459 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-13T18:05:20.460 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-13T18:05:20.461 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-13T18:05:20.462 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-13T18:05:20.464 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-13T18:05:20.464 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-13T18:05:20.465 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-13T18:05:20.466 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-13T18:05:20.467 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-13T18:05:20.469 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-13T18:05:20.470 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-13T18:05:20.471 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-13T18:05:20.473 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-13T18:05:20.474 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-13T18:05:20.475 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-13T18:05:20.476 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-13T18:05:20.477 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-13T18:05:20.478 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-13T18:05:20.479 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-13T18:05:20.480 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-13T18:05:20.481 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-13T18:05:20.482 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-13T18:05:20.483 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-13T18:05:20.484 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-13T18:05:20.485 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-13T18:05:20.486 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-13T18:05:20.487 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-13T18:05:20.489 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-13T18:05:20.489 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-13T18:05:20.490 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-13T18:05:20.491 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-13T18:05:20.492 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-13T18:05:20.493 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-13T18:05:20.494 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/connector/ 2024-09-13T18:05:20.495 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-13T18:05:20.496 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-13T18:05:20.497 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-13T18:05:20.498 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-13T18:05:20.499 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-13T18:05:20.500 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/console/ 2024-09-13T18:05:20.501 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-13T18:05:20.502 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-13T18:05:20.504 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-13T18:05:20.505 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-13T18:05:20.505 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-13T18:05:20.506 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-13T18:05:20.507 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-13T18:05:20.508 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-13T18:05:20.509 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-13T18:05:20.510 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-13T18:05:20.511 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-13T18:05:20.512 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-13T18:05:20.513 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-13T18:05:20.514 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-13T18:05:20.516 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-13T18:05:20.516 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-13T18:05:20.518 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-13T18:05:20.519 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-13T18:05:20.520 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-13T18:05:20.525 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-13T18:05:20.526 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-13T18:05:20.526 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-13T18:05:20.526 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cris/ 2024-09-13T18:05:20.526 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/cris/README 2024-09-13T18:05:20.526 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-13T18:05:20.527 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-13T18:05:20.528 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-13T18:05:20.529 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-13T18:05:20.530 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-13T18:05:20.531 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-13T18:05:20.532 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-13T18:05:20.533 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-13T18:05:20.534 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-13T18:05:20.535 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-13T18:05:20.536 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-13T18:05:20.537 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-13T18:05:20.539 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-13T18:05:20.540 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-13T18:05:20.541 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-13T18:05:20.542 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-13T18:05:20.543 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-13T18:05:20.544 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-13T18:05:20.545 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-13T18:05:20.546 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-13T18:05:20.547 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-13T18:05:20.548 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-13T18:05:20.550 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-13T18:05:20.550 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-13T18:05:20.551 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-13T18:05:20.553 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-13T18:05:20.553 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-13T18:05:20.554 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-13T18:05:20.555 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-13T18:05:20.556 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-13T18:05:20.557 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-13T18:05:20.558 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-13T18:05:20.559 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-13T18:05:20.560 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-13T18:05:20.560 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-13T18:05:20.561 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-13T18:05:20.562 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-13T18:05:20.563 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-13T18:05:20.564 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-13T18:05:20.565 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-13T18:05:20.566 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-13T18:05:20.567 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-13T18:05:20.568 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-13T18:05:20.570 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-13T18:05:20.571 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-13T18:05:20.572 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-13T18:05:20.573 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-13T18:05:20.574 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-13T18:05:20.575 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-13T18:05:20.576 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-13T18:05:20.577 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-13T18:05:20.578 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-13T18:05:20.579 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-13T18:05:20.580 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-13T18:05:20.582 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-13T18:05:20.583 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-13T18:05:20.583 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-13T18:05:20.585 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-13T18:05:20.586 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-13T18:05:20.587 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-13T18:05:20.587 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-13T18:05:20.588 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-13T18:05:20.589 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-13T18:05:20.590 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-13T18:05:20.591 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-13T18:05:20.592 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-13T18:05:20.593 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-13T18:05:20.594 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-13T18:05:20.595 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-13T18:05:20.597 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-13T18:05:20.598 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-13T18:05:20.599 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-13T18:05:20.599 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-13T18:05:20.600 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-13T18:05:20.601 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-13T18:05:20.602 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-13T18:05:20.603 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-13T18:05:20.604 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-13T18:05:20.604 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-13T18:05:20.606 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-13T18:05:20.607 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-13T18:05:20.607 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-13T18:05:20.608 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-13T18:05:20.609 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-13T18:05:20.610 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-13T18:05:20.611 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-13T18:05:20.612 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-13T18:05:20.613 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-13T18:05:20.614 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-13T18:05:20.615 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-13T18:05:20.617 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-13T18:05:20.617 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-13T18:05:20.618 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-13T18:05:20.619 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-13T18:05:20.620 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-13T18:05:20.621 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-13T18:05:20.622 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-13T18:05:20.623 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-13T18:05:20.624 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-13T18:05:20.625 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-13T18:05:20.626 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-13T18:05:20.627 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-13T18:05:20.628 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-13T18:05:20.630 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-13T18:05:20.630 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-13T18:05:20.631 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-13T18:05:20.633 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-13T18:05:20.634 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-13T18:05:20.634 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-13T18:05:20.635 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-13T18:05:20.636 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-13T18:05:20.637 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-13T18:05:20.638 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-13T18:05:20.639 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-13T18:05:20.640 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-13T18:05:20.641 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-13T18:05:20.642 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-13T18:05:20.643 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-13T18:05:20.644 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-13T18:05:20.645 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-13T18:05:20.646 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-13T18:05:20.647 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-13T18:05:20.648 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-13T18:05:20.649 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-13T18:05:20.650 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-13T18:05:20.651 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-13T18:05:20.652 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-13T18:05:20.654 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-13T18:05:20.655 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-13T18:05:20.656 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-13T18:05:20.657 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-13T18:05:20.658 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-13T18:05:20.659 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-13T18:05:20.660 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-13T18:05:20.661 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-13T18:05:20.662 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-13T18:05:20.663 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-13T18:05:20.664 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-13T18:05:20.665 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-13T18:05:20.667 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-13T18:05:20.667 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-13T18:05:20.669 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-13T18:05:20.670 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-13T18:05:20.671 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-13T18:05:20.672 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-13T18:05:20.673 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-13T18:05:20.674 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-13T18:05:20.675 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-13T18:05:20.676 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-13T18:05:20.677 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-13T18:05:20.679 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-13T18:05:20.680 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-13T18:05:20.680 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-13T18:05:20.681 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-13T18:05:20.682 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-13T18:05:20.683 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-13T18:05:20.684 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-13T18:05:20.685 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-13T18:05:20.687 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-13T18:05:20.688 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-13T18:05:20.689 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-13T18:05:20.689 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-13T18:05:20.690 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-13T18:05:20.691 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-13T18:05:20.692 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-13T18:05:20.694 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-13T18:05:20.695 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-13T18:05:20.696 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-13T18:05:20.697 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-13T18:05:20.697 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-13T18:05:20.699 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-13T18:05:20.700 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-13T18:05:20.701 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-13T18:05:20.702 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-13T18:05:20.702 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-13T18:05:20.703 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-13T18:05:20.705 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-13T18:05:20.705 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-13T18:05:20.706 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-13T18:05:20.707 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-13T18:05:20.708 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-13T18:05:20.709 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-13T18:05:20.710 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-13T18:05:20.711 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-13T18:05:20.712 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-13T18:05:20.712 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-13T18:05:20.713 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-13T18:05:20.714 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-13T18:05:20.715 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-13T18:05:20.716 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-13T18:05:20.717 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-13T18:05:20.718 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-13T18:05:20.719 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-13T18:05:20.720 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-13T18:05:20.721 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-13T18:05:20.722 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-13T18:05:20.723 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-13T18:05:20.724 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-13T18:05:20.724 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-13T18:05:20.730 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-13T18:05:20.730 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-13T18:05:20.730 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-13T18:05:20.872 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-13T18:05:20.872 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-13T18:05:20.873 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-13T18:05:20.874 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-13T18:05:20.875 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-13T18:05:20.876 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-13T18:05:20.877 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-13T18:05:20.878 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-13T18:05:20.879 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-13T18:05:20.880 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-13T18:05:20.881 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-13T18:05:20.882 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-13T18:05:20.883 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-13T18:05:20.884 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-13T18:05:20.885 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-13T18:05:20.886 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-13T18:05:20.887 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-13T18:05:20.888 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-13T18:05:20.889 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-13T18:05:20.890 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-13T18:05:20.891 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-13T18:05:20.892 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-13T18:05:20.893 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-13T18:05:20.894 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-13T18:05:20.895 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-13T18:05:20.896 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-13T18:05:20.897 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-13T18:05:20.898 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-13T18:05:20.899 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-13T18:05:20.900 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-13T18:05:20.901 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-13T18:05:20.902 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-13T18:05:20.903 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-13T18:05:20.904 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-13T18:05:20.905 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-13T18:05:20.906 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-13T18:05:20.907 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-13T18:05:20.908 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-13T18:05:20.910 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-13T18:05:20.910 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-13T18:05:20.911 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-13T18:05:20.912 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-13T18:05:20.913 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-13T18:05:20.914 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-13T18:05:20.915 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-13T18:05:20.916 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-13T18:05:20.917 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-13T18:05:20.918 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-13T18:05:20.919 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-13T18:05:20.920 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-13T18:05:20.920 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-13T18:05:20.922 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-13T18:05:20.923 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-13T18:05:20.924 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-13T18:05:20.925 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-13T18:05:20.925 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-13T18:05:20.926 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-13T18:05:20.927 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-13T18:05:20.928 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-13T18:05:20.929 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-13T18:05:20.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-13T18:05:20.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-13T18:05:20.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-13T18:05:20.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-13T18:05:20.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-13T18:05:20.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-13T18:05:20.935 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-13T18:05:20.936 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-13T18:05:20.937 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-13T18:05:20.938 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-13T18:05:20.939 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-13T18:05:20.940 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-13T18:05:20.941 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-13T18:05:20.942 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-13T18:05:20.942 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-13T18:05:20.943 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-13T18:05:20.944 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-13T18:05:20.945 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-13T18:05:20.946 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-13T18:05:20.947 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-13T18:05:20.948 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-13T18:05:20.949 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-13T18:05:20.950 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-13T18:05:20.952 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-13T18:05:20.952 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-13T18:05:20.953 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-13T18:05:20.954 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-13T18:05:20.955 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-13T18:05:20.956 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-13T18:05:20.957 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-13T18:05:20.958 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-13T18:05:20.959 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-13T18:05:20.960 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-13T18:05:20.961 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-13T18:05:20.962 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-13T18:05:20.963 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-13T18:05:20.964 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-13T18:05:20.965 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-13T18:05:20.966 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-13T18:05:20.967 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-13T18:05:20.968 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-13T18:05:20.969 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-13T18:05:20.970 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-13T18:05:20.971 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-13T18:05:20.972 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-13T18:05:20.974 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-13T18:05:20.975 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-13T18:05:20.976 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-13T18:05:20.977 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-13T18:05:20.978 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-13T18:05:20.979 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-13T18:05:20.979 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-13T18:05:20.980 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-13T18:05:20.981 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-13T18:05:20.982 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-13T18:05:20.983 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-13T18:05:20.984 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-13T18:05:20.985 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-13T18:05:20.986 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-13T18:05:20.987 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-13T18:05:20.988 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-13T18:05:20.989 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-13T18:05:20.990 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-13T18:05:20.991 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-13T18:05:20.992 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-13T18:05:20.993 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-13T18:05:20.994 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-13T18:05:20.995 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-13T18:05:20.996 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-13T18:05:20.997 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-13T18:05:20.998 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-13T18:05:20.999 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-13T18:05:21.000 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-13T18:05:21.001 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-13T18:05:21.002 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-13T18:05:21.003 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-13T18:05:21.004 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-13T18:05:21.005 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-13T18:05:21.006 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-13T18:05:21.007 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-13T18:05:21.008 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-13T18:05:21.009 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-13T18:05:21.010 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-13T18:05:21.011 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-13T18:05:21.012 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-13T18:05:21.013 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-13T18:05:21.014 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-13T18:05:21.015 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-13T18:05:21.015 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-13T18:05:21.016 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-13T18:05:21.017 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-13T18:05:21.018 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-13T18:05:21.019 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-13T18:05:21.020 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-13T18:05:21.021 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-13T18:05:21.022 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-13T18:05:21.023 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-13T18:05:21.024 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-13T18:05:21.025 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-13T18:05:21.026 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-13T18:05:21.027 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-13T18:05:21.028 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-13T18:05:21.029 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-13T18:05:21.030 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-13T18:05:21.031 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-13T18:05:21.032 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-13T18:05:21.033 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-13T18:05:21.033 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-13T18:05:21.034 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-13T18:05:21.035 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-13T18:05:21.036 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-13T18:05:21.037 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-13T18:05:21.038 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-13T18:05:21.039 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-13T18:05:21.041 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-13T18:05:21.041 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-13T18:05:21.042 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-13T18:05:21.043 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-13T18:05:21.044 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-13T18:05:21.045 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-13T18:05:21.046 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-13T18:05:21.047 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-13T18:05:21.048 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-13T18:05:21.049 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-13T18:05:21.050 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-13T18:05:21.051 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-13T18:05:21.052 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-13T18:05:21.053 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-13T18:05:21.054 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-13T18:05:21.055 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-13T18:05:21.056 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-13T18:05:21.057 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-13T18:05:21.058 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-13T18:05:21.059 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-13T18:05:21.060 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-13T18:05:21.061 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-13T18:05:21.062 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-13T18:05:21.063 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-13T18:05:21.064 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-13T18:05:21.065 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-13T18:05:21.066 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-13T18:05:21.067 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-13T18:05:21.068 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-13T18:05:21.069 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-13T18:05:21.070 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-13T18:05:21.071 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-13T18:05:21.072 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-13T18:05:21.074 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-13T18:05:21.075 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-13T18:05:21.076 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-13T18:05:21.077 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-13T18:05:21.078 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-13T18:05:21.079 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-13T18:05:21.080 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-13T18:05:21.081 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-13T18:05:21.082 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-13T18:05:21.083 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-13T18:05:21.084 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-13T18:05:21.085 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-13T18:05:21.086 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-13T18:05:21.087 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-13T18:05:21.088 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-13T18:05:21.089 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-13T18:05:21.089 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-13T18:05:21.090 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-13T18:05:21.091 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-13T18:05:21.092 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-13T18:05:21.093 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-13T18:05:21.093 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-13T18:05:21.094 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-13T18:05:21.095 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-13T18:05:21.097 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-13T18:05:21.097 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-13T18:05:21.098 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-13T18:05:21.099 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-13T18:05:21.100 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-13T18:05:21.101 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-13T18:05:21.102 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-13T18:05:21.103 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-13T18:05:21.104 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-13T18:05:21.105 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-13T18:05:21.106 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-13T18:05:21.107 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-13T18:05:21.108 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-13T18:05:21.109 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-13T18:05:21.110 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-13T18:05:21.111 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-13T18:05:21.112 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-13T18:05:21.113 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-13T18:05:21.114 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-13T18:05:21.115 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-13T18:05:21.116 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-13T18:05:21.117 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-13T18:05:21.118 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-13T18:05:21.118 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-13T18:05:21.120 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-13T18:05:21.121 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-13T18:05:21.121 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-13T18:05:21.123 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-13T18:05:21.124 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-13T18:05:21.125 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-13T18:05:21.126 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-13T18:05:21.127 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-13T18:05:21.128 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-13T18:05:21.129 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-13T18:05:21.129 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-13T18:05:21.130 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-13T18:05:21.131 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-13T18:05:21.132 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-13T18:05:21.133 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-13T18:05:21.133 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-13T18:05:21.134 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-13T18:05:21.135 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-13T18:05:21.136 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-13T18:05:21.137 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-13T18:05:21.138 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-13T18:05:21.139 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-13T18:05:21.140 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-13T18:05:21.141 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-13T18:05:21.142 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-13T18:05:21.143 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-13T18:05:21.144 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-13T18:05:21.145 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-13T18:05:21.146 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-13T18:05:21.147 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-13T18:05:21.148 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-13T18:05:21.149 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-13T18:05:21.149 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-13T18:05:21.150 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-13T18:05:21.151 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-13T18:05:21.152 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-13T18:05:21.153 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-13T18:05:21.154 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-13T18:05:21.155 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-13T18:05:21.156 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-13T18:05:21.157 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-13T18:05:21.158 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-13T18:05:21.159 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-13T18:05:21.160 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-13T18:05:21.161 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-13T18:05:21.162 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-13T18:05:21.163 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-13T18:05:21.164 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-13T18:05:21.165 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-13T18:05:21.167 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-13T18:05:21.168 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-13T18:05:21.169 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-13T18:05:21.170 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-13T18:05:21.171 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-13T18:05:21.172 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-13T18:05:21.173 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-13T18:05:21.174 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-13T18:05:21.175 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-13T18:05:21.176 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-13T18:05:21.177 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-13T18:05:21.178 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-13T18:05:21.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-13T18:05:21.180 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-13T18:05:21.181 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-13T18:05:21.182 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-13T18:05:21.183 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-13T18:05:21.184 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-13T18:05:21.186 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-13T18:05:21.187 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-13T18:05:21.188 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-13T18:05:21.189 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-13T18:05:21.190 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-13T18:05:21.191 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-13T18:05:21.192 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-13T18:05:21.193 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-13T18:05:21.194 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-13T18:05:21.195 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-13T18:05:21.196 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-13T18:05:21.197 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-13T18:05:21.198 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-13T18:05:21.199 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-13T18:05:21.200 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-13T18:05:21.200 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-13T18:05:21.201 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-13T18:05:21.202 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-13T18:05:21.203 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-13T18:05:21.204 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-13T18:05:21.205 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-13T18:05:21.206 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-13T18:05:21.207 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-13T18:05:21.209 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-13T18:05:21.210 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-13T18:05:21.210 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-13T18:05:21.211 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-13T18:05:21.212 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-13T18:05:21.213 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-13T18:05:21.214 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-13T18:05:21.214 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-13T18:05:21.215 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-13T18:05:21.216 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-13T18:05:21.217 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-13T18:05:21.218 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-13T18:05:21.219 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-13T18:05:21.220 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-13T18:05:21.221 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-13T18:05:21.222 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-13T18:05:21.223 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-13T18:05:21.224 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-13T18:05:21.225 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-13T18:05:21.226 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-13T18:05:21.226 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-13T18:05:21.227 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-13T18:05:21.228 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-13T18:05:21.229 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-13T18:05:21.229 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-13T18:05:21.231 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-13T18:05:21.231 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-13T18:05:21.232 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-13T18:05:21.233 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-13T18:05:21.234 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-13T18:05:21.235 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-13T18:05:21.236 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-13T18:05:21.237 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-13T18:05:21.238 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-13T18:05:21.239 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-13T18:05:21.240 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-13T18:05:21.241 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-13T18:05:21.242 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-13T18:05:21.243 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-13T18:05:21.244 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-13T18:05:21.245 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-13T18:05:21.246 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-13T18:05:21.247 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-13T18:05:21.247 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-13T18:05:21.248 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-13T18:05:21.250 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-13T18:05:21.250 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-13T18:05:21.251 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-13T18:05:21.253 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-13T18:05:21.254 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-13T18:05:21.255 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-13T18:05:21.256 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-13T18:05:21.257 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-13T18:05:21.259 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-13T18:05:21.259 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-13T18:05:21.260 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-13T18:05:21.261 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-13T18:05:21.262 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-13T18:05:21.263 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-13T18:05:21.264 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-13T18:05:21.265 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-13T18:05:21.267 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-13T18:05:21.268 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-13T18:05:21.269 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-13T18:05:21.270 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-13T18:05:21.271 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-13T18:05:21.272 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-13T18:05:21.273 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-13T18:05:21.274 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-13T18:05:21.275 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-13T18:05:21.276 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-13T18:05:21.277 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-13T18:05:21.278 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-13T18:05:21.279 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-13T18:05:21.280 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-13T18:05:21.281 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-13T18:05:21.282 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-13T18:05:21.283 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-13T18:05:21.284 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-13T18:05:21.285 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-13T18:05:21.286 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-13T18:05:21.287 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-13T18:05:21.288 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-13T18:05:21.289 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-13T18:05:21.290 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-13T18:05:21.290 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-13T18:05:21.291 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-13T18:05:21.292 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-13T18:05:21.294 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-13T18:05:21.295 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-13T18:05:21.296 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-13T18:05:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-13T18:05:21.297 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-13T18:05:21.298 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-13T18:05:21.299 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-13T18:05:21.300 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-13T18:05:21.301 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-13T18:05:21.303 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-13T18:05:21.303 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-13T18:05:21.304 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-13T18:05:21.305 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-13T18:05:21.306 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-13T18:05:21.307 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-13T18:05:21.308 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-13T18:05:21.309 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-13T18:05:21.310 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-13T18:05:21.311 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-13T18:05:21.312 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-13T18:05:21.313 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-13T18:05:21.314 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-13T18:05:21.315 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-13T18:05:21.316 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-13T18:05:21.317 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-13T18:05:21.318 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-13T18:05:21.319 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-13T18:05:21.320 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-13T18:05:21.321 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-13T18:05:21.322 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-13T18:05:21.323 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-13T18:05:21.324 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-13T18:05:21.325 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-13T18:05:21.326 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-13T18:05:21.327 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-13T18:05:21.328 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-13T18:05:21.329 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-13T18:05:21.330 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-13T18:05:21.331 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-13T18:05:21.332 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-13T18:05:21.333 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-13T18:05:21.334 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-13T18:05:21.335 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-13T18:05:21.336 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-13T18:05:21.337 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-13T18:05:21.341 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-13T18:05:21.341 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-13T18:05:21.341 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-13T18:05:21.341 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-13T18:05:21.342 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-13T18:05:21.343 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-13T18:05:21.344 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-13T18:05:21.345 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-13T18:05:21.346 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-13T18:05:21.347 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-13T18:05:21.348 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-13T18:05:21.349 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-13T18:05:21.350 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-13T18:05:21.351 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-13T18:05:21.352 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-13T18:05:21.353 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-13T18:05:21.354 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-13T18:05:21.355 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-13T18:05:21.356 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-13T18:05:21.357 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-13T18:05:21.358 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-13T18:05:21.360 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-13T18:05:21.360 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-13T18:05:21.361 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-13T18:05:21.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:21 smithi122 ceph-mon[35310]: pgmap v400: 97 pgs: 97 active+clean; 25 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 14 op/s 2024-09-13T18:05:21.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:21 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:21.480 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-13T18:05:21.481 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-13T18:05:21.482 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-13T18:05:21.483 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-13T18:05:21.484 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-13T18:05:21.485 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-13T18:05:21.486 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-13T18:05:21.487 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-13T18:05:21.488 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-13T18:05:21.489 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-13T18:05:21.491 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-13T18:05:21.491 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-13T18:05:21.492 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-13T18:05:21.493 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-13T18:05:21.494 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-13T18:05:21.495 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-13T18:05:21.496 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-13T18:05:21.497 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-13T18:05:21.498 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-13T18:05:21.498 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-13T18:05:21.499 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-13T18:05:21.500 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-13T18:05:21.502 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-13T18:05:21.503 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-13T18:05:21.504 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-13T18:05:21.505 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-13T18:05:21.506 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-13T18:05:21.507 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-13T18:05:21.508 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-13T18:05:21.509 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-13T18:05:21.510 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-13T18:05:21.511 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-13T18:05:21.512 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-13T18:05:21.513 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-13T18:05:21.514 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-13T18:05:21.516 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-13T18:05:21.517 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-13T18:05:21.518 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-13T18:05:21.519 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-13T18:05:21.520 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-13T18:05:21.521 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-13T18:05:21.522 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-13T18:05:21.523 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-13T18:05:21.524 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-13T18:05:21.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:21 smithi143 ceph-mon[38210]: pgmap v400: 97 pgs: 97 active+clean; 25 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 14 op/s 2024-09-13T18:05:21.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:21 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:21.526 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-13T18:05:21.527 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-13T18:05:21.528 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-13T18:05:21.529 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-13T18:05:21.530 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-13T18:05:21.532 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-13T18:05:21.534 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-13T18:05:21.535 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-13T18:05:21.537 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-13T18:05:21.538 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-13T18:05:21.539 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-13T18:05:21.540 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-13T18:05:21.545 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-13T18:05:21.545 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-13T18:05:21.545 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-13T18:05:21.546 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-13T18:05:21.547 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-13T18:05:21.548 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-13T18:05:21.549 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-13T18:05:21.551 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-13T18:05:21.552 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-13T18:05:21.553 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-13T18:05:21.554 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-13T18:05:21.556 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-13T18:05:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:21 smithi027 ceph-mon[30611]: pgmap v400: 97 pgs: 97 active+clean; 25 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 2.0 MiB/s wr, 14 op/s 2024-09-13T18:05:21.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:21 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:21.557 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-13T18:05:21.558 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-13T18:05:21.559 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-13T18:05:21.560 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-13T18:05:21.561 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-13T18:05:21.562 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-13T18:05:21.563 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-13T18:05:21.565 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-13T18:05:21.566 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-13T18:05:21.567 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-13T18:05:21.568 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-13T18:05:21.569 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-13T18:05:21.570 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-13T18:05:21.571 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-13T18:05:21.573 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-13T18:05:21.574 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-13T18:05:21.575 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-13T18:05:21.576 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-13T18:05:21.577 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-13T18:05:21.578 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-13T18:05:21.579 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-13T18:05:21.580 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-13T18:05:21.582 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-13T18:05:21.582 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-13T18:05:21.583 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-13T18:05:21.584 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-13T18:05:21.585 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-13T18:05:21.586 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-13T18:05:21.587 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-13T18:05:21.588 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-13T18:05:21.589 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-13T18:05:21.591 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-13T18:05:21.592 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-13T18:05:21.593 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-13T18:05:21.594 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-13T18:05:21.595 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-13T18:05:21.596 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-13T18:05:21.597 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-13T18:05:21.598 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-13T18:05:21.599 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-13T18:05:21.601 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-13T18:05:21.604 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-13T18:05:21.605 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-13T18:05:21.607 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-13T18:05:21.609 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-13T18:05:21.610 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-13T18:05:21.611 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-13T18:05:21.613 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-13T18:05:21.614 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-13T18:05:21.615 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-13T18:05:21.616 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-13T18:05:21.618 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-13T18:05:21.619 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-13T18:05:21.621 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-13T18:05:21.622 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-13T18:05:21.623 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-13T18:05:21.624 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-13T18:05:21.625 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-13T18:05:21.626 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-13T18:05:21.628 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-13T18:05:21.629 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-13T18:05:21.631 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-13T18:05:21.632 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-13T18:05:21.633 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-13T18:05:21.634 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-13T18:05:21.635 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-13T18:05:21.637 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-13T18:05:21.638 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-13T18:05:21.639 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-13T18:05:21.640 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-13T18:05:21.641 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-13T18:05:21.642 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-13T18:05:21.643 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-13T18:05:21.645 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-13T18:05:21.647 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-13T18:05:21.648 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-13T18:05:21.649 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-13T18:05:21.650 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-13T18:05:21.651 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-13T18:05:21.652 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-13T18:05:21.653 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-13T18:05:21.654 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-13T18:05:21.656 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-13T18:05:21.657 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-13T18:05:21.658 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-13T18:05:21.659 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-13T18:05:21.660 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-13T18:05:21.661 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-13T18:05:21.662 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-13T18:05:21.663 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-13T18:05:21.664 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-13T18:05:21.665 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-13T18:05:21.666 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-13T18:05:21.668 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-13T18:05:21.669 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-13T18:05:21.670 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-13T18:05:21.671 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-13T18:05:21.672 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-13T18:05:21.673 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-13T18:05:21.674 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-13T18:05:21.675 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-13T18:05:21.676 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-13T18:05:21.677 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-13T18:05:21.678 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-13T18:05:21.680 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-13T18:05:21.681 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-13T18:05:21.682 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-13T18:05:21.683 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-13T18:05:21.684 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-13T18:05:21.685 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-13T18:05:21.687 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-13T18:05:21.688 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-13T18:05:21.689 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-13T18:05:21.690 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-13T18:05:21.692 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-13T18:05:21.693 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-13T18:05:21.694 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-13T18:05:21.695 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-13T18:05:21.696 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-13T18:05:21.697 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-13T18:05:21.698 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-13T18:05:21.699 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-13T18:05:21.701 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-13T18:05:21.702 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-13T18:05:21.703 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-13T18:05:21.705 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-13T18:05:21.706 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-13T18:05:21.707 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-13T18:05:21.708 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-13T18:05:21.709 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-13T18:05:21.710 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-13T18:05:21.711 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-13T18:05:21.713 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-13T18:05:21.714 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-13T18:05:21.715 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-13T18:05:21.716 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-13T18:05:21.717 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-13T18:05:21.718 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-13T18:05:21.720 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-13T18:05:21.721 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-13T18:05:21.722 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-13T18:05:21.723 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-13T18:05:21.724 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-13T18:05:21.726 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-13T18:05:21.727 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-13T18:05:21.728 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-13T18:05:21.729 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-13T18:05:21.730 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-13T18:05:21.731 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-13T18:05:21.732 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-13T18:05:21.734 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-13T18:05:21.734 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-13T18:05:21.736 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-13T18:05:21.736 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-13T18:05:21.737 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-13T18:05:21.739 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-13T18:05:21.740 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-13T18:05:21.741 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-13T18:05:21.742 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-13T18:05:21.743 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-13T18:05:21.744 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-13T18:05:21.749 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-13T18:05:21.750 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-13T18:05:21.750 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-13T18:05:21.750 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-13T18:05:21.750 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-13T18:05:21.750 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-13T18:05:21.751 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-13T18:05:21.752 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-13T18:05:21.753 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-13T18:05:21.754 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-13T18:05:21.755 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-13T18:05:21.756 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-13T18:05:21.757 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-13T18:05:21.758 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-13T18:05:21.759 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-13T18:05:21.760 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-13T18:05:21.761 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-13T18:05:21.762 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-13T18:05:21.763 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-13T18:05:21.764 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-13T18:05:21.765 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-13T18:05:21.766 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-13T18:05:21.767 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-13T18:05:21.768 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-13T18:05:21.769 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-13T18:05:21.770 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-13T18:05:21.771 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-13T18:05:21.772 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-13T18:05:21.773 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-13T18:05:21.774 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-13T18:05:21.775 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-13T18:05:21.776 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-13T18:05:21.777 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-13T18:05:21.778 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-13T18:05:21.779 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-13T18:05:21.779 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-13T18:05:21.780 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-13T18:05:21.781 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-13T18:05:21.782 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-13T18:05:21.783 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-13T18:05:21.784 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-13T18:05:21.785 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-13T18:05:21.786 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-13T18:05:21.786 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-13T18:05:21.787 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-13T18:05:21.788 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-13T18:05:21.789 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-13T18:05:21.790 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-13T18:05:21.791 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-13T18:05:21.792 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-13T18:05:21.793 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-13T18:05:21.795 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-13T18:05:21.796 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-13T18:05:21.797 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-13T18:05:21.798 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-13T18:05:21.800 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-13T18:05:21.801 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-13T18:05:21.802 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-13T18:05:21.803 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-13T18:05:21.804 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-13T18:05:21.805 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-13T18:05:21.807 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-13T18:05:21.808 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-13T18:05:21.809 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-13T18:05:21.811 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-13T18:05:21.812 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-13T18:05:21.813 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-13T18:05:21.815 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-13T18:05:21.816 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-13T18:05:21.817 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-13T18:05:21.819 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-13T18:05:21.820 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-13T18:05:21.821 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-13T18:05:21.823 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-13T18:05:21.824 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-13T18:05:21.825 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-13T18:05:21.827 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-13T18:05:21.828 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-13T18:05:21.829 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-13T18:05:21.830 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-13T18:05:21.831 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-13T18:05:21.833 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-13T18:05:21.834 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-13T18:05:21.835 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-13T18:05:21.836 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-13T18:05:21.837 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-13T18:05:21.838 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-13T18:05:21.839 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-13T18:05:21.841 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-13T18:05:21.842 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-13T18:05:21.843 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-13T18:05:21.844 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-13T18:05:21.845 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-13T18:05:21.846 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-13T18:05:21.847 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-13T18:05:21.849 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-13T18:05:21.850 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-13T18:05:21.851 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-13T18:05:21.852 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-13T18:05:21.853 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-13T18:05:21.854 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-13T18:05:21.855 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-13T18:05:21.857 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-13T18:05:21.859 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-13T18:05:21.860 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-13T18:05:21.861 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-13T18:05:21.862 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-13T18:05:21.863 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-13T18:05:21.865 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-13T18:05:21.865 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-13T18:05:21.866 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-13T18:05:21.868 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-13T18:05:21.869 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-13T18:05:21.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-13T18:05:21.871 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-13T18:05:21.872 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-13T18:05:21.873 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-13T18:05:21.874 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-13T18:05:21.875 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-13T18:05:21.877 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-13T18:05:21.878 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-13T18:05:21.879 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-13T18:05:21.880 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-13T18:05:21.881 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-13T18:05:21.882 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-13T18:05:21.884 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-13T18:05:21.885 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-13T18:05:21.887 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-13T18:05:21.888 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-13T18:05:21.889 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-13T18:05:21.890 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-13T18:05:21.892 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-13T18:05:21.893 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-13T18:05:21.894 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-13T18:05:21.896 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-13T18:05:21.897 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-13T18:05:21.898 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-13T18:05:21.899 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-13T18:05:21.901 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-13T18:05:21.902 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-13T18:05:21.903 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-13T18:05:21.904 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-13T18:05:21.905 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-13T18:05:21.907 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-13T18:05:21.908 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-13T18:05:21.909 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-13T18:05:21.910 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-13T18:05:21.911 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-13T18:05:21.912 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-13T18:05:21.913 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-13T18:05:21.914 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-13T18:05:21.915 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-13T18:05:21.916 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-13T18:05:21.917 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-13T18:05:21.918 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-13T18:05:21.919 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-13T18:05:21.920 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-13T18:05:21.922 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-13T18:05:21.924 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-13T18:05:21.924 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-13T18:05:21.924 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-13T18:05:21.925 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-13T18:05:21.926 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-13T18:05:21.927 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-13T18:05:21.928 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-13T18:05:21.929 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-13T18:05:21.930 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-13T18:05:21.931 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-13T18:05:21.932 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-13T18:05:21.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-13T18:05:21.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-13T18:05:21.936 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-13T18:05:21.937 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-13T18:05:21.938 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-13T18:05:21.939 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-13T18:05:21.939 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-13T18:05:21.941 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-13T18:05:21.942 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-13T18:05:21.943 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-13T18:05:21.944 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-13T18:05:21.945 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-13T18:05:21.946 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-13T18:05:21.947 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-13T18:05:21.948 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-13T18:05:21.949 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-13T18:05:21.953 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-13T18:05:21.954 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-13T18:05:21.954 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-13T18:05:21.954 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-13T18:05:21.954 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-13T18:05:21.954 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-13T18:05:21.955 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-13T18:05:21.956 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-13T18:05:21.957 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-13T18:05:21.958 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-13T18:05:21.958 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-13T18:05:21.960 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-13T18:05:21.960 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-13T18:05:21.961 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-13T18:05:21.962 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-13T18:05:21.963 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-13T18:05:21.964 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-13T18:05:21.965 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-13T18:05:21.969 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-13T18:05:21.970 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-13T18:05:21.970 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-13T18:05:21.970 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-13T18:05:21.970 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-13T18:05:21.971 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-13T18:05:21.972 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-13T18:05:21.973 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-13T18:05:21.974 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-13T18:05:21.975 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-13T18:05:21.976 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-13T18:05:21.977 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-13T18:05:21.978 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-13T18:05:21.979 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-13T18:05:21.980 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-13T18:05:21.981 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-13T18:05:21.981 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-13T18:05:21.983 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-13T18:05:21.984 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-13T18:05:21.985 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-13T18:05:21.985 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-13T18:05:21.986 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-13T18:05:21.987 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-13T18:05:21.988 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-13T18:05:21.989 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-13T18:05:21.990 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-13T18:05:21.991 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-13T18:05:21.992 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-13T18:05:21.993 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-13T18:05:21.994 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-13T18:05:21.994 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-13T18:05:21.995 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-13T18:05:21.996 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-13T18:05:21.997 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-13T18:05:21.998 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-13T18:05:21.999 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-13T18:05:22.000 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-13T18:05:22.001 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-13T18:05:22.002 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-13T18:05:22.003 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-13T18:05:22.004 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-13T18:05:22.005 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-13T18:05:22.006 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-13T18:05:22.007 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-13T18:05:22.008 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-13T18:05:22.009 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-13T18:05:22.009 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-13T18:05:22.010 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-13T18:05:22.011 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-13T18:05:22.012 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-13T18:05:22.013 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-13T18:05:22.015 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-13T18:05:22.015 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-13T18:05:22.016 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-13T18:05:22.017 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-13T18:05:22.019 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-13T18:05:22.019 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-13T18:05:22.020 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-13T18:05:22.021 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-13T18:05:22.022 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-13T18:05:22.022 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-13T18:05:22.023 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-13T18:05:22.025 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-13T18:05:22.025 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-13T18:05:22.026 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-13T18:05:22.027 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-13T18:05:22.028 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-13T18:05:22.029 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-13T18:05:22.030 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-13T18:05:22.031 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-13T18:05:22.032 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-13T18:05:22.033 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-13T18:05:22.034 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-13T18:05:22.035 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-13T18:05:22.036 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-13T18:05:22.037 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-13T18:05:22.038 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-13T18:05:22.039 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-13T18:05:22.039 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-13T18:05:22.041 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-13T18:05:22.042 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-13T18:05:22.042 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-13T18:05:22.043 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-13T18:05:22.044 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-13T18:05:22.045 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-13T18:05:22.046 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-13T18:05:22.047 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-13T18:05:22.048 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-13T18:05:22.049 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-13T18:05:22.050 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-13T18:05:22.051 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-13T18:05:22.052 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-13T18:05:22.053 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-13T18:05:22.054 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-13T18:05:22.055 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-13T18:05:22.056 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-13T18:05:22.057 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-13T18:05:22.059 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-13T18:05:22.060 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-13T18:05:22.061 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-13T18:05:22.062 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-13T18:05:22.063 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-13T18:05:22.064 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-13T18:05:22.065 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-13T18:05:22.065 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-13T18:05:22.066 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-13T18:05:22.067 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-13T18:05:22.068 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-13T18:05:22.069 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-13T18:05:22.070 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-13T18:05:22.071 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-13T18:05:22.072 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-13T18:05:22.073 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-13T18:05:22.074 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-13T18:05:22.075 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-13T18:05:22.076 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-13T18:05:22.077 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-13T18:05:22.078 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-13T18:05:22.079 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-13T18:05:22.080 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-13T18:05:22.081 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-13T18:05:22.081 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-13T18:05:22.082 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-13T18:05:22.083 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-13T18:05:22.084 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-13T18:05:22.085 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-13T18:05:22.085 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-13T18:05:22.086 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-13T18:05:22.088 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-13T18:05:22.089 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-13T18:05:22.090 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-13T18:05:22.091 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-13T18:05:22.091 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-13T18:05:22.092 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-13T18:05:22.093 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-13T18:05:22.094 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-13T18:05:22.094 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-13T18:05:22.095 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-13T18:05:22.096 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-13T18:05:22.096 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-13T18:05:22.097 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-13T18:05:22.098 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-13T18:05:22.099 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-13T18:05:22.100 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-13T18:05:22.101 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-13T18:05:22.101 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-13T18:05:22.102 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-13T18:05:22.103 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-13T18:05:22.104 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-13T18:05:22.105 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-13T18:05:22.105 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-13T18:05:22.106 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-13T18:05:22.107 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-13T18:05:22.107 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-13T18:05:22.108 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-13T18:05:22.110 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-13T18:05:22.110 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-13T18:05:22.111 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-13T18:05:22.112 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-13T18:05:22.113 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-13T18:05:22.114 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-13T18:05:22.114 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-13T18:05:22.115 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-13T18:05:22.117 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-13T18:05:22.118 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-13T18:05:22.119 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-13T18:05:22.120 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-13T18:05:22.121 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-13T18:05:22.122 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-13T18:05:22.123 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-13T18:05:22.124 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-13T18:05:22.125 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-13T18:05:22.126 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-13T18:05:22.127 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-13T18:05:22.128 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-13T18:05:22.129 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-13T18:05:22.129 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-13T18:05:22.130 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-13T18:05:22.131 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-13T18:05:22.132 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-13T18:05:22.133 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-13T18:05:22.135 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-13T18:05:22.136 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-13T18:05:22.136 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-13T18:05:22.137 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-13T18:05:22.139 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-13T18:05:22.140 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-13T18:05:22.141 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-13T18:05:22.142 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-13T18:05:22.143 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-13T18:05:22.144 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-13T18:05:22.144 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-13T18:05:22.145 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-13T18:05:22.146 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-13T18:05:22.147 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-13T18:05:22.148 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-13T18:05:22.149 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-13T18:05:22.150 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-13T18:05:22.152 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-13T18:05:22.152 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-13T18:05:22.157 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-13T18:05:22.158 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-13T18:05:22.158 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-13T18:05:22.158 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-13T18:05:22.158 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-13T18:05:22.158 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-13T18:05:22.159 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-13T18:05:22.160 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-13T18:05:22.161 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-13T18:05:22.162 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-13T18:05:22.163 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-13T18:05:22.163 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-13T18:05:22.164 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-13T18:05:22.165 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-13T18:05:22.166 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-13T18:05:22.167 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-13T18:05:22.168 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-13T18:05:22.169 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-13T18:05:22.170 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-13T18:05:22.171 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-13T18:05:22.173 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-13T18:05:22.173 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-13T18:05:22.174 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-13T18:05:22.175 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-13T18:05:22.176 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-13T18:05:22.177 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-13T18:05:22.178 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-13T18:05:22.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-13T18:05:22.180 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-13T18:05:22.180 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-13T18:05:22.181 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-13T18:05:22.182 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-13T18:05:22.183 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-13T18:05:22.184 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-13T18:05:22.185 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-13T18:05:22.186 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-13T18:05:22.187 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-13T18:05:22.188 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-13T18:05:22.189 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-13T18:05:22.190 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-13T18:05:22.191 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-13T18:05:22.191 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-13T18:05:22.192 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-13T18:05:22.193 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-13T18:05:22.194 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-13T18:05:22.195 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-13T18:05:22.197 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-13T18:05:22.198 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-13T18:05:22.199 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-13T18:05:22.200 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-13T18:05:22.201 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-13T18:05:22.201 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-13T18:05:22.203 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-13T18:05:22.203 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-13T18:05:22.204 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-13T18:05:22.205 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-13T18:05:22.206 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-13T18:05:22.207 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-13T18:05:22.208 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-13T18:05:22.209 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-13T18:05:22.210 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-13T18:05:22.211 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-13T18:05:22.212 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-13T18:05:22.213 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-13T18:05:22.214 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-13T18:05:22.215 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-13T18:05:22.216 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-13T18:05:22.217 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-13T18:05:22.218 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-13T18:05:22.220 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-13T18:05:22.221 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-13T18:05:22.222 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-13T18:05:22.223 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-13T18:05:22.224 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-13T18:05:22.224 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-13T18:05:22.225 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-13T18:05:22.226 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-13T18:05:22.227 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-13T18:05:22.228 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-13T18:05:22.229 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-13T18:05:22.230 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-13T18:05:22.231 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-13T18:05:22.232 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-13T18:05:22.233 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-13T18:05:22.234 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-13T18:05:22.235 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-13T18:05:22.236 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-13T18:05:22.236 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-13T18:05:22.237 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-13T18:05:22.238 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-13T18:05:22.239 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-13T18:05:22.240 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-13T18:05:22.241 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-13T18:05:22.242 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-13T18:05:22.243 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-13T18:05:22.244 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-13T18:05:22.244 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-13T18:05:22.245 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-13T18:05:22.246 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-13T18:05:22.247 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-13T18:05:22.248 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-13T18:05:22.249 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-13T18:05:22.250 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-13T18:05:22.251 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-13T18:05:22.252 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-13T18:05:22.253 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-13T18:05:22.254 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-13T18:05:22.255 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-13T18:05:22.256 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-13T18:05:22.256 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-13T18:05:22.257 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-13T18:05:22.258 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-13T18:05:22.259 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-13T18:05:22.260 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-13T18:05:22.261 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-13T18:05:22.262 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-13T18:05:22.262 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-13T18:05:22.263 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-13T18:05:22.265 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-13T18:05:22.266 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-13T18:05:22.266 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-13T18:05:22.267 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-13T18:05:22.268 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-13T18:05:22.269 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-13T18:05:22.270 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-13T18:05:22.271 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-13T18:05:22.272 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-13T18:05:22.273 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-13T18:05:22.274 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-13T18:05:22.275 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-13T18:05:22.276 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-13T18:05:22.277 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-13T18:05:22.277 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-13T18:05:22.278 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-13T18:05:22.279 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-13T18:05:22.281 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-13T18:05:22.282 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-13T18:05:22.282 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-13T18:05:22.283 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-13T18:05:22.285 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-13T18:05:22.285 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-13T18:05:22.286 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-13T18:05:22.288 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-13T18:05:22.288 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-13T18:05:22.289 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-13T18:05:22.290 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-13T18:05:22.291 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-13T18:05:22.292 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-13T18:05:22.293 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-13T18:05:22.294 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-13T18:05:22.295 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-13T18:05:22.296 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-13T18:05:22.297 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-13T18:05:22.298 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-13T18:05:22.298 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-13T18:05:22.300 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-13T18:05:22.300 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-13T18:05:22.301 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-13T18:05:22.302 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-13T18:05:22.303 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-13T18:05:22.304 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-13T18:05:22.305 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-13T18:05:22.306 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-13T18:05:22.307 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-13T18:05:22.308 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-13T18:05:22.309 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-13T18:05:22.310 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-13T18:05:22.311 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-13T18:05:22.312 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-13T18:05:22.313 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-13T18:05:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-13T18:05:22.314 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-13T18:05:22.315 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-13T18:05:22.316 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-13T18:05:22.317 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-13T18:05:22.318 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-13T18:05:22.319 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-13T18:05:22.320 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-13T18:05:22.321 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-13T18:05:22.322 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-13T18:05:22.323 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-13T18:05:22.324 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-13T18:05:22.325 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-13T18:05:22.326 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-13T18:05:22.327 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-13T18:05:22.327 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-13T18:05:22.328 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-13T18:05:22.329 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-13T18:05:22.330 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-13T18:05:22.331 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-13T18:05:22.331 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-13T18:05:22.332 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-13T18:05:22.333 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-13T18:05:22.334 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-13T18:05:22.335 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-13T18:05:22.336 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-13T18:05:22.337 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-13T18:05:22.338 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-13T18:05:22.339 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-13T18:05:22.340 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-13T18:05:22.341 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-13T18:05:22.342 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-13T18:05:22.343 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-13T18:05:22.343 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-13T18:05:22.344 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-13T18:05:22.345 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-13T18:05:22.346 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-13T18:05:22.347 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-13T18:05:22.348 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-13T18:05:22.349 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-13T18:05:22.350 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-13T18:05:22.351 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-13T18:05:22.352 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-13T18:05:22.353 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-13T18:05:22.354 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-13T18:05:22.354 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-13T18:05:22.355 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-13T18:05:22.356 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-13T18:05:22.361 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-13T18:05:22.361 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-13T18:05:22.362 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-13T18:05:22.362 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-13T18:05:22.362 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-13T18:05:22.362 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-13T18:05:22.363 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-13T18:05:22.364 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-13T18:05:22.365 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-13T18:05:22.366 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-13T18:05:22.367 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-13T18:05:22.367 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-13T18:05:22.368 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-13T18:05:22.369 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-13T18:05:22.370 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-13T18:05:22.371 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-13T18:05:22.372 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-13T18:05:22.373 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-13T18:05:22.374 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-13T18:05:22.375 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-13T18:05:22.376 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-13T18:05:22.377 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-13T18:05:22.378 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-13T18:05:22.379 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-13T18:05:22.380 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-13T18:05:22.381 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-13T18:05:22.382 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-13T18:05:22.383 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-13T18:05:22.384 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-13T18:05:22.385 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-13T18:05:22.386 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-13T18:05:22.387 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-13T18:05:22.388 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-13T18:05:22.389 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-13T18:05:22.390 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-13T18:05:22.391 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-13T18:05:22.391 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-13T18:05:22.392 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-13T18:05:22.393 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-13T18:05:22.394 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-13T18:05:22.394 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-13T18:05:22.395 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-13T18:05:22.396 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-13T18:05:22.397 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-13T18:05:22.398 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-13T18:05:22.399 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-13T18:05:22.400 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-13T18:05:22.401 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-13T18:05:22.402 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-13T18:05:22.403 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-13T18:05:22.404 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-13T18:05:22.405 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-13T18:05:22.406 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-13T18:05:22.407 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-13T18:05:22.408 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-13T18:05:22.409 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-13T18:05:22.410 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-13T18:05:22.411 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-13T18:05:22.412 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-13T18:05:22.413 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-13T18:05:22.414 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-13T18:05:22.415 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-13T18:05:22.415 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-13T18:05:22.416 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-13T18:05:22.417 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-13T18:05:22.418 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-13T18:05:22.418 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-13T18:05:22.419 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-13T18:05:22.420 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-13T18:05:22.421 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-13T18:05:22.422 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-13T18:05:22.423 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-13T18:05:22.424 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-13T18:05:22.425 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-13T18:05:22.426 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-13T18:05:22.427 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-13T18:05:22.428 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-13T18:05:22.429 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-13T18:05:22.430 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-13T18:05:22.430 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-13T18:05:22.431 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-13T18:05:22.432 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-13T18:05:22.433 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-13T18:05:22.434 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-13T18:05:22.434 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-13T18:05:22.435 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-13T18:05:22.436 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-13T18:05:22.437 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-13T18:05:22.438 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-13T18:05:22.439 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-13T18:05:22.440 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-13T18:05:22.441 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-13T18:05:22.442 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-13T18:05:22.443 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-13T18:05:22.443 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-13T18:05:22.444 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-13T18:05:22.445 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-13T18:05:22.446 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-13T18:05:22.447 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-13T18:05:22.448 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-13T18:05:22.449 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-13T18:05:22.449 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-13T18:05:22.450 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-13T18:05:22.451 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-13T18:05:22.452 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-13T18:05:22.453 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-13T18:05:22.454 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-13T18:05:22.454 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-13T18:05:22.455 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-13T18:05:22.456 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-13T18:05:22.457 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-13T18:05:22.458 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-13T18:05:22.459 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-13T18:05:22.459 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-13T18:05:22.461 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-13T18:05:22.462 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-13T18:05:22.462 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-13T18:05:22.463 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-13T18:05:22.464 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-13T18:05:22.466 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-13T18:05:22.466 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-13T18:05:22.467 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-13T18:05:22.468 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-13T18:05:22.469 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-13T18:05:22.470 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-13T18:05:22.471 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-13T18:05:22.472 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-13T18:05:22.473 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-13T18:05:22.474 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-13T18:05:22.475 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-13T18:05:22.476 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-13T18:05:22.477 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-13T18:05:22.478 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-13T18:05:22.479 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-13T18:05:22.480 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-13T18:05:22.481 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-13T18:05:22.482 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-13T18:05:22.483 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-13T18:05:22.484 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-13T18:05:22.485 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-13T18:05:22.485 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-13T18:05:22.486 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-13T18:05:22.487 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-13T18:05:22.488 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-13T18:05:22.489 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-13T18:05:22.491 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-13T18:05:22.491 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-13T18:05:22.492 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-13T18:05:22.493 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-13T18:05:22.494 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-13T18:05:22.495 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-13T18:05:22.496 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-13T18:05:22.497 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-13T18:05:22.650 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-13T18:05:22.651 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-13T18:05:22.652 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-13T18:05:22.653 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-13T18:05:22.654 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-13T18:05:22.655 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-13T18:05:22.656 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-13T18:05:22.657 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-13T18:05:22.658 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-13T18:05:22.659 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-13T18:05:22.660 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-13T18:05:22.661 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-13T18:05:22.663 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-13T18:05:22.663 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-13T18:05:22.664 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-13T18:05:22.665 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-13T18:05:22.666 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-13T18:05:22.668 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-13T18:05:22.669 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-13T18:05:22.670 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-13T18:05:22.671 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-13T18:05:22.672 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-13T18:05:22.673 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-13T18:05:22.674 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-13T18:05:22.676 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-13T18:05:22.677 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-13T18:05:22.678 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-13T18:05:22.680 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-13T18:05:22.681 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-13T18:05:22.682 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-13T18:05:22.683 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-13T18:05:22.684 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-13T18:05:22.685 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-13T18:05:22.686 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-13T18:05:22.687 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-13T18:05:22.688 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-13T18:05:22.689 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-13T18:05:22.690 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-13T18:05:22.691 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-13T18:05:22.692 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-13T18:05:22.693 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-13T18:05:22.694 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-13T18:05:22.695 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-13T18:05:22.696 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-13T18:05:22.697 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-13T18:05:22.697 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-13T18:05:22.699 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-13T18:05:22.700 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-13T18:05:22.701 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-13T18:05:22.702 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-13T18:05:22.703 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-13T18:05:22.704 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-13T18:05:22.705 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-13T18:05:22.706 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-13T18:05:22.707 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-13T18:05:22.708 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-13T18:05:22.708 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-13T18:05:22.710 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-13T18:05:22.711 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-13T18:05:22.712 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-13T18:05:22.713 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-13T18:05:22.715 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-13T18:05:22.715 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-13T18:05:22.716 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-13T18:05:22.717 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-13T18:05:22.718 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-13T18:05:22.719 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-13T18:05:22.720 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-13T18:05:22.721 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-13T18:05:22.722 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-13T18:05:22.723 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-13T18:05:22.724 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-13T18:05:22.726 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-13T18:05:22.726 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-13T18:05:22.727 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-13T18:05:22.728 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-13T18:05:22.729 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-13T18:05:22.730 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-13T18:05:22.732 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-13T18:05:22.733 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-13T18:05:22.734 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-13T18:05:22.735 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-13T18:05:22.736 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-13T18:05:22.736 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-13T18:05:22.737 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-13T18:05:22.738 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-13T18:05:22.740 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-13T18:05:22.741 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-13T18:05:22.742 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-13T18:05:22.743 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-13T18:05:22.745 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-13T18:05:22.745 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-13T18:05:22.746 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-13T18:05:22.747 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-13T18:05:22.749 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-13T18:05:22.749 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-13T18:05:22.750 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-13T18:05:22.751 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-13T18:05:22.753 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-13T18:05:22.753 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-13T18:05:22.754 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-13T18:05:22.756 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-13T18:05:22.756 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-13T18:05:22.758 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-13T18:05:22.758 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-13T18:05:22.759 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-13T18:05:22.760 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-13T18:05:22.762 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-13T18:05:22.762 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-13T18:05:22.763 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-13T18:05:22.765 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-13T18:05:22.766 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-13T18:05:22.767 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-13T18:05:22.768 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-13T18:05:22.769 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-13T18:05:22.773 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-13T18:05:22.773 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-13T18:05:22.773 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-13T18:05:22.773 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/ 2024-09-13T18:05:22.774 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-13T18:05:22.775 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-13T18:05:22.776 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-13T18:05:22.777 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-13T18:05:22.778 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-13T18:05:22.779 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-13T18:05:22.780 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-13T18:05:22.781 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-13T18:05:22.782 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-13T18:05:22.783 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-13T18:05:22.784 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-13T18:05:22.785 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-13T18:05:22.786 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-13T18:05:22.787 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-13T18:05:22.788 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-13T18:05:22.789 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-13T18:05:22.790 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-13T18:05:22.791 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-13T18:05:22.792 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-13T18:05:22.793 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-13T18:05:22.794 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-13T18:05:22.795 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-13T18:05:22.796 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-13T18:05:22.796 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-13T18:05:22.797 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-13T18:05:22.798 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-13T18:05:22.799 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-13T18:05:22.800 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-13T18:05:22.800 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-13T18:05:22.801 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-13T18:05:22.802 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-13T18:05:22.803 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-13T18:05:22.804 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-13T18:05:22.805 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-13T18:05:22.806 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-13T18:05:22.807 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-13T18:05:22.808 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-13T18:05:22.810 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-13T18:05:22.810 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-13T18:05:22.811 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-13T18:05:22.812 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-13T18:05:22.813 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-13T18:05:22.814 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-13T18:05:22.815 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-13T18:05:22.815 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-13T18:05:22.817 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-13T18:05:22.818 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-13T18:05:22.819 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-13T18:05:22.819 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-13T18:05:22.820 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-13T18:05:22.821 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-13T18:05:22.822 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-13T18:05:22.823 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-13T18:05:22.824 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-13T18:05:22.825 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-13T18:05:22.826 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-13T18:05:22.827 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-13T18:05:22.828 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-13T18:05:22.829 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-13T18:05:22.830 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-13T18:05:22.831 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-13T18:05:22.833 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-13T18:05:22.833 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-13T18:05:22.834 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-13T18:05:22.836 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-13T18:05:22.837 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-13T18:05:22.838 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-13T18:05:22.839 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-13T18:05:22.840 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-13T18:05:22.842 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-13T18:05:22.842 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-13T18:05:22.843 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-13T18:05:22.844 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-13T18:05:22.845 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-13T18:05:22.846 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-13T18:05:22.847 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-13T18:05:22.848 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-13T18:05:22.849 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-13T18:05:22.849 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-13T18:05:22.851 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-13T18:05:22.852 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-13T18:05:22.853 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-13T18:05:22.853 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-13T18:05:22.854 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-13T18:05:22.855 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-13T18:05:22.856 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-13T18:05:22.856 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-13T18:05:22.858 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-13T18:05:22.858 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-13T18:05:22.859 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-13T18:05:22.860 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-13T18:05:22.861 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-13T18:05:22.861 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-13T18:05:22.862 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-13T18:05:22.863 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-13T18:05:22.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-13T18:05:22.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-13T18:05:22.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-13T18:05:22.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-13T18:05:22.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-13T18:05:22.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-13T18:05:22.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-13T18:05:22.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-13T18:05:22.871 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-13T18:05:22.872 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-13T18:05:22.873 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-13T18:05:22.874 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-13T18:05:22.875 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-13T18:05:22.876 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-13T18:05:22.877 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-13T18:05:22.878 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-13T18:05:22.879 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-13T18:05:22.880 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-13T18:05:22.881 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-13T18:05:22.882 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-13T18:05:22.883 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-13T18:05:22.884 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-13T18:05:22.886 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-13T18:05:22.887 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-13T18:05:22.888 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-13T18:05:22.889 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-13T18:05:22.890 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-13T18:05:22.891 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-13T18:05:22.892 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-13T18:05:22.893 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-13T18:05:22.894 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-13T18:05:22.895 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-13T18:05:22.896 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-13T18:05:22.897 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-13T18:05:22.898 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-13T18:05:22.899 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-13T18:05:22.900 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-13T18:05:22.901 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-13T18:05:22.902 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-13T18:05:22.903 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-13T18:05:22.904 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-13T18:05:22.906 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-13T18:05:22.906 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-13T18:05:22.907 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-13T18:05:22.908 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-13T18:05:22.909 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-13T18:05:22.910 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-13T18:05:22.911 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-13T18:05:22.912 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-13T18:05:22.913 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-13T18:05:22.914 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-13T18:05:22.915 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-13T18:05:22.916 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-13T18:05:22.918 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-13T18:05:22.918 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-13T18:05:22.919 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-13T18:05:22.920 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-13T18:05:22.921 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-13T18:05:22.923 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-13T18:05:22.924 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-13T18:05:22.925 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-13T18:05:22.926 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-13T18:05:22.931 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-13T18:05:22.933 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-13T18:05:22.942 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-13T18:05:22.945 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-13T18:05:22.948 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-13T18:05:22.953 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-13T18:05:22.973 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-13T18:05:23.051 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-13T18:05:23.117 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-13T18:05:23.117 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-13T18:05:23.118 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/ 2024-09-13T18:05:23.119 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-13T18:05:23.122 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-13T18:05:23.122 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-13T18:05:23.123 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-13T18:05:23.123 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-13T18:05:23.124 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-13T18:05:23.125 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-13T18:05:23.126 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-13T18:05:23.127 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-13T18:05:23.128 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-13T18:05:23.129 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-13T18:05:23.130 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-13T18:05:23.131 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-13T18:05:23.132 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-13T18:05:23.133 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-13T18:05:23.134 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-13T18:05:23.136 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-13T18:05:23.136 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-13T18:05:23.137 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-13T18:05:23.138 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-13T18:05:23.140 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-13T18:05:23.140 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hid/ 2024-09-13T18:05:23.141 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-13T18:05:23.143 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-13T18:05:23.144 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-13T18:05:23.145 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-13T18:05:23.146 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-13T18:05:23.147 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-13T18:05:23.148 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-13T18:05:23.149 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-13T18:05:23.150 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-13T18:05:23.151 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-13T18:05:23.152 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-13T18:05:23.153 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-13T18:05:23.154 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-13T18:05:23.155 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-13T18:05:23.156 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-13T18:05:23.157 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-13T18:05:23.158 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-13T18:05:23.159 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-13T18:05:23.159 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-13T18:05:23.160 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-13T18:05:23.162 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-13T18:05:23.162 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-13T18:05:23.163 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-13T18:05:23.164 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-13T18:05:23.165 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-13T18:05:23.166 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-13T18:05:23.167 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-13T18:05:23.168 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-13T18:05:23.169 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-13T18:05:23.169 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-13T18:05:23.170 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-13T18:05:23.171 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-13T18:05:23.172 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-13T18:05:23.173 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-13T18:05:23.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-13T18:05:23.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-13T18:05:23.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-13T18:05:23.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-13T18:05:23.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-13T18:05:23.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-13T18:05:23.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-13T18:05:23.180 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-13T18:05:23.181 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-13T18:05:23.182 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-13T18:05:23.182 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-13T18:05:23.183 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-13T18:05:23.184 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-13T18:05:23.185 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-13T18:05:23.186 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-13T18:05:23.187 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-13T18:05:23.187 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-13T18:05:23.188 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-13T18:05:23.189 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-13T18:05:23.190 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-13T18:05:23.190 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-13T18:05:23.191 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-13T18:05:23.192 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-13T18:05:23.193 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-13T18:05:23.193 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-13T18:05:23.194 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-13T18:05:23.195 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-13T18:05:23.196 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-13T18:05:23.197 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-13T18:05:23.198 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-13T18:05:23.199 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-13T18:05:23.200 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-13T18:05:23.201 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-13T18:05:23.203 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-13T18:05:23.204 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-13T18:05:23.204 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-13T18:05:23.205 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-13T18:05:23.206 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-13T18:05:23.208 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-13T18:05:23.209 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-13T18:05:23.210 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-13T18:05:23.211 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-13T18:05:23.212 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-13T18:05:23.213 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-13T18:05:23.214 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-13T18:05:23.215 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-13T18:05:23.216 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-13T18:05:23.217 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-13T18:05:23.219 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-13T18:05:23.220 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-13T18:05:23.221 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-13T18:05:23.222 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-13T18:05:23.223 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-13T18:05:23.224 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-13T18:05:23.225 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-13T18:05:23.226 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-13T18:05:23.227 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-13T18:05:23.228 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-13T18:05:23.229 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-13T18:05:23.230 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-13T18:05:23.232 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-13T18:05:23.233 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-13T18:05:23.234 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-13T18:05:23.235 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-13T18:05:23.236 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-13T18:05:23.237 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-13T18:05:23.238 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-13T18:05:23.239 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-13T18:05:23.240 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-13T18:05:23.241 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-13T18:05:23.242 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-13T18:05:23.243 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-13T18:05:23.244 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-13T18:05:23.244 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-13T18:05:23.245 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-13T18:05:23.246 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-13T18:05:23.247 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-13T18:05:23.247 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-13T18:05:23.248 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-13T18:05:23.249 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-13T18:05:23.250 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-13T18:05:23.251 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-13T18:05:23.252 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-13T18:05:23.253 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-13T18:05:23.254 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-13T18:05:23.255 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-13T18:05:23.256 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-13T18:05:23.257 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-13T18:05:23.258 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-13T18:05:23.259 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-13T18:05:23.260 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-13T18:05:23.261 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-13T18:05:23.262 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-13T18:05:23.263 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-13T18:05:23.264 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-13T18:05:23.265 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-13T18:05:23.266 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-13T18:05:23.267 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-13T18:05:23.268 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-13T18:05:23.269 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-13T18:05:23.270 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-13T18:05:23.272 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-13T18:05:23.273 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-13T18:05:23.274 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-13T18:05:23.275 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-13T18:05:23.277 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-13T18:05:23.278 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-13T18:05:23.279 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-13T18:05:23.280 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-13T18:05:23.281 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-13T18:05:23.282 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-13T18:05:23.283 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-13T18:05:23.284 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-13T18:05:23.286 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-13T18:05:23.287 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-13T18:05:23.289 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-13T18:05:23.290 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-13T18:05:23.291 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-13T18:05:23.292 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-13T18:05:23.293 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-13T18:05:23.294 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-13T18:05:23.295 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-13T18:05:23.296 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-13T18:05:23.297 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-13T18:05:23.299 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-13T18:05:23.300 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-13T18:05:23.301 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-13T18:05:23.302 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-13T18:05:23.304 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-13T18:05:23.305 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-13T18:05:23.306 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-13T18:05:23.307 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-13T18:05:23.308 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-13T18:05:23.309 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-13T18:05:23.311 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-13T18:05:23.312 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-13T18:05:23.313 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-13T18:05:23.314 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-13T18:05:23.315 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-13T18:05:23.315 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-13T18:05:23.316 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-13T18:05:23.317 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-13T18:05:23.318 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-13T18:05:23.320 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-13T18:05:23.321 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-13T18:05:23.321 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-13T18:05:23.322 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-13T18:05:23.323 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-13T18:05:23.324 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-13T18:05:23.325 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-13T18:05:23.326 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-13T18:05:23.327 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-13T18:05:23.328 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-13T18:05:23.330 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-13T18:05:23.330 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-13T18:05:23.331 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-13T18:05:23.332 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-13T18:05:23.333 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-13T18:05:23.334 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-13T18:05:23.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:23 smithi122 ceph-mon[35310]: pgmap v401: 97 pgs: 97 active+clean; 37 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-09-13T18:05:23.512 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-13T18:05:23.513 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-13T18:05:23.514 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-13T18:05:23.515 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-13T18:05:23.515 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-13T18:05:23.516 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-13T18:05:23.517 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ide/ 2024-09-13T18:05:23.518 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-13T18:05:23.519 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-13T18:05:23.520 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-13T18:05:23.520 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-13T18:05:23.521 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-13T18:05:23.522 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-13T18:05:23.523 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-13T18:05:23.524 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-13T18:05:23.525 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-13T18:05:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:23 smithi143 ceph-mon[38210]: pgmap v401: 97 pgs: 97 active+clean; 37 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-09-13T18:05:23.526 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-13T18:05:23.527 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-13T18:05:23.528 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-13T18:05:23.529 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-13T18:05:23.530 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/init.txt 2024-09-13T18:05:23.531 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-13T18:05:23.532 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/ 2024-09-13T18:05:23.533 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-13T18:05:23.534 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-13T18:05:23.535 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-13T18:05:23.536 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-13T18:05:23.537 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-13T18:05:23.537 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-13T18:05:23.538 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-13T18:05:23.539 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-13T18:05:23.540 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-13T18:05:23.541 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-13T18:05:23.542 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-13T18:05:23.542 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-13T18:05:23.543 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-13T18:05:23.545 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-13T18:05:23.546 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-13T18:05:23.547 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-13T18:05:23.547 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-13T18:05:23.548 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-13T18:05:23.549 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-13T18:05:23.550 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-13T18:05:23.551 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-13T18:05:23.552 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-13T18:05:23.553 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-13T18:05:23.554 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-13T18:05:23.555 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-13T18:05:23.555 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-13T18:05:23.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:23 smithi027 ceph-mon[30611]: pgmap v401: 97 pgs: 97 active+clean; 37 MiB data, 451 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 3.0 MiB/s wr, 12 op/s 2024-09-13T18:05:23.556 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-13T18:05:23.558 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-13T18:05:23.559 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-13T18:05:23.560 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-13T18:05:23.560 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-13T18:05:23.561 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-13T18:05:23.562 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-13T18:05:23.563 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-13T18:05:23.564 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-13T18:05:23.565 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-13T18:05:23.567 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-13T18:05:23.568 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-13T18:05:23.569 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-13T18:05:23.570 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-13T18:05:23.571 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-13T18:05:23.573 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-13T18:05:23.574 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-13T18:05:23.575 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-13T18:05:23.575 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-13T18:05:23.576 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-13T18:05:23.578 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-13T18:05:23.578 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-13T18:05:23.579 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-13T18:05:23.580 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-13T18:05:23.581 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-13T18:05:23.582 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-13T18:05:23.583 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-13T18:05:23.584 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-13T18:05:23.585 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-13T18:05:23.591 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-13T18:05:23.591 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-13T18:05:23.591 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-13T18:05:23.592 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-13T18:05:23.592 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-13T18:05:23.592 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-13T18:05:23.592 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-13T18:05:23.593 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-13T18:05:23.593 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-13T18:05:23.594 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-13T18:05:23.595 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-13T18:05:23.597 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-13T18:05:23.598 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-13T18:05:23.598 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-13T18:05:23.599 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-13T18:05:23.600 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-13T18:05:23.601 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-13T18:05:23.603 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-13T18:05:23.603 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-13T18:05:23.604 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-13T18:05:23.605 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-13T18:05:23.606 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/java.txt 2024-09-13T18:05:23.608 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-13T18:05:23.608 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-13T18:05:23.609 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-13T18:05:23.610 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-13T18:05:23.611 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-13T18:05:23.612 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-13T18:05:23.613 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-13T18:05:23.615 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-13T18:05:23.615 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-13T18:05:23.616 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-13T18:05:23.617 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-13T18:05:23.619 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-13T18:05:23.619 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-13T18:05:23.620 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-13T18:05:23.622 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-13T18:05:23.624 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-13T18:05:23.625 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-13T18:05:23.626 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-13T18:05:23.627 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-13T18:05:23.628 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-13T18:05:23.629 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-13T18:05:23.630 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-13T18:05:23.631 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-13T18:05:23.633 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-13T18:05:23.634 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-13T18:05:23.635 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-13T18:05:23.636 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-13T18:05:23.637 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-13T18:05:23.638 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-13T18:05:23.639 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-13T18:05:23.640 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-13T18:05:23.641 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-13T18:05:23.642 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-13T18:05:23.643 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-13T18:05:23.644 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-13T18:05:23.645 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-13T18:05:23.646 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-13T18:05:23.647 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-13T18:05:23.648 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-13T18:05:23.649 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/ 2024-09-13T18:05:23.650 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-13T18:05:23.652 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-13T18:05:23.653 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-13T18:05:23.654 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-13T18:05:23.655 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-13T18:05:23.656 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-13T18:05:23.657 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-13T18:05:23.658 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-13T18:05:23.659 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-13T18:05:23.660 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-13T18:05:23.660 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-13T18:05:23.661 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-13T18:05:23.662 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/ 2024-09-13T18:05:23.663 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-13T18:05:23.665 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-13T18:05:23.666 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-13T18:05:23.667 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-13T18:05:23.668 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-13T18:05:23.669 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-13T18:05:23.670 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-13T18:05:23.671 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-13T18:05:23.672 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-13T18:05:23.672 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-13T18:05:23.673 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-13T18:05:23.674 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-13T18:05:23.676 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-13T18:05:23.677 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-13T18:05:23.678 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-13T18:05:23.679 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-13T18:05:23.680 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-13T18:05:23.681 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-13T18:05:23.682 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-13T18:05:23.683 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-13T18:05:23.684 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/md.txt 2024-09-13T18:05:23.685 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-13T18:05:23.686 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-13T18:05:23.755 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-13T18:05:23.756 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-13T18:05:23.757 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-13T18:05:23.758 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/metag/ 2024-09-13T18:05:23.759 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-13T18:05:23.760 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-13T18:05:23.761 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/ 2024-09-13T18:05:23.762 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-13T18:05:23.764 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-13T18:05:23.766 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-13T18:05:23.767 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-13T18:05:23.767 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-13T18:05:23.767 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-13T18:05:23.768 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-13T18:05:23.768 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-13T18:05:23.770 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-13T18:05:23.771 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-13T18:05:23.771 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mips/ 2024-09-13T18:05:23.772 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-13T18:05:23.773 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-13T18:05:23.774 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-13T18:05:23.775 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-13T18:05:23.776 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-13T18:05:23.777 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-13T18:05:23.778 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-13T18:05:23.779 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-13T18:05:23.780 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-13T18:05:23.781 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-13T18:05:23.782 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-13T18:05:23.783 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-13T18:05:23.784 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-13T18:05:23.784 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-13T18:05:23.786 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-13T18:05:23.786 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-13T18:05:23.787 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-13T18:05:23.788 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-13T18:05:23.789 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-13T18:05:23.790 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-13T18:05:23.791 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-13T18:05:23.791 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-13T18:05:23.792 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-13T18:05:23.793 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-13T18:05:23.794 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-13T18:05:23.795 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-13T18:05:23.796 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-13T18:05:23.797 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-13T18:05:23.798 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-13T18:05:23.800 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-13T18:05:23.800 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-13T18:05:23.801 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-13T18:05:23.802 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-13T18:05:23.803 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-13T18:05:23.804 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-13T18:05:23.806 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-13T18:05:23.806 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-13T18:05:23.807 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-13T18:05:23.808 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-13T18:05:23.809 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-13T18:05:23.810 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-13T18:05:23.812 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-13T18:05:23.812 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-13T18:05:23.813 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-13T18:05:23.814 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-13T18:05:23.815 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ 2024-09-13T18:05:23.816 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-13T18:05:23.817 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-13T18:05:23.818 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-13T18:05:23.819 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-13T18:05:23.820 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-13T18:05:23.821 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-13T18:05:23.822 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-13T18:05:23.823 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-13T18:05:23.823 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-13T18:05:23.824 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-13T18:05:23.825 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-13T18:05:23.826 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-13T18:05:23.827 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-13T18:05:23.828 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-13T18:05:23.830 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-13T18:05:23.831 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-13T18:05:23.831 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-13T18:05:23.832 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-13T18:05:23.833 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-13T18:05:23.834 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-13T18:05:23.836 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-13T18:05:23.837 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-13T18:05:23.838 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-13T18:05:23.839 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-13T18:05:23.840 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-13T18:05:23.840 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-13T18:05:23.841 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-13T18:05:23.842 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-13T18:05:23.843 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-13T18:05:23.844 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-13T18:05:23.845 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-13T18:05:23.846 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-13T18:05:23.847 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-13T18:05:23.848 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-13T18:05:23.849 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-13T18:05:23.850 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-13T18:05:23.851 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-13T18:05:23.852 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-13T18:05:23.852 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-13T18:05:23.853 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-13T18:05:23.854 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-13T18:05:23.855 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-13T18:05:23.856 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-13T18:05:23.857 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-13T18:05:23.858 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-13T18:05:23.859 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-13T18:05:23.859 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-13T18:05:23.860 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-13T18:05:23.861 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-13T18:05:23.862 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-13T18:05:23.863 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-13T18:05:23.863 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-13T18:05:23.864 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-13T18:05:23.865 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-13T18:05:23.866 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-13T18:05:23.867 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-13T18:05:23.867 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-13T18:05:23.868 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-13T18:05:23.869 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-13T18:05:23.870 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-13T18:05:23.871 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-13T18:05:23.871 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-13T18:05:23.872 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-13T18:05:23.873 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-13T18:05:23.874 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-13T18:05:23.875 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-13T18:05:23.876 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-13T18:05:23.876 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-13T18:05:23.877 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-13T18:05:23.878 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-13T18:05:23.879 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-13T18:05:23.880 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-13T18:05:23.881 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-13T18:05:23.882 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-13T18:05:23.883 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-13T18:05:23.884 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-13T18:05:23.885 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-13T18:05:23.886 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-13T18:05:23.887 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-13T18:05:23.888 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-13T18:05:23.889 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-13T18:05:23.889 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-13T18:05:23.890 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-13T18:05:23.891 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-13T18:05:23.892 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-13T18:05:23.893 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-13T18:05:23.894 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-13T18:05:23.895 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-13T18:05:23.896 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-13T18:05:23.897 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-13T18:05:23.898 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-13T18:05:23.898 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-13T18:05:23.899 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-13T18:05:23.900 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-13T18:05:23.901 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-13T18:05:23.901 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-13T18:05:23.902 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-13T18:05:23.903 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-13T18:05:23.905 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-13T18:05:23.906 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-13T18:05:23.906 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-13T18:05:23.907 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-13T18:05:23.908 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-13T18:05:23.909 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-13T18:05:23.910 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-13T18:05:23.910 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-13T18:05:23.911 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-13T18:05:23.912 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-13T18:05:23.913 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-13T18:05:23.914 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-13T18:05:23.915 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-13T18:05:23.916 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-13T18:05:23.917 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-13T18:05:23.918 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-13T18:05:23.918 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-13T18:05:23.919 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-13T18:05:23.920 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-13T18:05:23.921 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-13T18:05:23.922 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-13T18:05:23.923 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-13T18:05:23.923 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-13T18:05:23.924 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-13T18:05:23.925 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-13T18:05:23.926 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-13T18:05:23.927 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-13T18:05:23.927 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-13T18:05:23.928 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-13T18:05:23.929 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-13T18:05:23.930 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-13T18:05:23.931 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-13T18:05:23.932 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-13T18:05:23.933 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-13T18:05:23.933 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-13T18:05:23.934 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-13T18:05:23.935 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-13T18:05:23.936 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-13T18:05:23.937 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-13T18:05:23.939 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-13T18:05:23.940 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-13T18:05:23.941 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-13T18:05:23.942 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-13T18:05:23.943 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-13T18:05:23.944 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-13T18:05:23.945 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-13T18:05:23.946 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-13T18:05:23.947 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-13T18:05:23.949 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-13T18:05:23.950 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-13T18:05:23.950 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-13T18:05:23.951 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-13T18:05:23.952 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-13T18:05:23.953 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-13T18:05:23.955 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-13T18:05:23.956 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-13T18:05:23.957 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-13T18:05:23.957 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-13T18:05:23.958 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-13T18:05:23.959 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-13T18:05:23.960 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-13T18:05:23.961 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-13T18:05:23.962 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/phy/ 2024-09-13T18:05:23.962 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-13T18:05:23.963 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-13T18:05:23.965 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-13T18:05:23.966 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/platform/ 2024-09-13T18:05:23.967 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-13T18:05:23.967 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-13T18:05:23.968 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/ 2024-09-13T18:05:23.970 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-13T18:05:23.971 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-13T18:05:23.972 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-13T18:05:23.973 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-13T18:05:23.974 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-13T18:05:23.975 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-13T18:05:23.976 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-13T18:05:23.977 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-13T18:05:23.978 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-13T18:05:23.978 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-13T18:05:23.979 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-13T18:05:23.981 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-13T18:05:23.981 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-13T18:05:23.982 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-13T18:05:23.983 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-13T18:05:23.985 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-13T18:05:23.986 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-13T18:05:23.987 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-13T18:05:23.988 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-13T18:05:23.989 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-13T18:05:23.990 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-13T18:05:23.991 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-13T18:05:23.992 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-13T18:05:23.993 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-13T18:05:23.994 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-13T18:05:23.995 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-13T18:05:23.996 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-13T18:05:23.997 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-13T18:05:23.998 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-13T18:05:23.999 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-13T18:05:24.000 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-13T18:05:24.001 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-13T18:05:24.002 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-13T18:05:24.003 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-13T18:05:24.004 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-13T18:05:24.005 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-13T18:05:24.006 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-13T18:05:24.007 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-13T18:05:24.007 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-13T18:05:24.008 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-13T18:05:24.009 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-13T18:05:24.010 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-13T18:05:24.011 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-13T18:05:24.012 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-13T18:05:24.012 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-13T18:05:24.013 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-13T18:05:24.014 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pps/ 2024-09-13T18:05:24.015 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-13T18:05:24.016 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-13T18:05:24.017 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-13T18:05:24.018 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-13T18:05:24.019 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-13T18:05:24.020 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-13T18:05:24.021 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-13T18:05:24.022 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-13T18:05:24.022 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-13T18:05:24.023 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-13T18:05:24.024 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-13T18:05:24.025 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pti/ 2024-09-13T18:05:24.026 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-13T18:05:24.028 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-13T18:05:24.029 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-13T18:05:24.030 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-13T18:05:24.031 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-13T18:05:24.032 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-13T18:05:24.033 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-13T18:05:24.034 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-13T18:05:24.035 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-13T18:05:24.036 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-13T18:05:24.037 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-13T18:05:24.038 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-13T18:05:24.038 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-13T18:05:24.039 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-13T18:05:24.041 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-13T18:05:24.042 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-13T18:05:24.043 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-13T18:05:24.044 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-13T18:05:24.045 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-13T18:05:24.046 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-13T18:05:24.048 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/ 2024-09-13T18:05:24.048 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-13T18:05:24.049 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-13T18:05:24.050 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-13T18:05:24.051 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-13T18:05:24.052 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-13T18:05:24.053 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-13T18:05:24.055 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-13T18:05:24.055 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-13T18:05:24.056 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-13T18:05:24.057 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-13T18:05:24.058 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-13T18:05:24.059 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-13T18:05:24.060 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-13T18:05:24.065 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-13T18:05:24.065 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-13T18:05:24.065 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-13T18:05:24.065 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-13T18:05:24.065 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-13T18:05:24.066 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-13T18:05:24.067 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-13T18:05:24.068 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-13T18:05:24.069 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-13T18:05:24.070 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-13T18:05:24.070 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-13T18:05:24.071 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-13T18:05:24.072 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-13T18:05:24.073 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-13T18:05:24.075 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-13T18:05:24.076 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-13T18:05:24.077 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-13T18:05:24.077 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-13T18:05:24.078 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-13T18:05:24.079 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-13T18:05:24.081 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-13T18:05:24.082 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-13T18:05:24.082 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-13T18:05:24.083 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-13T18:05:24.084 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-13T18:05:24.085 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-13T18:05:24.086 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-13T18:05:24.087 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-13T18:05:24.088 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-13T18:05:24.089 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-13T18:05:24.089 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-13T18:05:24.090 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-13T18:05:24.091 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-13T18:05:24.092 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-13T18:05:24.093 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-13T18:05:24.094 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-13T18:05:24.094 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-13T18:05:24.095 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-13T18:05:24.096 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-13T18:05:24.097 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-13T18:05:24.098 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-13T18:05:24.099 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-13T18:05:24.100 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-13T18:05:24.101 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-13T18:05:24.102 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-13T18:05:24.103 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-13T18:05:24.104 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-13T18:05:24.105 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-13T18:05:24.106 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-13T18:05:24.106 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-13T18:05:24.107 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-13T18:05:24.108 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-13T18:05:24.110 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-13T18:05:24.110 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-13T18:05:24.111 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-13T18:05:24.112 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-13T18:05:24.113 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-13T18:05:24.114 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-13T18:05:24.115 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-13T18:05:24.116 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-13T18:05:24.117 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-13T18:05:24.119 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-13T18:05:24.121 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-13T18:05:24.122 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-13T18:05:24.123 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-13T18:05:24.125 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-13T18:05:24.125 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-13T18:05:24.126 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-13T18:05:24.127 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-13T18:05:24.128 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-13T18:05:24.129 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-13T18:05:24.130 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-13T18:05:24.131 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/ 2024-09-13T18:05:24.132 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-13T18:05:24.133 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-13T18:05:24.134 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-13T18:05:24.135 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-13T18:05:24.136 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-13T18:05:24.137 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-13T18:05:24.138 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-13T18:05:24.139 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-13T18:05:24.140 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-13T18:05:24.141 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-13T18:05:24.142 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-13T18:05:24.143 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-13T18:05:24.144 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-13T18:05:24.145 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-13T18:05:24.146 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial/ 2024-09-13T18:05:24.147 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-13T18:05:24.148 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-13T18:05:24.149 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-13T18:05:24.150 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-13T18:05:24.152 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-13T18:05:24.152 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-13T18:05:24.153 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-13T18:05:24.154 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-13T18:05:24.155 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-13T18:05:24.156 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sh/ 2024-09-13T18:05:24.157 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-13T18:05:24.159 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-13T18:05:24.160 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-13T18:05:24.161 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/ 2024-09-13T18:05:24.162 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-13T18:05:24.163 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-13T18:05:24.164 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-13T18:05:24.165 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-13T18:05:24.166 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-13T18:05:24.167 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-13T18:05:24.168 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-13T18:05:24.169 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-13T18:05:24.170 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-13T18:05:24.171 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-13T18:05:24.172 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-13T18:05:24.172 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-13T18:05:24.173 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-13T18:05:24.174 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-13T18:05:24.175 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-13T18:05:24.176 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-13T18:05:24.177 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-13T18:05:24.178 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-13T18:05:24.179 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-13T18:05:24.180 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-13T18:05:24.181 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-13T18:05:24.182 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-13T18:05:24.183 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-13T18:05:24.184 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-13T18:05:24.185 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-13T18:05:24.186 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-13T18:05:24.187 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-13T18:05:24.188 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-13T18:05:24.189 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-13T18:05:24.189 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-13T18:05:24.190 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-13T18:05:24.191 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-13T18:05:24.192 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-13T18:05:24.193 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-13T18:05:24.194 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-13T18:05:24.195 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-13T18:05:24.195 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-13T18:05:24.196 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-13T18:05:24.197 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-13T18:05:24.198 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-13T18:05:24.199 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-13T18:05:24.200 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-13T18:05:24.201 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-13T18:05:24.204 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-13T18:05:24.204 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-13T18:05:24.204 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-13T18:05:24.205 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-13T18:05:24.205 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-13T18:05:24.206 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-13T18:05:24.207 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-13T18:05:24.208 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-13T18:05:24.209 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-13T18:05:24.210 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-13T18:05:24.211 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-13T18:05:24.212 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-13T18:05:24.213 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-13T18:05:24.213 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-13T18:05:24.214 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-13T18:05:24.216 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-13T18:05:24.217 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-13T18:05:24.218 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-13T18:05:24.219 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-13T18:05:24.220 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-13T18:05:24.221 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/ 2024-09-13T18:05:24.222 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-13T18:05:24.223 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-13T18:05:24.224 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-13T18:05:24.225 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-13T18:05:24.226 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-13T18:05:24.227 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-13T18:05:24.228 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-13T18:05:24.229 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-13T18:05:24.230 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-13T18:05:24.232 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-13T18:05:24.233 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-13T18:05:24.234 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-13T18:05:24.235 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-13T18:05:24.236 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-13T18:05:24.237 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-13T18:05:24.238 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-13T18:05:24.240 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-13T18:05:24.241 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-13T18:05:24.242 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-13T18:05:24.244 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-13T18:05:24.245 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-13T18:05:24.246 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-13T18:05:24.247 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-13T18:05:24.248 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-13T18:05:24.250 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-13T18:05:24.251 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-13T18:05:24.252 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-13T18:05:24.253 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/target/ 2024-09-13T18:05:24.254 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-13T18:05:24.255 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-13T18:05:24.256 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-13T18:05:24.257 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-13T18:05:24.258 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-13T18:05:24.259 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-13T18:05:24.260 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-13T18:05:24.261 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-13T18:05:24.262 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-13T18:05:24.263 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-13T18:05:24.264 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-13T18:05:24.265 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-13T18:05:24.266 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/ 2024-09-13T18:05:24.267 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-13T18:05:24.268 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-13T18:05:24.269 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-13T18:05:24.269 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-13T18:05:24.270 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-13T18:05:24.271 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-13T18:05:24.272 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-13T18:05:24.273 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-13T18:05:24.274 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-13T18:05:24.275 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-13T18:05:24.276 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-13T18:05:24.277 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-13T18:05:24.278 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-13T18:05:24.280 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/ 2024-09-13T18:05:24.281 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-13T18:05:24.282 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-13T18:05:24.283 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-13T18:05:24.283 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-13T18:05:24.285 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-13T18:05:24.286 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-13T18:05:24.287 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-13T18:05:24.288 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-13T18:05:24.289 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-13T18:05:24.290 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-13T18:05:24.291 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-13T18:05:24.291 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-13T18:05:24.292 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-13T18:05:24.293 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-13T18:05:24.294 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-13T18:05:24.295 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-13T18:05:24.295 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-13T18:05:24.296 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-13T18:05:24.297 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-13T18:05:24.298 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-13T18:05:24.299 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/ 2024-09-13T18:05:24.300 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-13T18:05:24.301 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-13T18:05:24.302 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-13T18:05:24.303 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-13T18:05:24.304 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-13T18:05:24.305 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-13T18:05:24.307 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-13T18:05:24.308 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-13T18:05:24.309 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-13T18:05:24.310 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-13T18:05:24.311 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-13T18:05:24.311 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-13T18:05:24.312 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-13T18:05:24.313 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-13T18:05:24.314 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-13T18:05:24.315 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-13T18:05:24.316 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-13T18:05:24.317 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-13T18:05:24.318 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-13T18:05:24.319 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-13T18:05:24.320 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-13T18:05:24.321 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-13T18:05:24.322 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-13T18:05:24.323 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-13T18:05:24.323 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-13T18:05:24.324 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-13T18:05:24.325 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-13T18:05:24.326 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-13T18:05:24.327 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-13T18:05:24.329 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-13T18:05:24.329 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-13T18:05:24.330 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-13T18:05:24.331 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-13T18:05:24.332 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-13T18:05:24.333 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-13T18:05:24.334 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-13T18:05:24.336 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-13T18:05:24.336 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-13T18:05:24.337 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-13T18:05:24.338 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-13T18:05:24.339 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-13T18:05:24.340 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-13T18:05:24.341 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-13T18:05:24.342 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-13T18:05:24.344 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-13T18:05:24.344 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-13T18:05:24.345 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-13T18:05:24.346 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-13T18:05:24.348 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-13T18:05:24.348 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-13T18:05:24.349 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-13T18:05:24.350 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-13T18:05:24.352 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-13T18:05:24.353 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-13T18:05:24.354 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-13T18:05:24.355 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-13T18:05:24.356 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-13T18:05:24.357 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-13T18:05:24.358 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-13T18:05:24.359 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-13T18:05:24.359 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-13T18:05:24.361 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-13T18:05:24.361 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-13T18:05:24.362 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-13T18:05:24.363 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-13T18:05:24.364 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-13T18:05:24.365 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-13T18:05:24.366 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-13T18:05:24.366 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-13T18:05:24.367 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-13T18:05:24.369 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-13T18:05:24.370 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-13T18:05:24.371 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-13T18:05:24.372 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-13T18:05:24.373 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-13T18:05:24.374 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-13T18:05:24.375 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-13T18:05:24.377 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-13T18:05:24.378 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-13T18:05:24.379 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-13T18:05:24.380 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-13T18:05:24.381 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-13T18:05:24.382 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-13T18:05:24.384 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-13T18:05:24.385 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-13T18:05:24.385 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-13T18:05:24.387 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-13T18:05:24.388 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-13T18:05:24.389 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-13T18:05:24.390 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-13T18:05:24.391 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-13T18:05:24.393 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-13T18:05:24.394 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-13T18:05:24.395 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-13T18:05:24.396 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-13T18:05:24.397 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-13T18:05:24.398 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-13T18:05:24.399 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-13T18:05:24.400 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-13T18:05:24.401 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-13T18:05:24.403 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-13T18:05:24.404 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-13T18:05:24.405 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-13T18:05:24.406 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-13T18:05:24.408 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-13T18:05:24.408 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-13T18:05:24.410 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-13T18:05:24.411 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-13T18:05:24.412 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-13T18:05:24.413 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-13T18:05:24.414 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-13T18:05:24.415 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-13T18:05:24.415 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-13T18:05:24.416 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-13T18:05:24.417 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-13T18:05:24.418 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-13T18:05:24.419 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-13T18:05:24.420 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-13T18:05:24.421 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-13T18:05:24.421 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-13T18:05:24.423 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-13T18:05:24.424 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-13T18:05:24.425 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-13T18:05:24.426 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-13T18:05:24.426 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-13T18:05:24.427 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-13T18:05:24.428 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-13T18:05:24.430 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-13T18:05:24.431 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-13T18:05:24.432 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-13T18:05:24.433 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-13T18:05:24.434 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-13T18:05:24.435 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-13T18:05:24.436 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-13T18:05:24.438 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-13T18:05:24.438 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-13T18:05:24.439 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-13T18:05:24.440 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-13T18:05:24.441 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-13T18:05:24.442 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-13T18:05:24.444 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-13T18:05:24.444 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-13T18:05:24.445 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-13T18:05:24.446 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-13T18:05:24.447 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-13T18:05:24.447 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-13T18:05:24.449 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-13T18:05:24.449 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-13T18:05:24.450 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-13T18:05:24.451 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-13T18:05:24.454 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/ 2024-09-13T18:05:24.455 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-13T18:05:24.456 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-13T18:05:24.456 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-13T18:05:24.458 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-13T18:05:24.459 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-13T18:05:24.459 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-13T18:05:24.460 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-13T18:05:24.461 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-13T18:05:24.462 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-13T18:05:24.463 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-13T18:05:24.464 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-13T18:05:24.465 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-13T18:05:24.466 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-13T18:05:24.467 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-13T18:05:24.468 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-13T18:05:24.469 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-13T18:05:24.470 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-13T18:05:24.471 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-13T18:05:24.472 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-13T18:05:24.474 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-13T18:05:24.474 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-13T18:05:24.475 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-13T18:05:24.476 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-13T18:05:24.477 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-13T18:05:24.478 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-13T18:05:24.479 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/ 2024-09-13T18:05:24.480 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-13T18:05:24.481 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-13T18:05:24.484 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-13T18:05:24.484 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-13T18:05:24.485 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-13T18:05:24.485 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-13T18:05:24.486 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-13T18:05:24.487 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-13T18:05:24.488 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-13T18:05:24.489 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-13T18:05:24.491 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-13T18:05:24.491 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-13T18:05:24.492 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-13T18:05:24.493 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-13T18:05:24.494 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-13T18:05:24.495 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-13T18:05:24.495 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-13T18:05:24.497 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-13T18:05:24.498 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-13T18:05:24.498 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-13T18:05:24.499 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-13T18:05:24.500 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-13T18:05:24.501 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-13T18:05:24.502 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-13T18:05:24.503 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-13T18:05:24.505 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-13T18:05:24.507 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-13T18:05:24.508 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-13T18:05:24.508 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-13T18:05:24.509 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-13T18:05:24.509 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-13T18:05:24.511 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-13T18:05:24.513 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-13T18:05:24.515 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-13T18:05:24.516 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/ 2024-09-13T18:05:24.517 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-13T18:05:24.519 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-13T18:05:24.520 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-13T18:05:24.520 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-13T18:05:24.521 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-13T18:05:24.522 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-13T18:05:24.523 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-13T18:05:24.524 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-13T18:05:24.525 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-13T18:05:24.526 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-13T18:05:24.527 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-13T18:05:24.528 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-13T18:05:24.529 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-13T18:05:24.530 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-13T18:05:24.530 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-13T18:05:24.532 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-13T18:05:24.533 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-13T18:05:24.534 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-13T18:05:24.535 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-13T18:05:24.535 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-13T18:05:24.536 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-13T18:05:24.539 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-13T18:05:24.539 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-13T18:05:24.539 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-13T18:05:24.540 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-13T18:05:24.541 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-13T18:05:24.542 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-13T18:05:24.543 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-13T18:05:24.544 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-13T18:05:24.545 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-13T18:05:24.546 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-13T18:05:24.547 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-13T18:05:24.548 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-13T18:05:24.549 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-13T18:05:24.550 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-13T18:05:24.551 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-13T18:05:24.552 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-13T18:05:24.554 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-13T18:05:24.555 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-13T18:05:24.556 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-13T18:05:24.557 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-13T18:05:24.557 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-13T18:05:24.559 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-13T18:05:24.560 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-13T18:05:24.561 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-13T18:05:24.562 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-13T18:05:24.563 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-13T18:05:24.564 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-13T18:05:24.565 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-13T18:05:24.566 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-13T18:05:24.567 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-13T18:05:24.567 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-13T18:05:24.568 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-13T18:05:24.569 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-13T18:05:24.570 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-13T18:05:24.572 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-13T18:05:24.572 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-13T18:05:24.574 INFO:tasks.workunit.client.0.smithi027.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-13T18:05:25.359 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:25 smithi027 ceph-mon[30611]: pgmap v402: 97 pgs: 97 active+clean; 66 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 5.5 MiB/s wr, 32 op/s 2024-09-13T18:05:25.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:25 smithi122 ceph-mon[35310]: pgmap v402: 97 pgs: 97 active+clean; 66 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 5.5 MiB/s wr, 32 op/s 2024-09-13T18:05:25.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:25 smithi143 ceph-mon[38210]: pgmap v402: 97 pgs: 97 active+clean; 66 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 5.5 MiB/s wr, 32 op/s 2024-09-13T18:05:26.383 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:26 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:26.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:26 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:26.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:26 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:27.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:27 smithi027 ceph-mon[30611]: pgmap v403: 97 pgs: 97 active+clean; 67 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 5.5 MiB/s wr, 39 op/s 2024-09-13T18:05:27.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:27 smithi122 ceph-mon[35310]: pgmap v403: 97 pgs: 97 active+clean; 67 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 5.5 MiB/s wr, 39 op/s 2024-09-13T18:05:27.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:27 smithi143 ceph-mon[38210]: pgmap v403: 97 pgs: 97 active+clean; 67 MiB data, 549 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 5.5 MiB/s wr, 39 op/s 2024-09-13T18:05:29.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:29 smithi122 ceph-mon[35310]: pgmap v404: 97 pgs: 97 active+clean; 90 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 7.5 MiB/s wr, 64 op/s 2024-09-13T18:05:29.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:29 smithi143 ceph-mon[38210]: pgmap v404: 97 pgs: 97 active+clean; 90 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 7.5 MiB/s wr, 64 op/s 2024-09-13T18:05:29.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:29 smithi027 ceph-mon[30611]: pgmap v404: 97 pgs: 97 active+clean; 90 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 508 KiB/s rd, 7.5 MiB/s wr, 64 op/s 2024-09-13T18:05:31.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:31 smithi122 ceph-mon[35310]: pgmap v405: 97 pgs: 97 active+clean; 93 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 7.7 MiB/s wr, 68 op/s 2024-09-13T18:05:31.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:31 smithi143 ceph-mon[38210]: pgmap v405: 97 pgs: 97 active+clean; 93 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 7.7 MiB/s wr, 68 op/s 2024-09-13T18:05:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:31 smithi027 ceph-mon[30611]: pgmap v405: 97 pgs: 97 active+clean; 93 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 843 KiB/s rd, 7.7 MiB/s wr, 68 op/s 2024-09-13T18:05:33.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:33 smithi122 ceph-mon[35310]: pgmap v406: 97 pgs: 97 active+clean; 93 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 5.7 MiB/s wr, 64 op/s 2024-09-13T18:05:33.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:33 smithi143 ceph-mon[38210]: pgmap v406: 97 pgs: 97 active+clean; 93 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 5.7 MiB/s wr, 64 op/s 2024-09-13T18:05:33.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:33 smithi027 ceph-mon[30611]: pgmap v406: 97 pgs: 97 active+clean; 93 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 5.7 MiB/s wr, 64 op/s 2024-09-13T18:05:35.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:35 smithi122 ceph-mon[35310]: pgmap v407: 97 pgs: 97 active+clean; 96 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.0 MiB/s wr, 105 op/s 2024-09-13T18:05:35.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:35 smithi143 ceph-mon[38210]: pgmap v407: 97 pgs: 97 active+clean; 96 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.0 MiB/s wr, 105 op/s 2024-09-13T18:05:35.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:35 smithi027 ceph-mon[30611]: pgmap v407: 97 pgs: 97 active+clean; 96 MiB data, 654 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 5.0 MiB/s wr, 105 op/s 2024-09-13T18:05:37.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:37 smithi122 ceph-mon[35310]: pgmap v408: 97 pgs: 97 active+clean; 99 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 2.9 MiB/s wr, 86 op/s 2024-09-13T18:05:37.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:37 smithi143 ceph-mon[38210]: pgmap v408: 97 pgs: 97 active+clean; 99 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 2.9 MiB/s wr, 86 op/s 2024-09-13T18:05:37.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:37 smithi027 ceph-mon[30611]: pgmap v408: 97 pgs: 97 active+clean; 99 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 783 KiB/s rd, 2.9 MiB/s wr, 86 op/s 2024-09-13T18:05:39.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:39 smithi122 ceph-mon[35310]: pgmap v409: 97 pgs: 97 active+clean; 103 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 82 op/s 2024-09-13T18:05:39.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:39 smithi143 ceph-mon[38210]: pgmap v409: 97 pgs: 97 active+clean; 103 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 82 op/s 2024-09-13T18:05:39.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:39 smithi027 ceph-mon[30611]: pgmap v409: 97 pgs: 97 active+clean; 103 MiB data, 678 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.2 MiB/s wr, 82 op/s 2024-09-13T18:05:41.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:41 smithi122 ceph-mon[35310]: pgmap v410: 97 pgs: 97 active+clean; 109 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 64 op/s 2024-09-13T18:05:41.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:41 smithi143 ceph-mon[38210]: pgmap v410: 97 pgs: 97 active+clean; 109 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 64 op/s 2024-09-13T18:05:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:41 smithi027 ceph-mon[30611]: pgmap v410: 97 pgs: 97 active+clean; 109 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.7 MiB/s wr, 64 op/s 2024-09-13T18:05:43.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:43 smithi122 ceph-mon[35310]: pgmap v411: 97 pgs: 97 active+clean; 109 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 56 op/s 2024-09-13T18:05:43.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:43 smithi143 ceph-mon[38210]: pgmap v411: 97 pgs: 97 active+clean; 109 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 56 op/s 2024-09-13T18:05:43.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:43 smithi027 ceph-mon[30611]: pgmap v411: 97 pgs: 97 active+clean; 109 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 56 op/s 2024-09-13T18:05:45.401 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:45 smithi027 ceph-mon[30611]: pgmap v412: 97 pgs: 97 active+clean; 119 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 76 op/s 2024-09-13T18:05:45.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:45 smithi122 ceph-mon[35310]: pgmap v412: 97 pgs: 97 active+clean; 119 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 76 op/s 2024-09-13T18:05:45.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:45 smithi143 ceph-mon[38210]: pgmap v412: 97 pgs: 97 active+clean; 119 MiB data, 724 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.3 MiB/s wr, 76 op/s 2024-09-13T18:05:47.376 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:47 smithi027 ceph-mon[30611]: pgmap v413: 97 pgs: 97 active+clean; 126 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 133 op/s 2024-09-13T18:05:47.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:47 smithi122 ceph-mon[35310]: pgmap v413: 97 pgs: 97 active+clean; 126 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 133 op/s 2024-09-13T18:05:47.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:47 smithi143 ceph-mon[38210]: pgmap v413: 97 pgs: 97 active+clean; 126 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 133 op/s 2024-09-13T18:05:49.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:49 smithi027 ceph-mon[30611]: pgmap v414: 97 pgs: 97 active+clean; 158 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.5 MiB/s wr, 446 op/s 2024-09-13T18:05:49.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:49 smithi122 ceph-mon[35310]: pgmap v414: 97 pgs: 97 active+clean; 158 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.5 MiB/s wr, 446 op/s 2024-09-13T18:05:49.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:49 smithi143 ceph-mon[38210]: pgmap v414: 97 pgs: 97 active+clean; 158 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.5 MiB/s wr, 446 op/s 2024-09-13T18:05:51.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:51 smithi122 ceph-mon[35310]: pgmap v415: 97 pgs: 97 active+clean; 185 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.1 MiB/s wr, 826 op/s 2024-09-13T18:05:51.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:51 smithi143 ceph-mon[38210]: pgmap v415: 97 pgs: 97 active+clean; 185 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.1 MiB/s wr, 826 op/s 2024-09-13T18:05:51.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:51 smithi027 ceph-mon[30611]: pgmap v415: 97 pgs: 97 active+clean; 185 MiB data, 990 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.1 MiB/s wr, 826 op/s 2024-09-13T18:05:53.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:53 smithi122 ceph-mon[35310]: pgmap v416: 97 pgs: 97 active+clean; 182 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.6 MiB/s wr, 859 op/s 2024-09-13T18:05:53.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:53 smithi143 ceph-mon[38210]: pgmap v416: 97 pgs: 97 active+clean; 182 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.6 MiB/s wr, 859 op/s 2024-09-13T18:05:53.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:53 smithi027 ceph-mon[30611]: pgmap v416: 97 pgs: 97 active+clean; 182 MiB data, 1008 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 7.6 MiB/s wr, 859 op/s 2024-09-13T18:05:54.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:54 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:54.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:54 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:54.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:54 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:55 smithi122 ceph-mon[35310]: pgmap v417: 97 pgs: 97 active+clean; 180 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 1.04k op/s 2024-09-13T18:05:55.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:55 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:55.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:55 smithi143 ceph-mon[38210]: pgmap v417: 97 pgs: 97 active+clean; 180 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 1.04k op/s 2024-09-13T18:05:55.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:55 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:55 smithi027 ceph-mon[30611]: pgmap v417: 97 pgs: 97 active+clean; 180 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 1.04k op/s 2024-09-13T18:05:55.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:55 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:57 smithi122 ceph-mon[35310]: pgmap v418: 97 pgs: 97 active+clean; 182 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.4 MiB/s wr, 1.05k op/s 2024-09-13T18:05:57.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:57 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:57.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:57 smithi143 ceph-mon[38210]: pgmap v418: 97 pgs: 97 active+clean; 182 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.4 MiB/s wr, 1.05k op/s 2024-09-13T18:05:57.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:57 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:57.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:57 smithi027 ceph-mon[30611]: pgmap v418: 97 pgs: 97 active+clean; 182 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.4 MiB/s wr, 1.05k op/s 2024-09-13T18:05:57.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:57 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:05:59.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:05:59 smithi122 ceph-mon[35310]: pgmap v419: 97 pgs: 97 active+clean; 182 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.1 MiB/s wr, 1.04k op/s 2024-09-13T18:05:59.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:05:59 smithi143 ceph-mon[38210]: pgmap v419: 97 pgs: 97 active+clean; 182 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.1 MiB/s wr, 1.04k op/s 2024-09-13T18:05:59.529 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:05:59 smithi027 ceph-mon[30611]: pgmap v419: 97 pgs: 97 active+clean; 182 MiB data, 980 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.1 MiB/s wr, 1.04k op/s 2024-09-13T18:06:01.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:01 smithi122 ceph-mon[35310]: pgmap v420: 97 pgs: 97 active+clean; 180 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 828 op/s 2024-09-13T18:06:01.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:01 smithi143 ceph-mon[38210]: pgmap v420: 97 pgs: 97 active+clean; 180 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 828 op/s 2024-09-13T18:06:01.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:01 smithi027 ceph-mon[30611]: pgmap v420: 97 pgs: 97 active+clean; 180 MiB data, 961 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 828 op/s 2024-09-13T18:06:03.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:03 smithi122 ceph-mon[35310]: pgmap v421: 97 pgs: 97 active+clean; 179 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 458 op/s 2024-09-13T18:06:03.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:03 smithi143 ceph-mon[38210]: pgmap v421: 97 pgs: 97 active+clean; 179 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 458 op/s 2024-09-13T18:06:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:03 smithi027 ceph-mon[30611]: pgmap v421: 97 pgs: 97 active+clean; 179 MiB data, 941 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.5 MiB/s wr, 458 op/s 2024-09-13T18:06:05.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:05 smithi122 ceph-mon[35310]: pgmap v422: 97 pgs: 97 active+clean; 183 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 484 op/s 2024-09-13T18:06:05.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:05 smithi143 ceph-mon[38210]: pgmap v422: 97 pgs: 97 active+clean; 183 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 484 op/s 2024-09-13T18:06:05.558 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:05 smithi027 ceph-mon[30611]: pgmap v422: 97 pgs: 97 active+clean; 183 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 484 op/s 2024-09-13T18:06:07.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:07 smithi122 ceph-mon[35310]: pgmap v423: 97 pgs: 97 active+clean; 183 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 312 op/s 2024-09-13T18:06:07.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:07 smithi143 ceph-mon[38210]: pgmap v423: 97 pgs: 97 active+clean; 183 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 312 op/s 2024-09-13T18:06:07.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:07 smithi027 ceph-mon[30611]: pgmap v423: 97 pgs: 97 active+clean; 183 MiB data, 956 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 312 op/s 2024-09-13T18:06:09.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:09 smithi122 ceph-mon[35310]: pgmap v424: 97 pgs: 97 active+clean; 191 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 427 op/s 2024-09-13T18:06:09.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:09 smithi143 ceph-mon[38210]: pgmap v424: 97 pgs: 97 active+clean; 191 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 427 op/s 2024-09-13T18:06:09.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:09 smithi027 ceph-mon[30611]: pgmap v424: 97 pgs: 97 active+clean; 191 MiB data, 1009 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.3 MiB/s wr, 427 op/s 2024-09-13T18:06:10.670 INFO:tasks.workunit.client.0.smithi027.stdout:Ok 2024-09-13T18:06:10.671 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:06:10.671 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:06:11.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:11 smithi122 ceph-mon[35310]: pgmap v425: 97 pgs: 97 active+clean; 210 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 513 op/s 2024-09-13T18:06:11.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:11 smithi143 ceph-mon[38210]: pgmap v425: 97 pgs: 97 active+clean; 210 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 513 op/s 2024-09-13T18:06:11.538 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:11 smithi027 ceph-mon[30611]: pgmap v425: 97 pgs: 97 active+clean; 210 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.7 MiB/s wr, 513 op/s 2024-09-13T18:06:13.463 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:13 smithi122 ceph-mon[35310]: pgmap v426: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 427 op/s 2024-09-13T18:06:13.517 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:13 smithi027 ceph-mon[30611]: pgmap v426: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 427 op/s 2024-09-13T18:06:13.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:13 smithi143 ceph-mon[38210]: pgmap v426: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.4 MiB/s wr, 427 op/s 2024-09-13T18:06:14.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:14 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:06:14.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:14 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:06:14.556 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:14 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T18:06:15.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:15 smithi122 ceph-mon[35310]: pgmap v427: 97 pgs: 97 active+clean; 150 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 462 op/s 2024-09-13T18:06:15.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:06:15.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:06:15.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:15 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:06:15.521 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:15 smithi027 ceph-mon[30611]: pgmap v427: 97 pgs: 97 active+clean; 150 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 462 op/s 2024-09-13T18:06:15.521 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:06:15.521 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:06:15.521 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:15 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:06:15.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:15 smithi143 ceph-mon[38210]: pgmap v427: 97 pgs: 97 active+clean; 150 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 462 op/s 2024-09-13T18:06:15.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T18:06:15.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T18:06:15.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:15 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' 2024-09-13T18:06:17.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:17 smithi143 ceph-mon[38210]: pgmap v428: 97 pgs: 97 active+clean; 116 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 417 op/s 2024-09-13T18:06:17.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:17 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:17.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:17 smithi027 ceph-mon[30611]: pgmap v428: 97 pgs: 97 active+clean; 116 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 417 op/s 2024-09-13T18:06:17.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:17 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:17.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:17 smithi122 ceph-mon[35310]: pgmap v428: 97 pgs: 97 active+clean; 116 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.1 MiB/s wr, 417 op/s 2024-09-13T18:06:17.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:17 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:19.517 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:19 smithi027 ceph-mon[30611]: pgmap v429: 97 pgs: 97 active+clean; 117 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 491 op/s 2024-09-13T18:06:19.517 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:19 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:19.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:19 smithi143 ceph-mon[38210]: pgmap v429: 97 pgs: 97 active+clean; 117 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 491 op/s 2024-09-13T18:06:19.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:19 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:19.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:19 smithi122 ceph-mon[35310]: pgmap v429: 97 pgs: 97 active+clean; 117 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 491 op/s 2024-09-13T18:06:19.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:19 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:21.394 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-13T18:06:21.394 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:06:21.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:21 smithi143 ceph-mon[38210]: pgmap v430: 97 pgs: 97 active+clean; 117 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 430 op/s 2024-09-13T18:06:21.536 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:21 smithi027 ceph-mon[30611]: pgmap v430: 97 pgs: 97 active+clean; 117 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 430 op/s 2024-09-13T18:06:21.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:21 smithi122 ceph-mon[35310]: pgmap v430: 97 pgs: 97 active+clean; 117 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 430 op/s 2024-09-13T18:06:22.496 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:22 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:22.498 DEBUG:teuthology.parallel:result is None 2024-09-13T18:06:22.498 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:06:22.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:22 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:22.565 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:06:22.566 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-13T18:06:22.576 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:06:22.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:22 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:22.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.736+0000 7f006ee00640 1 -- 172.21.15.27:0/2864292448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068105a70 msgr2=0x7f0068107ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:22.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.736+0000 7f006ee00640 1 --2- 172.21.15.27:0/2864292448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068105a70 0x7f0068107ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0060009ca0 tx=0x7f006002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.738 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.736+0000 7f006ee00640 1 -- 172.21.15.27:0/2864292448 shutdown_connections 2024-09-13T18:06:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.736+0000 7f006ee00640 1 --2- 172.21.15.27:0/2864292448 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068105a70 0x7f0068107ee0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.736+0000 7f006ee00640 1 --2- 172.21.15.27:0/2864292448 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0068103140 0x7f0068105530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.736+0000 7f006ee00640 1 --2- 172.21.15.27:0/2864292448 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0068100810 0x7f0068102c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.736+0000 7f006ee00640 1 -- 172.21.15.27:0/2864292448 >> 172.21.15.27:0/2864292448 conn(0x7f00680fa3f0 msgr2=0x7f00680fc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.736+0000 7f006ee00640 1 -- 172.21.15.27:0/2864292448 shutdown_connections 2024-09-13T18:06:22.739 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.736+0000 7f006ee00640 1 -- 172.21.15.27:0/2864292448 wait complete. 2024-09-13T18:06:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f006ee00640 1 Processor -- start 2024-09-13T18:06:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f006ee00640 1 -- start start 2024-09-13T18:06:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f006ee00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0068100810 0x7f00681980e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f006ee00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068103140 0x7f0068198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f006ee00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0068105a70 0x7f006819f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:22.741 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f006ee00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006819fbd0 con 0x7f0068100810 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f006ee00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006819fd40 con 0x7f0068105a70 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f006ee00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006819ff00 con 0x7f0068103140 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f0067e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0068100810 0x7f00681980e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.737+0000 7f0067400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068103140 0x7f0068198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0067400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068103140 0x7f0068198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:36862/0 (socket says 172.21.15.27:36862) 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0067400640 1 -- 172.21.15.27:0/4267045458 learned_addr learned my addr 172.21.15.27:0/4267045458 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f006ce00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0068105a70 0x7f006819f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0067400640 1 -- 172.21.15.27:0/4267045458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0068105a70 msgr2=0x7f006819f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0067400640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0068105a70 0x7f006819f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0067400640 1 -- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0068100810 msgr2=0x7f00681980e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0067400640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0068100810 0x7f00681980e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.742 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0067400640 1 -- 172.21.15.27:0/4267045458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0060009900 con 0x7f0068103140 2024-09-13T18:06:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0067e00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0068100810 0x7f00681980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0067400640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068103140 0x7f0068198620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f005400e9f0 tx=0x7f005400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0064c00640 1 -- 172.21.15.27:0/4267045458 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540096c0 con 0x7f0068103140 2024-09-13T18:06:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0064c00640 1 -- 172.21.15.27:0/4267045458 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0054005500 con 0x7f0068103140 2024-09-13T18:06:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00681a01e0 con 0x7f0068103140 2024-09-13T18:06:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.738+0000 7f0064c00640 1 -- 172.21.15.27:0/4267045458 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054010430 con 0x7f0068103140 2024-09-13T18:06:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.739+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00681a06a0 con 0x7f0068103140 2024-09-13T18:06:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.740+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0068107560 con 0x7f0068103140 2024-09-13T18:06:22.743 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.741+0000 7f0064c00640 1 -- 172.21.15.27:0/4267045458 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0054005020 con 0x7f0068103140 2024-09-13T18:06:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.743+0000 7f0064c00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f004c0a1090 0x7f004c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.743+0000 7f0064c00640 1 -- 172.21.15.27:0/4267045458 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0054014070 con 0x7f0068103140 2024-09-13T18:06:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.743+0000 7f0067e00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f004c0a1090 0x7f004c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:22.745 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.744+0000 7f0067e00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f004c0a1090 0x7f004c0a3550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0058009fc0 tx=0x7f0058005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:22.746 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.745+0000 7f0064c00640 1 -- 172.21.15.27:0/4267045458 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f0054096b70 con 0x7f0068103140 2024-09-13T18:06:22.930 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.928+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f006810b810 con 0x7f0068103140 2024-09-13T18:06:22.931 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.930+0000 7f0064c00640 1 -- 172.21.15.27:0/4267045458 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f005409a190 con 0x7f0068103140 2024-09-13T18:06:22.932 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:06:22.932 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":88,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:02:37.160677+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:06:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f004c0a1090 msgr2=0x7f004c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f004c0a1090 0x7f004c0a3550 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0058009fc0 tx=0x7f0058005f90 comp rx=0 tx=0).stop 2024-09-13T18:06:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068103140 msgr2=0x7f0068198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068103140 0x7f0068198620 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f005400e9f0 tx=0x7f005400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 shutdown_connections 2024-09-13T18:06:22.934 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f004c0a1090 0x7f004c0a3550 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f0068105a70 0x7f006819f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f0068103140 0x7f0068198620 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 --2- 172.21.15.27:0/4267045458 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f0068100810 0x7f00681980e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 >> 172.21.15.27:0/4267045458 conn(0x7f00680fa3f0 msgr2=0x7f00680ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 shutdown_connections 2024-09-13T18:06:22.935 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:22.932+0000 7f006ee00640 1 -- 172.21.15.27:0/4267045458 wait complete. 2024-09-13T18:06:22.951 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:57:10.088488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:01:44.492835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:01:45.883650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:06:22.951 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:06:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.112+0000 7fa317200640 1 -- 172.21.15.27:0/3927379814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa318103940 msgr2=0x7fa31810a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.112+0000 7fa317200640 1 --2- 172.21.15.27:0/3927379814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa318103940 0x7fa31810a260 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa310009ca0 tx=0x7fa31002a8b0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.114 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.112+0000 7fa317200640 1 -- 172.21.15.27:0/3927379814 shutdown_connections 2024-09-13T18:06:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.112+0000 7fa317200640 1 --2- 172.21.15.27:0/3927379814 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa318103940 0x7fa31810a260 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.112+0000 7fa317200640 1 --2- 172.21.15.27:0/3927379814 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa318102f80 0x7fa318103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.112+0000 7fa317200640 1 --2- 172.21.15.27:0/3927379814 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa318101e30 0x7fa318102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.112+0000 7fa317200640 1 -- 172.21.15.27:0/3927379814 >> 172.21.15.27:0/3927379814 conn(0x7fa3180fd5b0 msgr2=0x7fa3180ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.112+0000 7fa317200640 1 -- 172.21.15.27:0/3927379814 shutdown_connections 2024-09-13T18:06:23.115 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.112+0000 7fa317200640 1 -- 172.21.15.27:0/3927379814 wait complete. 2024-09-13T18:06:23.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa317200640 1 Processor -- start 2024-09-13T18:06:23.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa317200640 1 -- start start 2024-09-13T18:06:23.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa317200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa318101e30 0x7fa318197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa317200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa318102f80 0x7fa3181983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa317200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa318103940 0x7fa31819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa317200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31819f990 con 0x7fa318102f80 2024-09-13T18:06:23.118 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa317200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31819fb00 con 0x7fa318103940 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa317200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31819fcc0 con 0x7fa318101e30 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa316800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa318103940 0x7fa31819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.113+0000 7fa30fe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa318102f80 0x7fa3181983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa316800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa318103940 0x7fa31819f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:49342/0 (socket says 172.21.15.27:49342) 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa316800640 1 -- 172.21.15.27:0/3639763788 learned_addr learned my addr 172.21.15.27:0/3639763788 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa315e00640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa318101e30 0x7fa318197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa316800640 1 -- 172.21.15.27:0/3639763788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa318101e30 msgr2=0x7fa318197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa316800640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa318101e30 0x7fa318197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa316800640 1 -- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa318102f80 msgr2=0x7fa3181983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa316800640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa318102f80 0x7fa3181983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa316800640 1 -- 172.21.15.27:0/3639763788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa300009490 con 0x7fa318103940 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa30fe00640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa318102f80 0x7fa3181983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.114+0000 7fa316800640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa318103940 0x7fa31819f450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa310030f70 tx=0x7fa310030fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:23.119 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.115+0000 7fa30ea00640 1 -- 172.21.15.27:0/3639763788 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310004040 con 0x7fa318103940 2024-09-13T18:06:23.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.115+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa310009900 con 0x7fa318103940 2024-09-13T18:06:23.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.115+0000 7fa30ea00640 1 -- 172.21.15.27:0/3639763788 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa310004680 con 0x7fa318103940 2024-09-13T18:06:23.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.115+0000 7fa30ea00640 1 -- 172.21.15.27:0/3639763788 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa310045d40 con 0x7fa318103940 2024-09-13T18:06:23.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.115+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3181a0280 con 0x7fa318103940 2024-09-13T18:06:23.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.116+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3181091c0 con 0x7fa318103940 2024-09-13T18:06:23.120 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.118+0000 7fa30ea00640 1 -- 172.21.15.27:0/3639763788 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa310042070 con 0x7fa318103940 2024-09-13T18:06:23.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.119+0000 7fa30ea00640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2fc0a1110 0x7fa2fc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.119+0000 7fa30ea00640 1 -- 172.21.15.27:0/3639763788 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa3100edc30 con 0x7fa318103940 2024-09-13T18:06:23.121 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.119+0000 7fa315e00640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2fc0a1110 0x7fa2fc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.122 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.120+0000 7fa315e00640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2fc0a1110 0x7fa2fc0a35d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa308009bd0 tx=0x7fa308005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:23.123 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.121+0000 7fa30ea00640 1 -- 172.21.15.27:0/3639763788 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fa3100b7400 con 0x7fa318103940 2024-09-13T18:06:23.308 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.306+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa31802c3e0 con 0x7fa318103940 2024-09-13T18:06:23.309 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.307+0000 7fa30ea00640 1 -- 172.21.15.27:0/3639763788 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3100baa20 con 0x7fa318103940 2024-09-13T18:06:23.309 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.309+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2fc0a1110 msgr2=0x7fa2fc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.309+0000 7fa317200640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2fc0a1110 0x7fa2fc0a35d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa308009bd0 tx=0x7fa308005f90 comp rx=0 tx=0).stop 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.309+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa318103940 msgr2=0x7fa31819f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.309+0000 7fa317200640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa318103940 0x7fa31819f450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa310030f70 tx=0x7fa310030fa0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.309+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 shutdown_connections 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.309+0000 7fa317200640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fa2fc0a1110 0x7fa2fc0a35d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.309+0000 7fa317200640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fa318103940 0x7fa31819f450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.310+0000 7fa317200640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fa318102f80 0x7fa3181983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.310+0000 7fa317200640 1 --2- 172.21.15.27:0/3639763788 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fa318101e30 0x7fa318197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.310+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 >> 172.21.15.27:0/3639763788 conn(0x7fa3180fd5b0 msgr2=0x7fa318106390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:23.312 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.310+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 shutdown_connections 2024-09-13T18:06:23.313 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.310+0000 7fa317200640 1 -- 172.21.15.27:0/3639763788 wait complete. 2024-09-13T18:06:23.329 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:06:23.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.492+0000 7f94fec00640 1 -- 172.21.15.27:0/3415289404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94f8105a50 msgr2=0x7f94f8107ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.492+0000 7f94fec00640 1 --2- 172.21.15.27:0/3415289404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94f8105a50 0x7f94f8107ec0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009ca0 tx=0x7f94f002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.492+0000 7f94fec00640 1 -- 172.21.15.27:0/3415289404 shutdown_connections 2024-09-13T18:06:23.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.492+0000 7f94fec00640 1 --2- 172.21.15.27:0/3415289404 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94f8105a50 0x7f94f8107ec0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.492+0000 7f94fec00640 1 --2- 172.21.15.27:0/3415289404 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94f8103120 0x7f94f8105510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.492+0000 7f94fec00640 1 --2- 172.21.15.27:0/3415289404 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94f81007f0 0x7f94f8102be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.492+0000 7f94fec00640 1 -- 172.21.15.27:0/3415289404 >> 172.21.15.27:0/3415289404 conn(0x7f94f80fa3d0 msgr2=0x7f94f80fc810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:23.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.492+0000 7f94fec00640 1 -- 172.21.15.27:0/3415289404 shutdown_connections 2024-09-13T18:06:23.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.492+0000 7f94fec00640 1 -- 172.21.15.27:0/3415289404 wait complete. 2024-09-13T18:06:23.497 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.493+0000 7f94fec00640 1 Processor -- start 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.493+0000 7f94fec00640 1 -- start start 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.493+0000 7f94fec00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94f81007f0 0x7f94f8198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.493+0000 7f94fec00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94f8103120 0x7f94f81985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94fec00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94f8105a50 0x7f94f819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94fec00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f819fb80 con 0x7f94f81007f0 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94fec00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f819fcf0 con 0x7f94f8103120 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94fec00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f819feb0 con 0x7f94f8105a50 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94f7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94f81007f0 0x7f94f8198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94f7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94f81007f0 0x7f94f8198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57676/0 (socket says 172.21.15.27:57676) 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94f7e00640 1 -- 172.21.15.27:0/449824275 learned_addr learned my addr 172.21.15.27:0/449824275 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:06:23.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94f7400640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94f8103120 0x7f94f81985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94fcc00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94f8105a50 0x7f94f819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94f7e00640 1 -- 172.21.15.27:0/449824275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94f8105a50 msgr2=0x7f94f819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94f7e00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94f8105a50 0x7f94f819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94f7e00640 1 -- 172.21.15.27:0/449824275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94f8103120 msgr2=0x7f94f81985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94f7e00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94f8103120 0x7f94f81985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.494+0000 7f94f7e00640 1 -- 172.21.15.27:0/449824275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4009490 con 0x7f94f81007f0 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.495+0000 7f94f7e00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94f81007f0 0x7f94f8198090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f94e800e9f0 tx=0x7f94e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.495+0000 7f94f4c00640 1 -- 172.21.15.27:0/449824275 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8009720 con 0x7f94f81007f0 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.495+0000 7f94f4c00640 1 -- 172.21.15.27:0/449824275 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f94e800cd80 con 0x7f94f81007f0 2024-09-13T18:06:23.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.495+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f0009900 con 0x7f94f81007f0 2024-09-13T18:06:23.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.495+0000 7f94f4c00640 1 -- 172.21.15.27:0/449824275 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8010690 con 0x7f94f81007f0 2024-09-13T18:06:23.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.495+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f81a0510 con 0x7f94f81007f0 2024-09-13T18:06:23.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.496+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f8107540 con 0x7f94f81007f0 2024-09-13T18:06:23.500 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.498+0000 7f94f4c00640 1 -- 172.21.15.27:0/449824275 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f94e80046c0 con 0x7f94f81007f0 2024-09-13T18:06:23.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.499+0000 7f94f4c00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94dc0a1110 0x7f94dc0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.499+0000 7f94f4c00640 1 -- 172.21.15.27:0/449824275 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f94e8014070 con 0x7f94f81007f0 2024-09-13T18:06:23.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.500+0000 7f94f7400640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94dc0a1110 0x7f94dc0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.502 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.500+0000 7f94f7400640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94dc0a1110 0x7f94dc0a35d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f94f81995a0 tx=0x7f94e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:23.505 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.504+0000 7f94f4c00640 1 -- 172.21.15.27:0/449824275 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f94e8096380 con 0x7f94f81007f0 2024-09-13T18:06:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:23 smithi143 ceph-mon[38210]: pgmap v431: 97 pgs: 97 active+clean; 115 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-09-13T18:06:23.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:23 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/4267045458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:06:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:23 smithi027 ceph-mon[30611]: pgmap v431: 97 pgs: 97 active+clean; 115 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-09-13T18:06:23.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:23 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/4267045458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:06:23.615 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:23 smithi122 ceph-mon[35310]: pgmap v431: 97 pgs: 97 active+clean; 115 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 952 KiB/s rd, 1.2 MiB/s wr, 281 op/s 2024-09-13T18:06:23.615 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:23 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/4267045458' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:06:23.685 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.683+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94f810b7f0 con 0x7f94f81007f0 2024-09-13T18:06:23.686 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.684+0000 7f94f4c00640 1 -- 172.21.15.27:0/449824275 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94f810b7f0 con 0x7f94f81007f0 2024-09-13T18:06:23.686 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.685+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94dc0a1110 msgr2=0x7f94dc0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94dc0a1110 0x7f94dc0a35d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f94f81995a0 tx=0x7f94e4005f90 comp rx=0 tx=0).stop 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94f81007f0 msgr2=0x7f94f8198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94f81007f0 0x7f94f8198090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f94e800e9f0 tx=0x7f94e800edf0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 shutdown_connections 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f94dc0a1110 0x7f94dc0a35d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f94f8105a50 0x7f94f819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f94f8103120 0x7f94f81985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 --2- 172.21.15.27:0/449824275 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f94f81007f0 0x7f94f8198090 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.688 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 >> 172.21.15.27:0/449824275 conn(0x7f94f80fa3d0 msgr2=0x7f94f80ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 shutdown_connections 2024-09-13T18:06:23.689 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.686+0000 7f94fec00640 1 -- 172.21.15.27:0/449824275 wait complete. 2024-09-13T18:06:23.704 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.865+0000 7ffb3b800640 1 -- 172.21.15.27:0/3226024932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34101f80 msgr2=0x7ffb34102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.865+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3226024932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34101f80 0x7ffb34102380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ffb24009900 tx=0x7ffb2402a410 comp rx=0 tx=0).stop 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.865+0000 7ffb3b800640 1 -- 172.21.15.27:0/3226024932 shutdown_connections 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.865+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3226024932 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb34103b30 0x7ffb3410a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.865+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3226024932 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb34103170 0x7ffb341035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.865+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3226024932 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34101f80 0x7ffb34102380 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.865+0000 7ffb3b800640 1 -- 172.21.15.27:0/3226024932 >> 172.21.15.27:0/3226024932 conn(0x7ffb340fd700 msgr2=0x7ffb340ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.865+0000 7ffb3b800640 1 -- 172.21.15.27:0/3226024932 shutdown_connections 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.865+0000 7ffb3b800640 1 -- 172.21.15.27:0/3226024932 wait complete. 2024-09-13T18:06:23.870 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.866+0000 7ffb3b800640 1 Processor -- start 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.866+0000 7ffb3b800640 1 -- start start 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.866+0000 7ffb3b800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb34101f80 0x7ffb34198080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.866+0000 7ffb3b800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb34103170 0x7ffb341985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.866+0000 7ffb3b800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34103b30 0x7ffb3419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.866+0000 7ffb3b800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3419fb20 con 0x7ffb34103b30 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.866+0000 7ffb3b800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3419fc90 con 0x7ffb34101f80 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.866+0000 7ffb3b800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3419fe50 con 0x7ffb34103170 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb39800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34103b30 0x7ffb3419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb39800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34103b30 0x7ffb3419f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57690/0 (socket says 172.21.15.27:57690) 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb39800640 1 -- 172.21.15.27:0/3979099315 learned_addr learned my addr 172.21.15.27:0/3979099315 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:06:23.871 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb38e00640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb34101f80 0x7ffb34198080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb2be00640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb34103170 0x7ffb341985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb39800640 1 -- 172.21.15.27:0/3979099315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb34103170 msgr2=0x7ffb341985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb39800640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb34103170 0x7ffb341985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb39800640 1 -- 172.21.15.27:0/3979099315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb34101f80 msgr2=0x7ffb34198080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb39800640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb34101f80 0x7ffb34198080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb39800640 1 -- 172.21.15.27:0/3979099315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24009560 con 0x7ffb34103b30 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.867+0000 7ffb39800640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34103b30 0x7ffb3419f5e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00eb10 tx=0x7ffb2c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.868+0000 7ffb32000640 1 -- 172.21.15.27:0/3979099315 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c004b20 con 0x7ffb34103b30 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.868+0000 7ffb32000640 1 -- 172.21.15.27:0/3979099315 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ffb2c004c80 con 0x7ffb34103b30 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.868+0000 7ffb32000640 1 -- 172.21.15.27:0/3979099315 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c010650 con 0x7ffb34103b30 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.868+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb341a0130 con 0x7ffb34103b30 2024-09-13T18:06:23.872 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.868+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb341a05f0 con 0x7ffb34103b30 2024-09-13T18:06:23.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.869+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb34109370 con 0x7ffb34103b30 2024-09-13T18:06:23.873 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.871+0000 7ffb32000640 1 -- 172.21.15.27:0/3979099315 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ffb2c005020 con 0x7ffb34103b30 2024-09-13T18:06:23.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.872+0000 7ffb32000640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ffb180a1090 0x7ffb180a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:23.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.872+0000 7ffb32000640 1 -- 172.21.15.27:0/3979099315 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ffb2c014070 con 0x7ffb34103b30 2024-09-13T18:06:23.874 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.872+0000 7ffb38e00640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ffb180a1090 0x7ffb180a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:23.875 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.873+0000 7ffb38e00640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ffb180a1090 0x7ffb180a3550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffb2402aa00 tx=0x7ffb240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:23.878 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:23.876+0000 7ffb32000640 1 -- 172.21.15.27:0/3979099315 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7ffb2c096580 con 0x7ffb34103b30 2024-09-13T18:06:24.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.058+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb3402c410 con 0x7ffb34103b30 2024-09-13T18:06:24.060 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.058+0000 7ffb32000640 1 -- 172.21.15.27:0/3979099315 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb2c099ba0 con 0x7ffb34103b30 2024-09-13T18:06:24.061 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-09-13T18:06:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.060+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ffb180a1090 msgr2=0x7ffb180a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.060+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ffb180a1090 0x7ffb180a3550 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ffb2402aa00 tx=0x7ffb240058d0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.060+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34103b30 msgr2=0x7ffb3419f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.060+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34103b30 0x7ffb3419f5e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c00eb10 tx=0x7ffb2c00c2d0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.061+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 shutdown_connections 2024-09-13T18:06:24.063 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.061+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7ffb180a1090 0x7ffb180a3550 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.061+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7ffb34103b30 0x7ffb3419f5e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.061+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7ffb34103170 0x7ffb341985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.061+0000 7ffb3b800640 1 --2- 172.21.15.27:0/3979099315 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7ffb34101f80 0x7ffb34198080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.061+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 >> 172.21.15.27:0/3979099315 conn(0x7ffb340fd700 msgr2=0x7ffb34106540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.061+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 shutdown_connections 2024-09-13T18:06:24.064 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.061+0000 7ffb3b800640 1 -- 172.21.15.27:0/3979099315 wait complete. 2024-09-13T18:06:24.080 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-13T18:06:24.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.238+0000 7f4648000640 1 -- 172.21.15.27:0/2527411312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46400ffda0 msgr2=0x7f46401001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:24.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.238+0000 7f4648000640 1 --2- 172.21.15.27:0/2527411312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46400ffda0 0x7f46401001a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4634009900 tx=0x7f463402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.239+0000 7f4648000640 1 -- 172.21.15.27:0/2527411312 shutdown_connections 2024-09-13T18:06:24.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.239+0000 7f4648000640 1 --2- 172.21.15.27:0/2527411312 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4640101950 0x7f46401081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.239+0000 7f4648000640 1 --2- 172.21.15.27:0/2527411312 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4640100f90 0x7f4640101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.241 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.239+0000 7f4648000640 1 --2- 172.21.15.27:0/2527411312 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f46400ffda0 0x7f46401001a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.239+0000 7f4648000640 1 -- 172.21.15.27:0/2527411312 >> 172.21.15.27:0/2527411312 conn(0x7f46400fb520 msgr2=0x7f46400fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:24.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.239+0000 7f4648000640 1 -- 172.21.15.27:0/2527411312 shutdown_connections 2024-09-13T18:06:24.242 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.239+0000 7f4648000640 1 -- 172.21.15.27:0/2527411312 wait complete. 2024-09-13T18:06:24.243 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4648000640 1 Processor -- start 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4648000640 1 -- start start 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4648000640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46400ffda0 0x7f4640195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4648000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4640100f90 0x7f46401963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4648000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4640101950 0x7f464019d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4648000640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464019d970 con 0x7f4640100f90 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4648000640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464019dae0 con 0x7f46400ffda0 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4648000640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464019dca0 con 0x7f4640101950 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4644c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4640100f90 0x7f46401963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4645600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46400ffda0 0x7f4640195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4644c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4640100f90 0x7f46401963c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:57710/0 (socket says 172.21.15.27:57710) 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.240+0000 7f4644c00640 1 -- 172.21.15.27:0/835482414 learned_addr learned my addr 172.21.15.27:0/835482414 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f4646000640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4640101950 0x7f464019d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:24.244 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f4644c00640 1 -- 172.21.15.27:0/835482414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4640101950 msgr2=0x7f464019d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f4644c00640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4640101950 0x7f464019d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f4644c00640 1 -- 172.21.15.27:0/835482414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46400ffda0 msgr2=0x7f4640195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f4644c00640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46400ffda0 0x7f4640195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f4644c00640 1 -- 172.21.15.27:0/835482414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4634009560 con 0x7f4640100f90 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f4644c00640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4640100f90 0x7f46401963c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f462c00e9f0 tx=0x7f462c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f463e000640 1 -- 172.21.15.27:0/835482414 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c009700 con 0x7f4640100f90 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f463e000640 1 -- 172.21.15.27:0/835482414 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f462c00cd80 con 0x7f4640100f90 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f463e000640 1 -- 172.21.15.27:0/835482414 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c018920 con 0x7f4640100f90 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.241+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464019df80 con 0x7f4640100f90 2024-09-13T18:06:24.245 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.242+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464019e400 con 0x7f4640100f90 2024-09-13T18:06:24.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.242+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4640107230 con 0x7f4640100f90 2024-09-13T18:06:24.246 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.244+0000 7f463e000640 1 -- 172.21.15.27:0/835482414 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f462c018a80 con 0x7f4640100f90 2024-09-13T18:06:24.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.246+0000 7f463e000640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46280a1110 0x7f46280a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:24.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.247+0000 7f463e000640 1 -- 172.21.15.27:0/835482414 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f462c014070 con 0x7f4640100f90 2024-09-13T18:06:24.248 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.247+0000 7f4645600640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46280a1110 0x7f46280a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:24.249 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.247+0000 7f4645600640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46280a1110 0x7f46280a35d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f463402a9e0 tx=0x7f46340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:24.251 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.250+0000 7f463e000640 1 -- 172.21.15.27:0/835482414 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f462c052e20 con 0x7f4640100f90 2024-09-13T18:06:24.485 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.483+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f464002c480 con 0x7f4640100f90 2024-09-13T18:06:24.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.494+0000 7f463e000640 1 -- 172.21.15.27:0/835482414 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) v1 ==== 81+0+733407 (secure 0 0 0) 0x7f462c0963e0 con 0x7f4640100f90 2024-09-13T18:06:24.507 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: "epoch": 20, 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: "active_gid": 14150, 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: "active_name": "x", 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: "active_addrs": { 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:6800", 2024-09-13T18:06:24.508 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 3586663065 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:6801", 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 3586663065 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: "active_addr": "172.21.15.27:6801/3586663065", 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: "active_change": "2024-09-13T17:54:35.275587+0000", 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: "active_mgr_features": 4540138322906710015, 2024-09-13T18:06:24.509 INFO:teuthology.orchestra.run.smithi027.stdout: "available": true, 2024-09-13T18:06:24.510 INFO:teuthology.orchestra.run.smithi027.stdout: "standbys": [ 2024-09-13T18:06:24.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.510 INFO:teuthology.orchestra.run.smithi027.stdout: "gid": 24109, 2024-09-13T18:06:24.510 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "z", 2024-09-13T18:06:24.510 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr_features": 4540138322906710015, 2024-09-13T18:06:24.510 INFO:teuthology.orchestra.run.smithi027.stdout: "available_modules": [ 2024-09-13T18:06:24.510 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.510 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "alerts", 2024-09-13T18:06:24.510 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.511 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.511 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.511 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:24.511 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:24.511 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.511 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.511 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.512 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.513 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.514 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.515 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.516 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.516 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.516 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.516 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.516 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.516 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.516 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.517 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.518 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.518 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.518 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.518 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.518 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_destination": { 2024-09-13T18:06:24.518 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_destination", 2024-09-13T18:06:24.518 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email address to send alerts to", 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_from_name": { 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_from_name", 2024-09-13T18:06:24.519 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "Ceph", 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email From: name", 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.520 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_host": { 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_host", 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP server", 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.521 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_password": { 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_password", 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Password to authenticate with", 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.522 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_port": { 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_port", 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "465", 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP port", 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.523 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_sender": { 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_sender", 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP envelope sender", 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.524 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_ssl": { 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_ssl", 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.525 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_user": { 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_user", 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.526 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "User to authenticate as", 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.527 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "balancer", 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "active": { 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "active", 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.528 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_time": { 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_time", 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.529 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0000", 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_weekday": { 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_weekday", 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.530 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_max_iterations": { 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_max_iterations", 2024-09-13T18:06:24.531 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "25", 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "250", 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_metrics": { 2024-09-13T18:06:24.532 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_metrics", 2024-09-13T18:06:24.533 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.533 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.533 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.533 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T18:06:24.533 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.533 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.533 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.533 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T18:06:24.533 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_step": { 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_step", 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.5", 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0.001", 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "0.999", 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "aggressiveness of optimization", 2024-09-13T18:06:24.534 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "end_time": { 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_time", 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2359", 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.535 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "end_weekday": { 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_weekday", 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.536 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T18:06:24.537 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:06:24.537 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.537 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.537 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.537 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.537 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.537 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.537 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.538 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.539 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.539 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.539 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.539 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.539 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.539 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.539 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.539 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.540 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.541 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.542 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "min_score": { 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_score", 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.543 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.544 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "upmap", 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "crush-compat", 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "none", 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap" 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Balancer mode", 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_ids": { 2024-09-13T18:06:24.545 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_ids", 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.546 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.547 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_deviation": { 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_deviation", 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.548 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T18:06:24.549 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T18:06:24.549 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.549 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.549 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_optimizations": { 2024-09-13T18:06:24.549 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_optimizations", 2024-09-13T18:06:24.549 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:24.549 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.550 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.550 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:24.550 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.550 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.550 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.551 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T18:06:24.551 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.551 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.551 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.551 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.551 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.552 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.552 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephadm", 2024-09-13T18:06:24.552 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.552 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.552 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.553 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_down_multiplier": { 2024-09-13T18:06:24.553 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_down_multiplier", 2024-09-13T18:06:24.553 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:24.553 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.553 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.553 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-13T18:06:24.553 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.554 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.554 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.554 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T18:06:24.554 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.554 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.554 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.555 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_refresh_rate": { 2024-09-13T18:06:24.555 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_refresh_rate", 2024-09-13T18:06:24.555 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.555 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.555 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.556 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "20", 2024-09-13T18:06:24.556 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.556 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.556 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.556 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T18:06:24.556 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.557 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.557 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.557 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_starting_port": { 2024-09-13T18:06:24.557 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_starting_port", 2024-09-13T18:06:24.557 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.558 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.558 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.558 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4721", 2024-09-13T18:06:24.558 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.558 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.558 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.559 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T18:06:24.559 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.559 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.559 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.560 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_ptrace": { 2024-09-13T18:06:24.560 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_ptrace", 2024-09-13T18:06:24.560 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.560 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.560 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.560 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.561 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.561 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.561 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.561 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T18:06:24.561 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T18:06:24.561 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.562 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.562 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_interval": { 2024-09-13T18:06:24.562 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_interval", 2024-09-13T18:06:24.562 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.562 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.562 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.563 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:24.563 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.563 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.563 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.563 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T18:06:24.563 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.564 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.564 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.564 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_memory_target_ratio": { 2024-09-13T18:06:24.564 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T18:06:24.564 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:24.565 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.565 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.565 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.7", 2024-09-13T18:06:24.565 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.565 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.565 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.566 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T18:06:24.566 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.566 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.566 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.566 INFO:teuthology.orchestra.run.smithi027.stdout: "cgroups_split": { 2024-09-13T18:06:24.567 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cgroups_split", 2024-09-13T18:06:24.567 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.567 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.567 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.567 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.567 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.568 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.568 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.568 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T18:06:24.568 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.568 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.568 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.569 INFO:teuthology.orchestra.run.smithi027.stdout: "config_checks_enabled": { 2024-09-13T18:06:24.569 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_checks_enabled", 2024-09-13T18:06:24.569 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.569 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.570 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.570 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.570 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.570 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.570 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.570 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T18:06:24.571 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.571 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.571 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.571 INFO:teuthology.orchestra.run.smithi027.stdout: "config_dashboard": { 2024-09-13T18:06:24.571 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_dashboard", 2024-09-13T18:06:24.571 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.572 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.572 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.572 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.572 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.572 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.573 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.573 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T18:06:24.573 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.573 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.573 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.574 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_alertmanager": { 2024-09-13T18:06:24.574 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_alertmanager", 2024-09-13T18:06:24.574 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.574 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.574 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.574 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T18:06:24.575 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.575 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.575 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.575 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:24.575 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.575 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.576 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.576 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_base": { 2024-09-13T18:06:24.576 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_base", 2024-09-13T18:06:24.576 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.576 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.577 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.577 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T18:06:24.577 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.577 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.577 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.578 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Container image name, without the tag", 2024-09-13T18:06:24.578 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.578 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.578 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.578 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_elasticsearch": { 2024-09-13T18:06:24.579 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_elasticsearch", 2024-09-13T18:06:24.579 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.579 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.579 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.579 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T18:06:24.579 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.579 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.580 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.580 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "elasticsearch container image", 2024-09-13T18:06:24.580 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.580 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.580 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.580 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_grafana": { 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_grafana", 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.581 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_haproxy": { 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_haproxy", 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.582 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T18:06:24.583 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.583 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.583 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.583 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "HAproxy container image", 2024-09-13T18:06:24.583 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.583 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.583 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.583 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_agent": { 2024-09-13T18:06:24.584 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_agent", 2024-09-13T18:06:24.584 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.584 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.584 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.584 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T18:06:24.584 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.584 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.584 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.584 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger agent container image", 2024-09-13T18:06:24.585 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.585 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.585 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.585 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_collector": { 2024-09-13T18:06:24.585 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_collector", 2024-09-13T18:06:24.585 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.585 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.586 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.586 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T18:06:24.586 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.586 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.586 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.586 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger collector container image", 2024-09-13T18:06:24.586 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.586 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.586 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.587 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_query": { 2024-09-13T18:06:24.587 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_query", 2024-09-13T18:06:24.587 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.587 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.587 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.587 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T18:06:24.587 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.587 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger query container image", 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_keepalived": { 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_keepalived", 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.588 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.589 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.589 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T18:06:24.589 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.589 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.589 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.589 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Keepalived container image", 2024-09-13T18:06:24.589 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.589 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.589 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.590 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_loki": { 2024-09-13T18:06:24.590 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_loki", 2024-09-13T18:06:24.590 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.590 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.590 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.590 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T18:06:24.590 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.590 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.591 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.591 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Loki container image", 2024-09-13T18:06:24.591 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.591 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.591 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.591 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_node_exporter": { 2024-09-13T18:06:24.591 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_node_exporter", 2024-09-13T18:06:24.591 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.592 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.592 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.592 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T18:06:24.592 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.592 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.592 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.592 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:24.592 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.593 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.593 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.593 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_nvmeof": { 2024-09-13T18:06:24.593 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_nvmeof", 2024-09-13T18:06:24.594 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.594 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.594 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.594 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T18:06:24.594 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.594 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.594 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.595 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Nvme-of container image", 2024-09-13T18:06:24.595 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.595 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.595 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.595 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_prometheus": { 2024-09-13T18:06:24.596 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_prometheus", 2024-09-13T18:06:24.596 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.596 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.596 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.596 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T18:06:24.597 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.597 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.597 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.597 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:24.597 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.597 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.598 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.598 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_promtail": { 2024-09-13T18:06:24.598 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_promtail", 2024-09-13T18:06:24.598 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.599 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.599 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.599 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T18:06:24.599 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.599 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.599 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.600 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Promtail container image", 2024-09-13T18:06:24.600 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.600 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.600 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.601 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_snmp_gateway": { 2024-09-13T18:06:24.601 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_snmp_gateway", 2024-09-13T18:06:24.601 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.601 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.601 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.601 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T18:06:24.602 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.602 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.602 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.602 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SNMP Gateway container image", 2024-09-13T18:06:24.602 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.602 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.603 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.603 INFO:teuthology.orchestra.run.smithi027.stdout: "container_init": { 2024-09-13T18:06:24.603 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_init", 2024-09-13T18:06:24.603 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.604 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.604 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.604 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.604 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.604 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.604 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.605 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T18:06:24.605 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.605 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.605 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.605 INFO:teuthology.orchestra.run.smithi027.stdout: "daemon_cache_timeout": { 2024-09-13T18:06:24.606 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "daemon_cache_timeout", 2024-09-13T18:06:24.606 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.606 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.606 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.606 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:24.606 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.607 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.607 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.607 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T18:06:24.607 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.607 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.607 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.608 INFO:teuthology.orchestra.run.smithi027.stdout: "default_cephadm_command_timeout": { 2024-09-13T18:06:24.608 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T18:06:24.608 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.608 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.608 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.609 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "900", 2024-09-13T18:06:24.609 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.609 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.609 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.609 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T18:06:24.609 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.610 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.610 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.610 INFO:teuthology.orchestra.run.smithi027.stdout: "default_registry": { 2024-09-13T18:06:24.610 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_registry", 2024-09-13T18:06:24.611 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.611 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.611 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.611 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io", 2024-09-13T18:06:24.611 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.612 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.612 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.612 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T18:06:24.612 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.612 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.613 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.613 INFO:teuthology.orchestra.run.smithi027.stdout: "device_cache_timeout": { 2024-09-13T18:06:24.613 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_cache_timeout", 2024-09-13T18:06:24.613 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.613 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1800", 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache device inventory", 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "device_enhanced_scan": { 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_enhanced_scan", 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.614 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "facts_cache_timeout": { 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "facts_cache_timeout", 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.615 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache host facts data", 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "host_check_interval": { 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "host_check_interval", 2024-09-13T18:06:24.616 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to perform a host check", 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "hw_monitoring": { 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hw_monitoring", 2024-09-13T18:06:24.617 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "inventory_list_all": { 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "inventory_list_all", 2024-09-13T18:06:24.618 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.619 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.620 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "log_refresh_metadata": { 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_refresh_metadata", 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.621 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.622 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.623 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.624 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.625 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "*", 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "max_count_per_host": { 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_count_per_host", 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of daemons per service per host", 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.628 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "max_osd_draining_count": { 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_osd_draining_count", 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.629 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "migration_current": { 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "migration_current", 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "internal - do not modify", 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.630 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "root", 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm-package", 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: "root" 2024-09-13T18:06:24.631 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "oob_default_addr": { 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "oob_default_addr", 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "169.254.1.1", 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.632 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "prometheus_alerts_path": { 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus_alerts_path", 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.633 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_insecure": { 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_insecure", 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.634 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_password": { 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_password", 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.635 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_url": { 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_url", 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.636 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_username": { 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_username", 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.637 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "secure_monitoring_stack": { 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "secure_monitoring_stack", 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.638 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "service_discovery_port": { 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "service_discovery_port", 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8765", 2024-09-13T18:06:24.639 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "cephadm service discovery port", 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "ssh_config_file": { 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssh_config_file", 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.640 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "use_agent": { 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_agent", 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.641 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "use_repo_digest": { 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_repo_digest", 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.642 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_failed_host_check": { 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_failed_host_check", 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.643 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_daemons": { 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_daemons", 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.644 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_hosts": { 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_hosts", 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.645 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crash", 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.646 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.647 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.648 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.649 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.650 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.651 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "retain_interval": { 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retain_interval", 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "31536000", 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.652 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_recent_interval": { 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_recent_interval", 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1209600", 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.653 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dashboard", 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.654 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.655 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.656 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_ENABLED": { 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.657 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.658 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.659 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.660 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.661 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.662 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.663 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.664 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.665 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.666 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.667 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.668 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.669 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_URL": { 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_URL", 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.670 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.671 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.672 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.673 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.674 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.675 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.676 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T18:06:24.677 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T18:06:24.678 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.679 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.680 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T18:06:24.681 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T18:06:24.682 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T18:06:24.683 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T18:06:24.684 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T18:06:24.685 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T18:06:24.686 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T18:06:24.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T18:06:24.688 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8", 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T18:06:24.689 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "45", 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T18:06:24.690 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T18:06:24.691 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T18:06:24.692 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T18:06:24.693 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T18:06:24.694 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T18:06:24.695 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.696 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.697 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.698 INFO:teuthology.orchestra.run.smithi027.stdout: "cross_origin_url": { 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cross_origin_url", 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.699 INFO:teuthology.orchestra.run.smithi027.stdout: "crt_file": { 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crt_file", 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "debug": { 2024-09-13T18:06:24.700 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "debug", 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable/disable debug options", 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "jwt_token_ttl": { 2024-09-13T18:06:24.701 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "jwt_token_ttl", 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "28800", 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-13T18:06:24.702 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.703 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.704 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.705 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.706 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.707 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "motd": { 2024-09-13T18:06:24.708 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "motd", 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "The message of the day", 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect_resolve_ip_addr": { 2024-09-13T18:06:24.709 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-13T18:06:24.710 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.711 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8080", 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.712 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl_server_port": { 2024-09-13T18:06:24.713 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl_server_port", 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8443", 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-13T18:06:24.714 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "redirect", 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect" 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.715 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.716 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "url_prefix": { 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url_prefix", 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.717 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "devicehealth", 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_monitoring": { 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_monitoring", 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.718 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "monitor device health metrics", 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.719 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.720 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.721 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.722 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.723 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "mark_out_threshold": { 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mark_out_threshold", 2024-09-13T18:06:24.724 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2419200", 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_name": { 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_name", 2024-09-13T18:06:24.725 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "device_health_metrics", 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "retention_period": { 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retention_period", 2024-09-13T18:06:24.726 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15552000", 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain device health metrics", 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_frequency": { 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_frequency", 2024-09-13T18:06:24.727 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "self_heal": { 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "self_heal", 2024-09-13T18:06:24.728 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:24.729 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_threshold": { 2024-09-13T18:06:24.730 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_threshold", 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7257600", 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "diskprediction_local", 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.732 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.733 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.735 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.736 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "predict_interval": { 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predict_interval", 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.737 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "predictor_model": { 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predictor_model", 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.738 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "prophetstor", 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.739 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "influx", 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": false, 2024-09-13T18:06:24.740 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "influxdb python module not found", 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "batch_size": { 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "batch_size", 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5000", 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.741 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "database": { 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "database", 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "ceph", 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.742 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": { 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hostname", 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server hostname", 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.743 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "30", 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "5", 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.744 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.745 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.746 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.747 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.748 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.749 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "password": { 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "password", 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "password of InfluxDB server user", 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.750 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "port": { 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "port", 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8086", 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server port", 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.751 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "false", 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.752 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "threads": { 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threads", 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "32", 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T18:06:24.753 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "username": { 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "username", 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "username of InfluxDB server user", 2024-09-13T18:06:24.754 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "verify_ssl": { 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "verify_ssl", 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "true", 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.755 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "insights", 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.756 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.757 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.758 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.759 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.760 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.761 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "iostat", 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.762 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.763 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.764 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.765 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.766 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "k8sevents", 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_event_retention_days": { 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ceph_event_retention_days", 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.767 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7", 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "config_check_secs": { 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_check_secs", 2024-09-13T18:06:24.768 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "10", 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.769 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.770 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.771 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.772 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.773 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "localpool", 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "failure_domain": { 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "failure_domain", 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "host", 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.775 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "failure domain for any created local pool", 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.776 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.777 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.779 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.780 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "min_size": { 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_size", 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.781 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default min_size for any created local pool", 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "num_rep": { 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "num_rep", 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3", 2024-09-13T18:06:24.782 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default replica count for any created local pool", 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_num": { 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_num", 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "128", 2024-09-13T18:06:24.783 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "prefix": { 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prefix", 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.784 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name prefix for any created local pool", 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "subtree": { 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "subtree", 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.785 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "rack", 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mds_autoscaler", 2024-09-13T18:06:24.786 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.787 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.788 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.789 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.790 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.791 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirroring", 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.792 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.793 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.794 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.795 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.796 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "nfs", 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.798 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.799 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.800 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.801 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.802 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "fail_fs": { 2024-09-13T18:06:24.803 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "fail_fs", 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.804 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.805 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.806 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.807 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.808 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator": { 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm", 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "rook", 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "test_orchestrator" 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.810 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Orchestrator backend", 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_perf_query", 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.811 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.812 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.813 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.814 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.815 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_support", 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.817 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.818 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.819 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.820 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.821 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_autoscaler", 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.822 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.823 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.824 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.825 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.826 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:24.827 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.828 INFO:teuthology.orchestra.run.smithi027.stdout: "threshold": { 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threshold", 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1.0", 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "scaling threshold", 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.829 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "progress", 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_pg_recovery_event": { 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_pg_recovery_event", 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.830 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.831 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.832 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.834 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.835 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.836 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "max_completed_events": { 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_completed_events", 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.837 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "50", 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "number of past completed events to remember", 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long the module is going to sleep", 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus", 2024-09-13T18:06:24.839 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "cache": { 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cache", 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.840 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "exclude_perf_counters": { 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "exclude_perf_counters", 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T18:06:24.841 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.842 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.843 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.844 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.845 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.846 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools": { 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools", 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.847 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "300", 2024-09-13T18:06:24.848 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_interval": { 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_interval", 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15.0", 2024-09-13T18:06:24.849 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.850 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "9283", 2024-09-13T18:06:24.851 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "stale_cache_strategy": { 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stale_cache_strategy", 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.852 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "log", 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.853 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "default", 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "default", 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "error" 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.855 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_support", 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.856 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.857 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.858 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.859 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.860 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_snap_create": { 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_snap_create", 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.861 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "mirror_snapshot_schedule": { 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.862 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "trash_purge_schedule": { 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "trash_purge_schedule", 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.863 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.864 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "restful", 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_auth": { 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_auth", 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.865 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.866 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.867 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.868 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.869 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.870 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.871 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.872 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.873 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rgw", 2024-09-13T18:06:24.874 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.875 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.876 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.877 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.878 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.879 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rook", 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.880 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.881 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.882 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.883 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.884 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.885 INFO:teuthology.orchestra.run.smithi027.stdout: "storage_class": { 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "storage_class", 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "local", 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.886 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "selftest", 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.887 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.888 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.889 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.890 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.891 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "roption1": { 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption1", 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.892 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "roption2": { 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption2", 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "xyz", 2024-09-13T18:06:24.893 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption1": { 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption1", 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.894 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption2": { 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption2", 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.895 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption3": { 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption3", 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.896 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption4": { 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption4", 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.897 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption5": { 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption5", 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.898 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption6": { 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption6", 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.899 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption7": { 2024-09-13T18:06:24.900 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption7", 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "42", 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "testkey": { 2024-09-13T18:06:24.901 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testkey", 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "testlkey": { 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testlkey", 2024-09-13T18:06:24.902 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "testnewline": { 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testnewline", 2024-09-13T18:06:24.903 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.904 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snap_schedule", 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_m_granularity": { 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_m_granularity", 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.905 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "dump_on_update": { 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dump_on_update", 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.906 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "dump database to debug log on update", 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.907 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.908 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.909 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.910 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.911 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stats", 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.912 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.913 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.914 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.915 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.916 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.917 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "status", 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.918 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.921 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.922 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telegraf", 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.923 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "address": { 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "address", 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15", 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.926 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.927 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.928 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.929 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.930 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telemetry", 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_basic": { 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_basic", 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.931 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_crash": { 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_crash", 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.932 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_device": { 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_device", 2024-09-13T18:06:24.933 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_ident": { 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_ident", 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.934 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_perf": { 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_perf", 2024-09-13T18:06:24.935 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "contact": { 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "contact", 2024-09-13T18:06:24.936 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "description": { 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "description", 2024-09-13T18:06:24.937 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "device_url": { 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_url", 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.938 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.939 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:24.940 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "24", 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "8", 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "last_opt_revision": { 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "last_opt_revision", 2024-09-13T18:06:24.941 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1", 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard": { 2024-09-13T18:06:24.942 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard", 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard_description": { 2024-09-13T18:06:24.943 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard_description", 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.944 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.945 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.946 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.947 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.948 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "organization": { 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "organization", 2024-09-13T18:06:24.949 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "proxy": { 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "proxy", 2024-09-13T18:06:24.950 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "url": { 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url", 2024-09-13T18:06:24.951 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.952 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "test_orchestrator", 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.953 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.954 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.955 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.956 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.957 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "volumes", 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.958 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.959 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.960 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.961 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.962 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.963 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_clones": { 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_clones", 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4", 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.964 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_delay": { 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_delay", 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.965 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_no_wait": { 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.966 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix", 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "discovery_interval": { 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "discovery_interval", 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "100", 2024-09-13T18:06:24.967 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "identifier": { 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "identifier", 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.968 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.969 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.970 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.971 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.972 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.973 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.974 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.975 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_host": { 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_host", 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.976 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_port": { 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_port", 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10051", 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.977 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_sender": { 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_sender", 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.978 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: "gid": 24116, 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "y", 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: "mgr_features": 4540138322906710015, 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: "available_modules": [ 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "alerts", 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.979 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.980 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.981 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.982 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.983 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.984 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.985 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_destination": { 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_destination", 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email address to send alerts to", 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.986 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_from_name": { 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_from_name", 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "Ceph", 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email From: name", 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_host": { 2024-09-13T18:06:24.987 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_host", 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP server", 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.988 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_password": { 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_password", 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Password to authenticate with", 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.989 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_port": { 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_port", 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "465", 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP port", 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.990 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_sender": { 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_sender", 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP envelope sender", 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.991 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_ssl": { 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_ssl", 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.992 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_user": { 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_user", 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "User to authenticate as", 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.993 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "balancer", 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "active": { 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "active", 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.994 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_time": { 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_time", 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.995 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0000", 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_weekday": { 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_weekday", 2024-09-13T18:06:24.996 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_max_iterations": { 2024-09-13T18:06:24.997 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_max_iterations", 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "25", 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "250", 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_metrics": { 2024-09-13T18:06:24.998 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_metrics", 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_step": { 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_step", 2024-09-13T18:06:24.999 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.5", 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0.001", 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "0.999", 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "aggressiveness of optimization", 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "end_time": { 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_time", 2024-09-13T18:06:25.000 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2359", 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "end_weekday": { 2024-09-13T18:06:25.001 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_weekday", 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.002 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.003 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.004 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.005 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.006 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "min_score": { 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_score", 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.007 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.008 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "upmap", 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "crush-compat", 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "none", 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap" 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Balancer mode", 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.009 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_ids": { 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_ids", 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.010 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.011 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_deviation": { 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_deviation", 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.012 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_optimizations": { 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_optimizations", 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.013 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephadm", 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_down_multiplier": { 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_down_multiplier", 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-13T18:06:25.014 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_refresh_rate": { 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_refresh_rate", 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "20", 2024-09-13T18:06:25.015 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_starting_port": { 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_starting_port", 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4721", 2024-09-13T18:06:25.016 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_ptrace": { 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_ptrace", 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.017 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_interval": { 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_interval", 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.018 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_memory_target_ratio": { 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.7", 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.019 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "cgroups_split": { 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cgroups_split", 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.020 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "config_checks_enabled": { 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_checks_enabled", 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.021 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "config_dashboard": { 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_dashboard", 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.022 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_alertmanager": { 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_alertmanager", 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T18:06:25.023 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_base": { 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_base", 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T18:06:25.024 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Container image name, without the tag", 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_elasticsearch": { 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_elasticsearch", 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T18:06:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "elasticsearch container image", 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_grafana": { 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_grafana", 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T18:06:25.026 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_haproxy": { 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_haproxy", 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.027 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "HAproxy container image", 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_agent": { 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_agent", 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.028 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger agent container image", 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_collector": { 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_collector", 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.029 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger collector container image", 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_query": { 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_query", 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.030 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger query container image", 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_keepalived": { 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_keepalived", 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.031 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Keepalived container image", 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_loki": { 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_loki", 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.032 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Loki container image", 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_node_exporter": { 2024-09-13T18:06:25.033 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_node_exporter", 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_nvmeof": { 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_nvmeof", 2024-09-13T18:06:25.034 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Nvme-of container image", 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_prometheus": { 2024-09-13T18:06:25.035 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_prometheus", 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_promtail": { 2024-09-13T18:06:25.036 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_promtail", 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Promtail container image", 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_snmp_gateway": { 2024-09-13T18:06:25.037 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_snmp_gateway", 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SNMP Gateway container image", 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.038 INFO:teuthology.orchestra.run.smithi027.stdout: "container_init": { 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_init", 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.039 INFO:teuthology.orchestra.run.smithi027.stdout: "daemon_cache_timeout": { 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "daemon_cache_timeout", 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.040 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "default_cephadm_command_timeout": { 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "900", 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.041 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "default_registry": { 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_registry", 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io", 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.042 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "device_cache_timeout": { 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_cache_timeout", 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1800", 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache device inventory", 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.043 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "device_enhanced_scan": { 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_enhanced_scan", 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.044 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "facts_cache_timeout": { 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "facts_cache_timeout", 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache host facts data", 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.045 INFO:teuthology.orchestra.run.smithi027.stdout: "host_check_interval": { 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "host_check_interval", 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to perform a host check", 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.046 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "hw_monitoring": { 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hw_monitoring", 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.047 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "inventory_list_all": { 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "inventory_list_all", 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.048 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.049 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "log_refresh_metadata": { 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_refresh_metadata", 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.050 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.051 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.052 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.053 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.054 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.055 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "*", 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.056 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "max_count_per_host": { 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_count_per_host", 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of daemons per service per host", 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.057 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "max_osd_draining_count": { 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_osd_draining_count", 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T18:06:25.058 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "migration_current": { 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "migration_current", 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "internal - do not modify", 2024-09-13T18:06:25.059 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "root", 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm-package", 2024-09-13T18:06:25.060 INFO:teuthology.orchestra.run.smithi027.stdout: "root" 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "oob_default_addr": { 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "oob_default_addr", 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "169.254.1.1", 2024-09-13T18:06:25.061 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "prometheus_alerts_path": { 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus_alerts_path", 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T18:06:25.062 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_insecure": { 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_insecure", 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.063 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_password": { 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_password", 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.064 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_url": { 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_url", 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.065 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_username": { 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_username", 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.066 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "secure_monitoring_stack": { 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "secure_monitoring_stack", 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.067 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "service_discovery_port": { 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "service_discovery_port", 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.068 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8765", 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "cephadm service discovery port", 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "ssh_config_file": { 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssh_config_file", 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.069 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "use_agent": { 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_agent", 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.070 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "use_repo_digest": { 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_repo_digest", 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.071 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_failed_host_check": { 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_failed_host_check", 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.072 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_daemons": { 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_daemons", 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.073 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_hosts": { 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_hosts", 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.074 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.075 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crash", 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.076 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.077 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.078 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.079 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.080 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "retain_interval": { 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retain_interval", 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "31536000", 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T18:06:25.081 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_recent_interval": { 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_recent_interval", 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1209600", 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T18:06:25.082 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dashboard", 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.083 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.084 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.085 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.085 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.085 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.085 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.085 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.085 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.085 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.085 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.085 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.086 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_ENABLED": { 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.087 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.088 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.089 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.090 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.091 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.092 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.093 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.094 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.095 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.096 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.097 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.098 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.099 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_URL": { 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_URL", 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.100 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.101 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.102 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.103 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.104 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.105 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.106 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.107 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.108 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.109 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.110 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.111 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.112 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.113 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.114 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.115 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.116 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.117 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8", 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.118 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "45", 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.119 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.120 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.121 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.122 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.123 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.124 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.125 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.126 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.127 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "cross_origin_url": { 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cross_origin_url", 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.128 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "crt_file": { 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crt_file", 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.129 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "debug": { 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "debug", 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable/disable debug options", 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.130 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "jwt_token_ttl": { 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "jwt_token_ttl", 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "28800", 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.131 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.132 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.133 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.134 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.135 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.136 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.137 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "motd": { 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "motd", 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "The message of the day", 2024-09-13T18:06:25.138 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect_resolve_ip_addr": { 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.139 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.140 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8080", 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.141 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.142 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl_server_port": { 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl_server_port", 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8443", 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.143 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "redirect", 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.144 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect" 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.145 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "url_prefix": { 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url_prefix", 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.146 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "devicehealth", 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.147 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_monitoring": { 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_monitoring", 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "monitor device health metrics", 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.148 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.149 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.150 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.151 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.152 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.153 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "mark_out_threshold": { 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mark_out_threshold", 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2419200", 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.154 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_name": { 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_name", 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "device_health_metrics", 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.155 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "retention_period": { 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retention_period", 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15552000", 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.156 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain device health metrics", 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_frequency": { 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_frequency", 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.157 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "self_heal": { 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "self_heal", 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.158 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.159 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_threshold": { 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_threshold", 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7257600", 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.160 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "diskprediction_local", 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.161 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.162 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.163 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.164 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.165 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "predict_interval": { 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predict_interval", 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.166 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "predictor_model": { 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predictor_model", 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.167 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "prophetstor", 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.168 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "influx", 2024-09-13T18:06:25.169 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": false, 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "influxdb python module not found", 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "batch_size": { 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "batch_size", 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5000", 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.170 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "database": { 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "database", 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "ceph", 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.171 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": { 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hostname", 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server hostname", 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.172 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "30", 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "5", 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.173 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.174 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.175 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.176 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.177 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "password": { 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "password", 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.178 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "password of InfluxDB server user", 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "port": { 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "port", 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.179 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8086", 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server port", 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.180 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "false", 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "threads": { 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threads", 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.181 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "32", 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "username": { 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "username", 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.182 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "username of InfluxDB server user", 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "verify_ssl": { 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "verify_ssl", 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.183 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "true", 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "insights", 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.184 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.185 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.186 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.187 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.188 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.189 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "iostat", 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.190 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.191 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.192 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.193 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.194 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.195 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "k8sevents", 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_event_retention_days": { 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ceph_event_retention_days", 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7", 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T18:06:25.196 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "config_check_secs": { 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_check_secs", 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "10", 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.197 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.198 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.199 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.200 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.201 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.202 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "localpool", 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "failure_domain": { 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "failure_domain", 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.203 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "host", 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "failure domain for any created local pool", 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.204 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.205 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.206 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.207 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.208 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "min_size": { 2024-09-13T18:06:25.209 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_size", 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default min_size for any created local pool", 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "num_rep": { 2024-09-13T18:06:25.210 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "num_rep", 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3", 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default replica count for any created local pool", 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_num": { 2024-09-13T18:06:25.211 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_num", 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "128", 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "prefix": { 2024-09-13T18:06:25.212 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prefix", 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name prefix for any created local pool", 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "subtree": { 2024-09-13T18:06:25.213 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "subtree", 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "rack", 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.214 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mds_autoscaler", 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.215 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.216 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.217 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.218 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.219 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.220 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirroring", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.221 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.222 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.223 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.224 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.225 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "nfs", 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.226 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.227 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.228 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.229 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.230 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.231 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "fail_fs": { 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "fail_fs", 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.232 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.233 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.234 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.235 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.236 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.237 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator": { 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.238 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm", 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: "rook", 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: "test_orchestrator" 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Orchestrator backend", 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.239 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_perf_query", 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.240 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.241 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.242 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.243 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.244 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_support", 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.245 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.246 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.247 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.248 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.249 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.250 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_autoscaler", 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.251 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.252 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.253 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.254 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.255 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.256 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "threshold": { 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threshold", 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1.0", 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.257 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "scaling threshold", 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "progress", 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_pg_recovery_event": { 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_pg_recovery_event", 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.258 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-13T18:06:25.259 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.260 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.261 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.262 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.263 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.264 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.265 INFO:teuthology.orchestra.run.smithi027.stdout: "max_completed_events": { 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_completed_events", 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "50", 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "number of past completed events to remember", 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.266 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long the module is going to sleep", 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.267 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus", 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "cache": { 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cache", 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.268 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "exclude_perf_counters": { 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "exclude_perf_counters", 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.269 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.270 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.271 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.272 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.273 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.274 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.275 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools": { 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools", 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.276 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "300", 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_interval": { 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_interval", 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15.0", 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.278 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.279 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "9283", 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T18:06:25.280 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "stale_cache_strategy": { 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stale_cache_strategy", 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "log", 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.281 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "default", 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.282 INFO:teuthology.orchestra.run.smithi027.stdout: "default", 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "error" 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-13T18:06:25.283 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_support", 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.284 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.285 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.286 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.287 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.288 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.289 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_snap_create": { 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_snap_create", 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.290 INFO:teuthology.orchestra.run.smithi027.stdout: "mirror_snapshot_schedule": { 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.291 INFO:teuthology.orchestra.run.smithi027.stdout: "trash_purge_schedule": { 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "trash_purge_schedule", 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.292 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "restful", 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_auth": { 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_auth", 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.293 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.294 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.295 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.296 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.297 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.298 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.299 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.300 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.301 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rgw", 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.302 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.303 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.304 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.305 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.306 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.307 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rook", 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.308 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.309 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.310 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.311 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.312 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.313 INFO:teuthology.orchestra.run.smithi027.stdout: "storage_class": { 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "storage_class", 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "local", 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.314 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "selftest", 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.315 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.316 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.317 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.318 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.319 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "roption1": { 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption1", 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.320 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "roption2": { 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption2", 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.321 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "xyz", 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption1": { 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption1", 2024-09-13T18:06:25.322 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption2": { 2024-09-13T18:06:25.323 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption2", 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.324 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption3": { 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption3", 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.325 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption4": { 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption4", 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.326 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption5": { 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption5", 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.327 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption6": { 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption6", 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption7": { 2024-09-13T18:06:25.328 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption7", 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "42", 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.329 INFO:teuthology.orchestra.run.smithi027.stdout: "testkey": { 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testkey", 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.330 INFO:teuthology.orchestra.run.smithi027.stdout: "testlkey": { 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testlkey", 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "testnewline": { 2024-09-13T18:06:25.331 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testnewline", 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.332 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snap_schedule", 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_m_granularity": { 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_m_granularity", 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.333 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "dump_on_update": { 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dump_on_update", 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.334 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "dump database to debug log on update", 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.335 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.336 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.337 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.338 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.339 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stats", 2024-09-13T18:06:25.340 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.341 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.342 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.343 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.344 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.345 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "status", 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.346 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.347 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.348 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.349 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.350 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.351 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telegraf", 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "address": { 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "address", 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.352 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15", 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.353 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.354 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.355 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.356 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.357 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.358 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telemetry", 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.359 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_basic": { 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_basic", 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.360 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_crash": { 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_crash", 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.361 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_device": { 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_device", 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.362 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_ident": { 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_ident", 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.363 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_perf": { 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_perf", 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.364 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "contact": { 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "contact", 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.365 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "description": { 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "description", 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.366 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "device_url": { 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_url", 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.367 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.368 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "24", 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "8", 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.369 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "last_opt_revision": { 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "last_opt_revision", 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1", 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.370 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard": { 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard", 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.371 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard_description": { 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard_description", 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.372 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.373 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.374 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.375 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.376 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.377 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "organization": { 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "organization", 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.378 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "proxy": { 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "proxy", 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.379 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "url": { 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url", 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.380 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "test_orchestrator", 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.381 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.382 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.383 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.384 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.385 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.386 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "volumes", 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.387 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.388 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.389 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.390 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.391 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_clones": { 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_clones", 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4", 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.392 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_delay": { 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_delay", 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.393 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_no_wait": { 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.394 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix", 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.395 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "discovery_interval": { 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "discovery_interval", 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "100", 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.396 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "identifier": { 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "identifier", 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.397 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.398 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.399 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.400 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.401 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.402 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.403 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_host": { 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_host", 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.404 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_port": { 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_port", 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10051", 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.405 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_sender": { 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_sender", 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.406 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: "modules": [ 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm", 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: "dashboard", 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: "iostat", 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: "nfs", 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: "restful" 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.407 INFO:teuthology.orchestra.run.smithi027.stdout: "available_modules": [ 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "alerts", 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.408 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How frequently to reexamine health status", 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.409 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.410 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.411 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.412 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.413 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_destination": { 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_destination", 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.414 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email address to send alerts to", 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_from_name": { 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_from_name", 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "Ceph", 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.415 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Email From: name", 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_host": { 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_host", 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.416 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP server", 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_password": { 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_password", 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.417 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Password to authenticate with", 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_port": { 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_port", 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.418 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "465", 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP port", 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_sender": { 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_sender", 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.419 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SMTP envelope sender", 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_ssl": { 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_ssl", 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.420 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "smtp_user": { 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "smtp_user", 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.421 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "User to authenticate as", 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "balancer", 2024-09-13T18:06:25.422 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "active": { 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "active", 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically balance PGs across cluster", 2024-09-13T18:06:25.423 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_time": { 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_time", 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0000", 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "beginning time of day to automatically balance", 2024-09-13T18:06:25.424 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "begin_weekday": { 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "begin_weekday", 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-13T18:06:25.425 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_max_iterations": { 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_max_iterations", 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "25", 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "250", 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.426 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_metrics": { 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_metrics", 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "pgs,objects,bytes", 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.427 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "crush_compat_step": { 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crush_compat_step", 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.5", 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0.001", 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "0.999", 2024-09-13T18:06:25.428 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "aggressiveness of optimization", 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "end_time": { 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_time", 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2359", 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.429 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ending time of day to automatically balance", 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "end_weekday": { 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "end_weekday", 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "0", 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "6", 2024-09-13T18:06:25.430 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.431 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.432 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.433 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.434 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.435 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "min_score": { 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_score", 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:25.436 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.437 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "upmap", 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "crush-compat", 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "none", 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap" 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Balancer mode", 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_ids": { 2024-09-13T18:06:25.438 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_ids", 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.439 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_deviation": { 2024-09-13T18:06:25.440 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_deviation", 2024-09-13T18:06:25.441 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.441 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.441 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.441 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:25.441 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: "upmap_max_optimizations": { 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "upmap_max_optimizations", 2024-09-13T18:06:25.444 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.445 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cephadm", 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_down_multiplier": { 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_down_multiplier", 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.446 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_refresh_rate": { 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_refresh_rate", 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "20", 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.447 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "agent_starting_port": { 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "agent_starting_port", 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4721", 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.448 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_ptrace": { 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_ptrace", 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.449 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_interval": { 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_interval", 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.450 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "autotune_memory_target_ratio": { 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "autotune_memory_target_ratio", 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0.7", 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.451 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "cgroups_split": { 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cgroups_split", 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.452 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "config_checks_enabled": { 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_checks_enabled", 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.453 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "config_dashboard": { 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_dashboard", 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.454 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_alertmanager": { 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_alertmanager", 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-13T18:06:25.455 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_base": { 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_base", 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-13T18:06:25.456 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Container image name, without the tag", 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_elasticsearch": { 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_elasticsearch", 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.457 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "elasticsearch container image", 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_grafana": { 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_grafana", 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.458 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_haproxy": { 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_haproxy", 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.459 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "HAproxy container image", 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_agent": { 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_agent", 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.460 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger agent container image", 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_collector": { 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_collector", 2024-09-13T18:06:25.461 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger collector container image", 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_jaeger_query": { 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_jaeger_query", 2024-09-13T18:06:25.462 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Jaeger query container image", 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_keepalived": { 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_keepalived", 2024-09-13T18:06:25.463 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Keepalived container image", 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_loki": { 2024-09-13T18:06:25.464 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_loki", 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Loki container image", 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_node_exporter": { 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_node_exporter", 2024-09-13T18:06:25.465 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_nvmeof": { 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_nvmeof", 2024-09-13T18:06:25.466 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Nvme-of container image", 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_prometheus": { 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_prometheus", 2024-09-13T18:06:25.467 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Prometheus container image", 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.468 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_promtail": { 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_promtail", 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Promtail container image", 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.469 INFO:teuthology.orchestra.run.smithi027.stdout: "container_image_snmp_gateway": { 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_image_snmp_gateway", 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "SNMP Gateway container image", 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.470 INFO:teuthology.orchestra.run.smithi027.stdout: "container_init": { 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "container_init", 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Run podman/docker with `--init`", 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.471 INFO:teuthology.orchestra.run.smithi027.stdout: "daemon_cache_timeout": { 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "daemon_cache_timeout", 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.472 INFO:teuthology.orchestra.run.smithi027.stdout: "default_cephadm_command_timeout": { 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_cephadm_command_timeout", 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "900", 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.473 INFO:teuthology.orchestra.run.smithi027.stdout: "default_registry": { 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "default_registry", 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "docker.io", 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.474 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "device_cache_timeout": { 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_cache_timeout", 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1800", 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache device inventory", 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.475 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "device_enhanced_scan": { 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_enhanced_scan", 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.476 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "facts_cache_timeout": { 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "facts_cache_timeout", 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "seconds to cache host facts data", 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.477 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "host_check_interval": { 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "host_check_interval", 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to perform a host check", 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.478 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "hw_monitoring": { 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hw_monitoring", 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.479 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "inventory_list_all": { 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "inventory_list_all", 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.480 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.481 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "log_refresh_metadata": { 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_refresh_metadata", 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.482 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.483 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.484 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.485 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.486 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.487 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "*", 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-13T18:06:25.488 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "max_count_per_host": { 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_count_per_host", 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.489 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of daemons per service per host", 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "max_osd_draining_count": { 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_osd_draining_count", 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.490 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "migration_current": { 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "migration_current", 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.491 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "internal - do not modify", 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "mode": { 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mode", 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "root", 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.492 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm-package", 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "root" 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "mode for remote execution of cephadm", 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "oob_default_addr": { 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "oob_default_addr", 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.493 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "169.254.1.1", 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "prometheus_alerts_path": { 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus_alerts_path", 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.494 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_insecure": { 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_insecure", 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.495 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_password": { 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_password", 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.496 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_url": { 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_url", 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.497 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "registry_username": { 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "registry_username", 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.498 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "secure_monitoring_stack": { 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "secure_monitoring_stack", 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.499 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "service_discovery_port": { 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "service_discovery_port", 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.500 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8765", 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "cephadm service discovery port", 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "ssh_config_file": { 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssh_config_file", 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.501 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "use_agent": { 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_agent", 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.502 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "use_repo_digest": { 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "use_repo_digest", 2024-09-13T18:06:25.503 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_failed_host_check": { 2024-09-13T18:06:25.504 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_failed_host_check", 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if the host check fails", 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_daemons": { 2024-09-13T18:06:25.505 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_daemons", 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_on_stray_hosts": { 2024-09-13T18:06:25.506 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_on_stray_hosts", 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.507 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crash", 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.508 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.509 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.510 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.511 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.512 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "retain_interval": { 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retain_interval", 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "31536000", 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.513 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_recent_interval": { 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_recent_interval", 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1209600", 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.514 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dashboard", 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.515 INFO:teuthology.orchestra.run.smithi027.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.516 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_HOST": { 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.517 INFO:teuthology.orchestra.run.smithi027.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.518 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_ENABLED": { 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_ENABLED", 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.519 INFO:teuthology.orchestra.run.smithi027.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.520 INFO:teuthology.orchestra.run.smithi027.stdout: "ENABLE_BROWSABLE_API": { 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.521 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.522 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.523 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.524 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.525 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.526 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.527 INFO:teuthology.orchestra.run.smithi027.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.528 INFO:teuthology.orchestra.run.smithi027.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.529 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_PASSWORD": { 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.530 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.531 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_URL": { 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_URL", 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.532 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_API_USERNAME": { 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.533 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.534 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.535 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.536 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.537 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_HOST": { 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.538 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.539 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.540 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.541 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.542 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.543 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.545 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.546 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_ENABLED": { 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.547 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.548 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.549 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8", 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.550 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "45", 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.551 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ACCESS_KEY": { 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.552 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "admin", 2024-09-13T18:06:25.553 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SECRET_KEY": { 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.554 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "RGW_API_SSL_VERIFY": { 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.555 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "UNSAFE_TLS_v1_2": { 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.556 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:25.557 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.558 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.559 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "cross_origin_url": { 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cross_origin_url", 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.560 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "crt_file": { 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "crt_file", 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.561 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "debug": { 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "debug", 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.562 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Enable/disable debug options", 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "jwt_token_ttl": { 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "jwt_token_ttl", 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "28800", 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.563 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.564 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.565 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.566 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.567 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.568 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.569 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "motd": { 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "motd", 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.570 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "The message of the day", 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect_resolve_ip_addr": { 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "redirect_resolve_ip_addr", 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.571 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.572 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8080", 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.573 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.574 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl_server_port": { 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl_server_port", 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8443", 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.575 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "redirect", 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.576 INFO:teuthology.orchestra.run.smithi027.stdout: "redirect" 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-13T18:06:25.577 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "url_prefix": { 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url_prefix", 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.578 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "devicehealth", 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.579 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_monitoring": { 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_monitoring", 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "monitor device health metrics", 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.580 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.581 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.582 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.583 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.584 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.585 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "mark_out_threshold": { 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mark_out_threshold", 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "2419200", 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.586 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "pool_name": { 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pool_name", 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "device_health_metrics", 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-13T18:06:25.587 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "retention_period": { 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "retention_period", 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15552000", 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long to retain device health metrics", 2024-09-13T18:06:25.588 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_frequency": { 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_frequency", 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.589 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "self_heal": { 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "self_heal", 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.590 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how frequently to wake up and check device health", 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.591 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "warn_threshold": { 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "warn_threshold", 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7257600", 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.592 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "diskprediction_local", 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.593 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.594 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.595 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.596 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.597 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "predict_interval": { 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predict_interval", 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.598 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "86400", 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "predictor_model": { 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "predictor_model", 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.599 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "prophetstor", 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.600 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "600", 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "influx", 2024-09-13T18:06:25.601 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": false, 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "influxdb python module not found", 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "batch_size": { 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "batch_size", 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5000", 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.602 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "database": { 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "database", 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "ceph", 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.603 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": { 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "hostname", 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server hostname", 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.604 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "30", 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "5", 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.605 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.606 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.607 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.608 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.609 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.610 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "password": { 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "password", 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.611 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "password of InfluxDB server user", 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "port": { 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "port", 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "8086", 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.612 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "InfluxDB server port", 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "ssl": { 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ssl", 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "false", 2024-09-13T18:06:25.613 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "threads": { 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threads", 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:25.614 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "32", 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "username": { 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "username", 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.615 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "username of InfluxDB server user", 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "verify_ssl": { 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "verify_ssl", 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "true", 2024-09-13T18:06:25.616 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "insights", 2024-09-13T18:06:25.617 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.618 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.619 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.620 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.621 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.622 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "iostat", 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.623 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.624 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.625 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.626 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.627 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.628 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "k8sevents", 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_event_retention_days": { 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "ceph_event_retention_days", 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.629 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "7", 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "config_check_secs": { 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "config_check_secs", 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.630 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "10", 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.631 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.632 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.633 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.634 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.635 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.636 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "localpool", 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "failure_domain": { 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "failure_domain", 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "host", 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.637 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "failure domain for any created local pool", 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.638 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.639 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.640 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.641 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.642 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "min_size": { 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "min_size", 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.643 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default min_size for any created local pool", 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "num_rep": { 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "num_rep", 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3", 2024-09-13T18:06:25.644 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default replica count for any created local pool", 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_num": { 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_num", 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.645 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "128", 2024-09-13T18:06:25.646 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.646 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.646 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.646 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "default pg_num for any created local pool", 2024-09-13T18:06:25.646 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.646 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.646 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.646 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.647 INFO:teuthology.orchestra.run.smithi027.stdout: "prefix": { 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prefix", 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "name prefix for any created local pool", 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "subtree": { 2024-09-13T18:06:25.648 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "subtree", 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "rack", 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.649 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mds_autoscaler", 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.650 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.651 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.652 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.653 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.654 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirroring", 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.655 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.656 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.657 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.658 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.659 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.660 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "nfs", 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.661 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.662 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.663 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.664 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.665 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.666 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "fail_fs": { 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "fail_fs", 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.667 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.668 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.669 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.670 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.671 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.672 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator": { 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "orchestrator", 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "cephadm", 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "rook", 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "test_orchestrator" 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.673 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Orchestrator backend", 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_perf_query", 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.674 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.675 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.676 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.677 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.678 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.679 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "osd_support", 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.680 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.681 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.682 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.683 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.684 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "pg_autoscaler", 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.685 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.686 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.687 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.688 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.689 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.690 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.691 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "threshold": { 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "threshold", 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "3.0", 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1.0", 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "scaling threshold", 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.692 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "progress", 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_pg_recovery_event": { 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_pg_recovery_event", 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.693 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.694 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.695 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.696 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.697 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.698 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.699 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "max_completed_events": { 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_completed_events", 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.700 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "50", 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "number of past completed events to remember", 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "sleep_interval": { 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "sleep_interval", 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.701 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "5", 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "how long the module is going to sleep", 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "prometheus", 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.702 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "cache": { 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "cache", 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.703 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "exclude_perf_counters": { 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "exclude_perf_counters", 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-13T18:06:25.704 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.705 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.706 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.707 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.708 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools": { 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools", 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.710 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "300", 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.711 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "scrape_interval": { 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "scrape_interval", 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15.0", 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.712 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "::", 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.713 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "9283", 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.714 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "stale_cache_strategy": { 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stale_cache_strategy", 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "log", 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.715 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_behaviour": { 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_behaviour", 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "default", 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.716 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "default", 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "error" 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "standby_error_status_code": { 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "standby_error_status_code", 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.717 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "500", 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "400", 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "599", 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_support", 2024-09-13T18:06:25.718 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.719 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.720 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.721 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.722 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.723 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_snap_create": { 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_snap_create", 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10", 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.724 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "mirror_snapshot_schedule": { 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "mirror_snapshot_schedule", 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.725 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "trash_purge_schedule": { 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "trash_purge_schedule", 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.726 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "restful", 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.727 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "enable_auth": { 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enable_auth", 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.728 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "key_file": { 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "key_file", 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.729 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.730 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.731 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.732 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.733 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.734 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "server_addr": { 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_addr", 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.735 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "server_port": { 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "server_port", 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.736 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rgw", 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.737 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.738 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.739 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.740 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.741 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.742 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rook", 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.743 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.744 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.745 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.746 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.747 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "storage_class": { 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "storage_class", 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "local", 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.748 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "selftest", 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.749 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.750 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.751 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.752 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.753 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.754 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "roption1": { 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption1", 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.755 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "roption2": { 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "roption2", 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "xyz", 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.756 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption1": { 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption1", 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.757 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption2": { 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption2", 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.758 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption3": { 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption3", 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "float", 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.759 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption4": { 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption4", 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.760 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption5": { 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption5", 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.761 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption6": { 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption6", 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.762 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "rwoption7": { 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rwoption7", 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "1", 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "42", 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.763 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "testkey": { 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testkey", 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.764 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "testlkey": { 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testlkey", 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.765 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "testnewline": { 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "testnewline", 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.766 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snap_schedule", 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "allow_m_granularity": { 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "allow_m_granularity", 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.767 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "allow minute scheduled snapshots", 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "dump_on_update": { 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "dump_on_update", 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.768 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "dump database to debug log on update", 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.769 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.770 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.771 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.772 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.773 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "stats", 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.775 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.776 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.777 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.778 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.779 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "status", 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.780 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.781 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.782 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.783 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.784 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.785 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telegraf", 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "address": { 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "address", 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.786 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "15", 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.787 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.788 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.791 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.792 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "telemetry", 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.793 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_basic": { 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_basic", 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.794 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_crash": { 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_crash", 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_device": { 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_device", 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.796 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_ident": { 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_ident", 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "channel_perf": { 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "channel_perf", 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.798 INFO:teuthology.orchestra.run.smithi027.stdout: "contact": { 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "contact", 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.799 INFO:teuthology.orchestra.run.smithi027.stdout: "description": { 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "description", 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "device_url": { 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "device_url", 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "enabled": { 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "enabled", 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "24", 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "8", 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "last_opt_revision": { 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "last_opt_revision", 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "1", 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard": { 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard", 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.805 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "leaderboard_description": { 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "leaderboard_description", 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.806 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.807 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.808 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.809 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.810 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.811 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "organization": { 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "organization", 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.812 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "proxy": { 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "proxy", 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.813 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "url": { 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "url", 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.814 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "test_orchestrator", 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.815 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.816 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.817 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.818 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.819 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.820 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "volumes", 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.821 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.822 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.823 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.824 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.825 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "max_concurrent_clones": { 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "max_concurrent_clones", 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.826 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "4", 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_delay": { 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_delay", 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.827 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "0", 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "snapshot_clone_no_wait": { 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "snapshot_clone_no_wait", 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.828 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "True", 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix", 2024-09-13T18:06:25.829 INFO:teuthology.orchestra.run.smithi027.stdout: "can_run": true, 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "error_string": "", 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "module_options": { 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "discovery_interval": { 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "discovery_interval", 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "uint", 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "100", 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.830 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "identifier": { 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "identifier", 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.831 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "interval": { 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "interval", 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "secs", 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "60", 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.832 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "log_level": { 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_level", 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.833 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster": { 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster", 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.834 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_cluster_level": { 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_cluster_level", 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "info", 2024-09-13T18:06:25.835 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [ 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "", 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "critical", 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "debug", 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "error", 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "info", 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "warning" 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.836 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "log_to_file": { 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "log_to_file", 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "bool", 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 1, 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "False", 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.837 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_host": { 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_host", 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "", 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.838 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_port": { 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_port", 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "int", 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "10051", 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.839 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "zabbix_sender": { 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "zabbix_sender", 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "str", 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "level": "advanced", 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "flags": 0, 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "min": "", 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "max": "", 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "enum_allowed": [], 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "desc": "", 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "long_desc": "", 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "tags": [], 2024-09-13T18:06:25.840 INFO:teuthology.orchestra.run.smithi027.stdout: "see_also": [] 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "services": { 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "dashboard": "https://172.21.15.27:8443/" 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "always_on_modules": { 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "octopus": [ 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "balancer", 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "devicehealth", 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator", 2024-09-13T18:06:25.841 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_autoscaler", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "progress", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_support", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "status", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "telemetry", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "volumes" 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "pacific": [ 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "balancer", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "devicehealth", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_autoscaler", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "progress", 2024-09-13T18:06:25.842 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_support", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "status", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "telemetry", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "volumes" 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "quincy": [ 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "balancer", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "devicehealth", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_autoscaler", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "progress", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_support", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "status", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "telemetry", 2024-09-13T18:06:25.843 INFO:teuthology.orchestra.run.smithi027.stdout: "volumes" 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: ], 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "reef": [ 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "balancer", 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "crash", 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "devicehealth", 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "orchestrator", 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "pg_autoscaler", 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "progress", 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "rbd_support", 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "status", 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "telemetry", 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: "volumes" 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T18:06:25.844 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "last_failure_osd_epoch": 3, 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "active_clients": [ 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "devicehealth", 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 296181992 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.845 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "libcephsqlite", 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 3892744305 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "rbd_support", 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-13T18:06:25.846 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 1430092829 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "name": "volumes", 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "addrvec": [ 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: { 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v2", 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 46997650 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:25.847 INFO:teuthology.orchestra.run.smithi027.stdout: ] 2024-09-13T18:06:25.848 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.501+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46280a1110 msgr2=0x7f46280a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46280a1110 0x7f46280a35d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f463402a9e0 tx=0x7f46340058d0 comp rx=0 tx=0).stop 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4640100f90 msgr2=0x7f46401963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4640100f90 0x7f46401963c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f462c00e9f0 tx=0x7f462c00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 shutdown_connections 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f46280a1110 0x7f46280a35d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4640101950 0x7f464019d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4640100f90 0x7f46401963c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 --2- 172.21.15.27:0/835482414 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f46400ffda0 0x7f4640195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 >> 172.21.15.27:0/835482414 conn(0x7f46400fb520 msgr2=0x7f4640104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 shutdown_connections 2024-09-13T18:06:25.849 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:06:24.502+0000 7f4648000640 1 -- 172.21.15.27:0/835482414 wait complete. 2024-09-13T18:06:25.850 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:24 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:24 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3639763788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:06:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:24 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/449824275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:06:25.851 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:24 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3979099315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:06:25.852 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:24 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:25.852 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:24 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3639763788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:06:25.852 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:24 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/449824275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:06:25.852 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:24 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3979099315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:06:25.852 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:25 smithi122 ceph-mon[35310]: pgmap v432: 97 pgs: 97 active+clean; 112 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 402 op/s 2024-09-13T18:06:25.852 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:25 smithi122 ceph-mon[35310]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:25.853 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:25 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/835482414' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T18:06:25.853 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:24 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:25.938 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:24 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3639763788' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:06:25.938 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:24 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/449824275' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:06:25.938 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:24 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3979099315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:06:25.938 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:25 smithi143 ceph-mon[38210]: pgmap v432: 97 pgs: 97 active+clean; 112 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 402 op/s 2024-09-13T18:06:25.938 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:25 smithi143 ceph-mon[38210]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:25.938 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:25 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/835482414' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T18:06:25.995 DEBUG:tasks.check_counter:Getting stats from a 2024-09-13T18:06:25.996 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-13T18:06:25.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:25 smithi027 ceph-mon[30611]: pgmap v432: 97 pgs: 97 active+clean; 112 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 402 op/s 2024-09-13T18:06:25.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:25 smithi027 ceph-mon[30611]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-13T18:06:25.996 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:25 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/835482414' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-13T18:06:26.335 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:06:27.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:27 smithi143 ceph-mon[38210]: pgmap v433: 97 pgs: 97 active+clean; 110 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 370 op/s 2024-09-13T18:06:27.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:27 smithi027 ceph-mon[30611]: pgmap v433: 97 pgs: 97 active+clean; 110 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 370 op/s 2024-09-13T18:06:27.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:27 smithi122 ceph-mon[35310]: pgmap v433: 97 pgs: 97 active+clean; 110 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 370 op/s 2024-09-13T18:06:28.902 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 3202, 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 5616, 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 1227158, 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 6685720, 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 17, 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 10, 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.563405513, 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.334250613, 2024-09-13T18:06:28.903 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.282979035, 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.017432808, 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 5612, 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.299261803, 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000053325 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 6602, 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.001753581, 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000265 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 992224, 2024-09-13T18:06:28.904 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 2500736 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 13786, 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 7579, 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 6724320, 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 1726084, 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 8, 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 6, 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.925201559, 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.387643022, 2024-09-13T18:06:28.905 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.723756498, 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.014717028, 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 7580, 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.277005980, 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000036544 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 20438, 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.002923071, 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000143 2024-09-13T18:06:28.906 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 819104, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 50848 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 635, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 882, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 263195, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 648814, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 8, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 6, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.091207109, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.035250301, 2024-09-13T18:06:28.907 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.037580458, 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.017184701, 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 881, 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.082427336, 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000093561 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 807, 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000188229, 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000233 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 185264 2024-09-13T18:06:28.908 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 1, 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "finisher-MDSRank": { 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "queue_len": 0, 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "complete_latency": { 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 457, 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.812235955, 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001777321 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "finisher-PurgeQueue": { 2024-09-13T18:06:28.909 INFO:teuthology.orchestra.run.smithi027.stdout: "queue_len": 0, 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "complete_latency": { 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 1285, 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.151001545, 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000117510 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "request": 1340, 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "reply": 1336, 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "reply_latency": { 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 1336, 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 1.452540915, 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001087231 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.910 INFO:teuthology.orchestra.run.smithi027.stdout: "slow_reply": 0, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "forward": 4, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_fetch_complete": 0, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_fetch_keys": 0, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_commit": 11, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_split": 0, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_merge": 0, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes": 22, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_top": 3, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_bottom": 7, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_pin_tail": 12, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_pinned": 15, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_expired": 1292, 2024-09-13T18:06:28.911 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_with_caps": 0, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": 0, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "subtrees": 4, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse": 3241, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_hit": 2427, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_forward": 0, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_discover": 697, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_remote_ino": 0, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_lock": 0, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "load_cent": 0, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "q": 0, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "exported": 29, 2024-09-13T18:06:28.912 INFO:teuthology.orchestra.run.smithi027.stdout: "exported_inodes": 121, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "imported": 31, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "imported_inodes": 388, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_dir_fetch": 0, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_peer_discover": 0, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rfiles": 4, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rbytes": 234, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rsnaps": 0, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_set_tag": 0, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:06:28.913 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_file_inodes": 0, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_inode_file_caps": 4, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_revoke": 141, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_grant": 1020, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_caps": 762, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_caps_dirty": 509, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_cap_release": 25, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "process_request_cap_release": 1303 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.914 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_cache": { 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_update": 238, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_update_receipt": 2053, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_try_discover": 1369, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_send_discover": 1395, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_handle_discover": 296, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays": 0, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays_delayed": 0, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_created": 670, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_enqueued": 670, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_reintegrated": 0, 2024-09-13T18:06:28.915 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_migrated": 0, 2024-09-13T18:06:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_processing": 0, 2024-09-13T18:06:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:06:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:06:28.916 INFO:teuthology.orchestra.run.smithi027.stdout: "recovery_started": 0, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "recovery_completed": 0, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_exportdir": 29, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_flush": 0, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_fragstats": 0, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_inodestats": 0 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_log": { 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "evadd": 2870, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "evex": 0, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "evtrm": 0, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "ev": 2870, 2024-09-13T18:06:28.917 INFO:teuthology.orchestra.run.smithi027.stdout: "evexg": 0, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "evexd": 0, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "segadd": 4, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "segex": 0, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "segtrm": 0, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "seg": 4, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "segexg": 0, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "segexd": 0, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "expos": 4194304, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "wrpos": 9066892, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "rdpos": 0, 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "jlat": { 2024-09-13T18:06:28.918 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 197, 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.523210822, 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.002655892 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "replayed": 0 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_mem": { 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "ino": 27, 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "ino+": 1317, 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "ino-": 1290, 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "dir": 25, 2024-09-13T18:06:28.919 INFO:teuthology.orchestra.run.smithi027.stdout: "dir+": 818, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "dir-": 793, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "dn": 21, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "dn+": 2250, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "dn-": 2229, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "cap": 0, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "cap+": 696, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "cap-": 696, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "rss": 60224, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "heap": 198932 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_server": { 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "dispatch_client_request": 1557, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "dispatch_server_request": 60, 2024-09-13T18:06:28.920 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_request": 1340, 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_session": 9, 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_peer_request": 195, 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "req_create_latency": { 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 283, 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.206024718, 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000728002 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getattr_latency": { 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 3, 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.003964876, 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001321625 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.921 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getfilelock_latency": { 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "req_link_latency": { 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookup_latency": { 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 316, 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.104775954, 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000331569 2024-09-13T18:06:28.922 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookuphash_latency": { 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupino_latency": { 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupname_latency": { 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.923 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupparent_latency": { 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupsnap_latency": { 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.924 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lssnap_latency": { 2024-09-13T18:06:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mkdir_latency": { 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mknod_latency": { 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mksnap_latency": { 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.926 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "req_open_latency": { 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "req_readdir_latency": { 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 64, 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.052659708, 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000822807 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rename_latency": { 2024-09-13T18:06:28.927 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "req_renamesnap_latency": { 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "req_snapdiff_latency": { 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.928 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmdir_latency": { 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 14, 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.172812800, 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.012343771 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmsnap_latency": { 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmxattr_latency": { 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.929 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setattr_latency": { 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setdirlayout_latency": { 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setfilelock_latency": { 2024-09-13T18:06:28.930 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setlayout_latency": { 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setxattr_latency": { 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.931 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "req_symlink_latency": { 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "req_unlink_latency": { 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 656, 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.912302859, 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001390705 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:06:28.932 INFO:teuthology.orchestra.run.smithi027.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getvxattr_latency": { 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_sessions": { 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "session_count": 1, 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "session_add": 3, 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "session_remove": 2, 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "sessions_open": 1, 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "sessions_stale": 0, 2024-09-13T18:06:28.933 INFO:teuthology.orchestra.run.smithi027.stdout: "total_load": 920, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "average_load": 920, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "avg_session_uptime": 1270, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "mdthresh_evicted": 0 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:28.934 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:28.935 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:28.936 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 319801, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 133, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 616, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 7, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-13T18:06:28.937 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 7496, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 154, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 201615, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 3214, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-13T18:06:28.938 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "objecter": { 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "op_active": 0, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "op_laggy": 0, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "op_send": 1037, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "op_send_bytes": 5020182, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "op_resend": 27, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "op_reply": 1037, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "op_latency": { 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 1037, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 8.610774135, 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.008303543 2024-09-13T18:06:28.939 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "op_inflight": 0, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "oplen_avg": { 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 1037, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 1079 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "op": 1037, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "op_r": 42, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "op_w": 995, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "op_rmw": 0, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "op_pg": 0, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_stat": 0, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_create": 10, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_read": 42, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_write": 239, 2024-09-13T18:06:28.940 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_writefull": 36, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_writesame": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_append": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_zero": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_truncate": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_delete": 683, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_mapext": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_sparse_read": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_clonerange": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_getxattr": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_setxattr": 20, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_rmxattr": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:06:28.941 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_call": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_watch": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_notify": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_pgls": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_other": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_active": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_send": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_resend": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_ping": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_active": 0, 2024-09-13T18:06:28.942 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_send": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_resend": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_active": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_send": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_resend": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_active": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_send": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_resend": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "command_active": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "command_send": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "command_resend": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "map_epoch": 88, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "map_full": 0, 2024-09-13T18:06:28.943 INFO:teuthology.orchestra.run.smithi027.stdout: "map_inc": 2, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_sessions": 12, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_session_open": 12, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_session_close": 0, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_laggy": 0, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_wr": 39, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_rd": 0, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_del": 10 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "oft": { 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_objs": 1, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:06:28.944 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_updates": 0, 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_removes": 0 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "osd-slow-ops": { 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "slow_ops_count": 0 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "purge_queue": { 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_ops": 0, 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_ops_high_water": 6, 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing": 0, 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_high_water": 6, 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executed_ops": 670, 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executed": 670, 2024-09-13T18:06:28.945 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_item_in_journal": 0 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 17619, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 6508254, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 17619, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 17619, 2024-09-13T18:06:28.946 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 6508254, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-objecter_bytes": { 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:28.947 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 1037, 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 5087852, 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 1037, 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 5087852, 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-objecter_ops": { 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:28.948 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 1024, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 1037, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 1037, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 1037, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 1037, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.949 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 3758096384, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 670, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 67670, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 670, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 42, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 67670, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.950 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-write_buf_throttle-0x562320f84500": { 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 3758096384, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 2870, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 4872588, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 2870, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 197, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 4872588, 2024-09-13T18:06:28.951 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:28.952 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:28.952 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:28.952 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:28.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:28.952 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:28.952 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:06:29.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:29 smithi143 ceph-mon[38210]: pgmap v434: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-09-13T18:06:29.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:29 smithi027 ceph-mon[30611]: pgmap v434: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-09-13T18:06:29.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:29 smithi122 ceph-mon[35310]: pgmap v434: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 353 op/s 2024-09-13T18:06:29.826 INFO:tasks.check_counter:Daemon mds.a mds.exported=29 2024-09-13T18:06:29.827 INFO:tasks.check_counter:Daemon mds.a mds.imported=31 2024-09-13T18:06:29.827 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=238 2024-09-13T18:06:29.827 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=2053 2024-09-13T18:06:29.827 DEBUG:tasks.check_counter:Getting stats from d 2024-09-13T18:06:29.827 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-13T18:06:30.155 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:06:31.526 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:31 smithi143 ceph-mon[38210]: pgmap v435: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 847 KiB/s wr, 276 op/s 2024-09-13T18:06:31.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:31 smithi027 ceph-mon[30611]: pgmap v435: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 847 KiB/s wr, 276 op/s 2024-09-13T18:06:31.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:31 smithi122 ceph-mon[35310]: pgmap v435: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 847 KiB/s wr, 276 op/s 2024-09-13T18:06:32.808 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:06:32.808 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:32.808 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 0, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 2, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 0, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 0, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 0, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.003666727, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.000000000, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.000552947, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:32.809 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 1, 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 66, 2024-09-13T18:06:32.810 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 160, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 87808, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 3, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 2, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.007903028, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.005434600, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.001446389, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 64, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.003828311, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000059817 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.811 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 87808 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 97, 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 90, 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 710560, 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 49472, 2024-09-13T18:06:32.812 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 2, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 1, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.024056885, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.007890051, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.022738793, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 90, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.012365489, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000137394 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:32.813 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 710560, 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 49472 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 0, 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:32.814 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:32.815 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-13T18:06:32.816 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 148823, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 27, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:32.817 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 0, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 0, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 928, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 2, 2024-09-13T18:06:32.818 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 94, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 694394, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 94, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-13T18:06:32.819 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-13T18:06:32.820 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 94, 2024-09-13T18:06:32.820 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 694394, 2024-09-13T18:06:32.820 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:32.820 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:32.820 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:32.820 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:32.820 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:32.820 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:32.820 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:06:33.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:33 smithi143 ceph-mon[38210]: pgmap v436: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 581 KiB/s wr, 184 op/s 2024-09-13T18:06:33.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:33 smithi027 ceph-mon[30611]: pgmap v436: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 581 KiB/s wr, 184 op/s 2024-09-13T18:06:33.590 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-13T18:06:33.590 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-13T18:06:33.590 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-13T18:06:33.591 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-13T18:06:33.591 DEBUG:tasks.check_counter:Getting stats from g 2024-09-13T18:06:33.591 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-13T18:06:33.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:33 smithi122 ceph-mon[35310]: pgmap v436: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 581 KiB/s wr, 184 op/s 2024-09-13T18:06:33.918 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:06:35.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:35 smithi027 ceph-mon[30611]: pgmap v437: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 582 KiB/s wr, 172 op/s 2024-09-13T18:06:35.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:35 smithi143 ceph-mon[38210]: pgmap v437: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 582 KiB/s wr, 172 op/s 2024-09-13T18:06:35.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:35 smithi122 ceph-mon[35310]: pgmap v437: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 582 KiB/s wr, 172 op/s 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 284, 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 285, 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 95451, 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 88014, 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 6, 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 2, 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.042956101, 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.018921459, 2024-09-13T18:06:35.775 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.009072172, 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.008013940, 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 283, 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.018650863, 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000065904 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.776 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 475, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 538, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 3366991, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 334223, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 5, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 4, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.054212102, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.017950519, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.019513441, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.012540109, 2024-09-13T18:06:35.777 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 536, 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.028074866, 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000052378 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 186752 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:35.778 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 115, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 97, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 793444, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 49824, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 3, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.024934702, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.007971610, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.023851775, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000053874, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 97, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.013941640, 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000143728 2024-09-13T18:06:35.779 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 792096, 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 48880 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 1, 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.780 INFO:teuthology.orchestra.run.smithi027.stdout: "finisher-MDSRank": { 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "queue_len": 0, 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "complete_latency": { 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 1355, 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.033886913, 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000025008 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "finisher-PurgeQueue": { 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "queue_len": 0, 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "complete_latency": { 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.781 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "mds": { 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "request": 0, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "reply": 0, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "reply_latency": { 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "slow_reply": 0, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "forward": 0, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_fetch_complete": 0, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_fetch_keys": 0, 2024-09-13T18:06:35.782 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_commit": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_split": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_merge": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes": 511, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_top": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_bottom": 511, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_pin_tail": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_pinned": 511, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_expired": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "inodes_with_caps": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "caps": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "subtrees": 1, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_hit": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_forward": 0, 2024-09-13T18:06:35.783 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_discover": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_remote_ino": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "traverse_lock": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "load_cent": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "q": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "exported": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "exported_inodes": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "imported": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "imported_inodes": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_dir_fetch": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "openino_peer_discover": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rfiles": 0, 2024-09-13T18:06:35.784 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rbytes": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "root_rsnaps": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_set_tag": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "scrub_file_inodes": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:06:35.785 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_caps": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_cap_release": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "process_request_cap_release": 0 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_cache": { 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_update": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_update_receipt": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_try_discover": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_send_discover": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "dir_handle_discover": 0, 2024-09-13T18:06:35.786 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays_delayed": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_created": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_enqueued": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_reintegrated": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "strays_migrated": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_processing": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "recovery_started": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "recovery_completed": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_exportdir": 0, 2024-09-13T18:06:35.787 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_flush": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_fragstats": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "ireq_inodestats": 0 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_log": { 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "evadd": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "evex": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "evtrm": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "ev": 2130, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "evexg": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "evexd": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "segadd": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "segex": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "segtrm": 0, 2024-09-13T18:06:35.788 INFO:teuthology.orchestra.run.smithi027.stdout: "seg": 3, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "segexg": 0, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "segexd": 0, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "expos": 4194304, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "wrpos": 7439955, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "rdpos": 7438817, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "jlat": { 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "replayed": 2130 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_mem": { 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "ino": 6, 2024-09-13T18:06:35.789 INFO:teuthology.orchestra.run.smithi027.stdout: "ino+": 563, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "ino-": 557, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "dir": 4, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "dir+": 82, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "dir-": 78, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "dn": 511, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "dn+": 831, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "dn-": 320, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "cap": 0, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "cap+": 0, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "cap-": 0, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "rss": 48252, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "heap": 207124 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.790 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_server": { 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "dispatch_client_request": 0, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "dispatch_server_request": 0, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_request": 0, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_client_session": 0, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "handle_peer_request": 0, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "req_create_latency": { 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getattr_latency": { 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.791 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getfilelock_latency": { 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "req_link_latency": { 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookup_latency": { 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.792 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookuphash_latency": { 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupino_latency": { 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupname_latency": { 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.793 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupparent_latency": { 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lookupsnap_latency": { 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "req_lssnap_latency": { 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.794 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.795 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.795 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mkdir_latency": { 2024-09-13T18:06:35.795 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.795 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.795 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.795 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.795 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mknod_latency": { 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: "req_mksnap_latency": { 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.796 INFO:teuthology.orchestra.run.smithi027.stdout: "req_open_latency": { 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "req_readdir_latency": { 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rename_latency": { 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.797 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.798 INFO:teuthology.orchestra.run.smithi027.stdout: "req_renamesnap_latency": { 2024-09-13T18:06:35.798 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.798 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.798 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.798 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.798 INFO:teuthology.orchestra.run.smithi027.stdout: "req_snapdiff_latency": { 2024-09-13T18:06:35.798 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmdir_latency": { 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmsnap_latency": { 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.799 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "req_rmxattr_latency": { 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setattr_latency": { 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setdirlayout_latency": { 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.800 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setfilelock_latency": { 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setlayout_latency": { 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.801 INFO:teuthology.orchestra.run.smithi027.stdout: "req_setxattr_latency": { 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "req_symlink_latency": { 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "req_unlink_latency": { 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.802 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "req_getvxattr_latency": { 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_sessions": { 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "session_count": 1, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "session_add": 2, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "session_remove": 1, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "sessions_open": 2, 2024-09-13T18:06:35.803 INFO:teuthology.orchestra.run.smithi027.stdout: "sessions_stale": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "total_load": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "average_load": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "avg_session_uptime": 2400, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "mdthresh_evicted": 0 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:35.804 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:35.805 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:35.806 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 197319, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 52, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 7496, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 154, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:35.807 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 378520, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 2095, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "objecter": { 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "op_active": 0, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "op_laggy": 0, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "op_send": 760, 2024-09-13T18:06:35.808 INFO:teuthology.orchestra.run.smithi027.stdout: "op_send_bytes": 21, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "op_resend": 3, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "op_reply": 760, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "op_latency": { 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 760, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 1.171969441, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001542065 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "op_inflight": 0, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "oplen_avg": { 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 760, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 761 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "op": 760, 2024-09-13T18:06:35.809 INFO:teuthology.orchestra.run.smithi027.stdout: "op_r": 760, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "op_w": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "op_rmw": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "op_pg": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_stat": 437, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_create": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_read": 321, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_write": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_writefull": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_writesame": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_append": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_zero": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_truncate": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_delete": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_mapext": 0, 2024-09-13T18:06:35.810 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_sparse_read": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_clonerange": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_getxattr": 1, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_setxattr": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_rmxattr": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_call": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_watch": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_notify": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_pgls": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "osdop_other": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_active": 0, 2024-09-13T18:06:35.811 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_send": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_resend": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "linger_ping": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_active": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_send": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "poolop_resend": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_active": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_send": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "poolstat_resend": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_active": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_send": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "statfs_resend": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "command_active": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "command_send": 0, 2024-09-13T18:06:35.812 INFO:teuthology.orchestra.run.smithi027.stdout: "command_resend": 0, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "map_epoch": 88, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "map_full": 0, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "map_inc": 2, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_sessions": 6, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_session_open": 6, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_session_close": 0, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_laggy": 0, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_wr": 0, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_rd": 2, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_del": 0 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "oft": { 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_objs": 0, 2024-09-13T18:06:35.813 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_updates": 0, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "omap_total_removes": 0 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "osd-slow-ops": { 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "slow_ops_count": 0 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "purge_queue": { 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_ops": 0, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing": 0, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executing_high_water": 0, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executed_ops": 0, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_executed": 0, 2024-09-13T18:06:35.814 INFO:teuthology.orchestra.run.smithi027.stdout: "pq_item_in_journal": 0 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 870, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 4169047, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 870, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 870, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 4169047, 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:35.815 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-objecter_bytes": { 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 760, 2024-09-13T18:06:35.816 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 3245656, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 760, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 3245656, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-objecter_ops": { 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 1024, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-13T18:06:35.817 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 760, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 760, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 760, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 760, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:35.818 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 3758096384, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:35.819 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-write_buf_throttle-0x5606a97fe960": { 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 3758096384, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 0, 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:35.820 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:35.821 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:35.821 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:06:37.027 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-13T18:06:37.028 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-13T18:06:37.028 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-13T18:06:37.028 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-13T18:06:37.028 DEBUG:tasks.check_counter:Getting stats from j 2024-09-13T18:06:37.028 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-13T18:06:37.361 INFO:teuthology.orchestra.run.smithi027.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.a/config 2024-09-13T18:06:37.555 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:37 smithi027 ceph-mon[30611]: pgmap v438: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 34 op/s 2024-09-13T18:06:37.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:37 smithi122 ceph-mon[35310]: pgmap v438: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 34 op/s 2024-09-13T18:06:37.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:37 smithi143 ceph-mon[38210]: pgmap v438: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 KiB/s wr, 34 op/s 2024-09-13T18:06:39.330 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 96, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 91, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 708336, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 50800, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 4, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 0, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.025616800, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.008875337, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.021246704, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:06:39.331 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 90, 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.006985797, 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000077619 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 708336, 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 50800 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.332 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 1, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 68, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 160, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 88160, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 3, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 2, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.008453366, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.005982093, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.001448175, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 66, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.003851336, 2024-09-13T18:06:39.333 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000058353 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 88160 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_messages": 4, 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages": 4, 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_bytes": 3040, 2024-09-13T18:06:39.334 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_bytes": 448, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_created_connections": 2, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_active_connections": 1, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_total_time": 0.003370241, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_send_time": 0.000048670, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_recv_time": 0.003270620, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 3, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.005947469, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.001982489 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:39.335 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "msgr_send_encrypted_bytes": 448 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "cct": { 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "total_workers": 0, 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "unhealthy_workers": 0 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "mempool": { 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:39.336 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:39.337 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_items": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:39.338 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_bytes": 148823, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_anon_items": 27, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "buffer_meta_items": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_bytes": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_items": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_bytes": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_items": 0, 2024-09-13T18:06:39.339 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "pgmap_items": 0, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_bytes": 928, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_co_items": 2, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_1_items": 0, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "unittest_2_items": 0 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2024-09-13T18:06:39.340 INFO:teuthology.orchestra.run.smithi027.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "val": 0, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "max": 104857600, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "get_started": 0, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "get": 97, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "get_sum": 694784, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "get_or_fail_success": 97, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "take": 0, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "take_sum": 0, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "put": 97, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "put_sum": 694784, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "wait": { 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "avgcount": 0, 2024-09-13T18:06:39.341 INFO:teuthology.orchestra.run.smithi027.stdout: "sum": 0.000000000, 2024-09-13T18:06:39.342 INFO:teuthology.orchestra.run.smithi027.stdout: "avgtime": 0.000000000 2024-09-13T18:06:39.342 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:39.342 INFO:teuthology.orchestra.run.smithi027.stdout: } 2024-09-13T18:06:39.342 INFO:teuthology.orchestra.run.smithi027.stdout:} 2024-09-13T18:06:39.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:39 smithi027 ceph-mon[30611]: pgmap v439: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2024-09-13T18:06:39.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:39 smithi122 ceph-mon[35310]: pgmap v439: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2024-09-13T18:06:39.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:39 smithi143 ceph-mon[38210]: pgmap v439: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 KiB/s wr, 16 op/s 2024-09-13T18:06:40.070 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-13T18:06:40.070 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-13T18:06:40.070 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-13T18:06:40.071 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-13T18:06:40.071 DEBUG:tasks.check_counter:Getting stats from b 2024-09-13T18:06:40.071 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-13T18:06:40.283 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:06:41.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:41 smithi027 ceph-mon[30611]: pgmap v440: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-13T18:06:41.663 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:41 smithi122 ceph-mon[35310]: pgmap v440: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-13T18:06:41.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:41 smithi143 ceph-mon[38210]: pgmap v440: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 13 op/s 2024-09-13T18:06:42.055 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-13T18:06:42.056 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:42.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 43872, 2024-09-13T18:06:42.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 84975, 2024-09-13T18:06:42.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 17065950, 2024-09-13T18:06:42.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 87974895, 2024-09-13T18:06:42.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 19, 2024-09-13T18:06:42.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 6, 2024-09-13T18:06:42.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 3.007607957, 2024-09-13T18:06:42.056 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 1.457853372, 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 2.555403773, 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.158152493, 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 84969, 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1.945273624, 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000022893 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 99123, 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.013738979, 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000138 2024-09-13T18:06:42.057 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 15575424, 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 40789248 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 17574, 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 31877, 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 4637379, 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 45253926, 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 9, 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 5, 2024-09-13T18:06:42.058 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 1.235517952, 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.580840702, 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.560600765, 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.119049017, 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 31879, 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1.196520084, 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000037533 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 38911, 2024-09-13T18:06:42.059 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.005654086, 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000145 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 190880 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 15622, 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 28936, 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 4024731, 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 32523544, 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 8, 2024-09-13T18:06:42.060 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 7, 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 1.025353396, 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.474876361, 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.511621337, 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.072464017, 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 28936, 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.893502233, 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000030878 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:42.061 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 38825, 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.005698769, 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000146 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 861264, 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 56304 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-09-13T18:06:42.062 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2664, 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 17.745791206, 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.006661333 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-13T18:06:42.063 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 18670, 2024-09-13T18:06:42.064 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 3.182835741, 2024-09-13T18:06:42.064 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000170478 2024-09-13T18:06:42.064 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:42.064 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.064 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-09-13T18:06:42.064 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 22313, 2024-09-13T18:06:42.064 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 22249, 2024-09-13T18:06:42.064 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-09-13T18:06:42.064 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 22249, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 38.365163174, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001724354 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 64, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 158, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 16, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 7, 2024-09-13T18:06:42.065 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 1713, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 1122, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 493, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 98, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 109, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 989, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 1, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 1, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 5, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 23103, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 22454, 2024-09-13T18:06:42.066 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 10, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 68, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 965, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 71, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 124, 2024-09-13T18:06:42.067 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 4, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 234, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:06:42.068 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 102, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 1807, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 22140, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 15730, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 11007, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 112, 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 11797 2024-09-13T18:06:42.069 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 2363, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 34, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 22, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 25, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 5280, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 72, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 10098, 2024-09-13T18:06:42.070 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 10026, 2024-09-13T18:06:42.071 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-09-13T18:06:42.071 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-09-13T18:06:42.071 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-09-13T18:06:42.071 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:06:42.071 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:06:42.071 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-09-13T18:06:42.071 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-09-13T18:06:42.071 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 68, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 23, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 49252, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 49252, 2024-09-13T18:06:42.072 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 59, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 59, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 106287609, 2024-09-13T18:06:42.073 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1618, 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 67.562500784, 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.041756799 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 103, 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 11103, 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 11000, 2024-09-13T18:06:42.074 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 116, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 798, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 682, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 1713, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 18313, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 16600, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 1, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 11076, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 11075, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 94552, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 207124 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.075 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 27159, 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 146, 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 22313, 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 80, 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 765, 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 10449, 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 13.768828900, 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001317717 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.076 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 71, 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.131610354, 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001853666 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-09-13T18:06:42.077 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 62, 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.021247615, 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000342703 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.078 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.079 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.080 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.081 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.081 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 623, 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.489818255, 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000786225 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-09-13T18:06:42.082 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 904, 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 1.518405837, 2024-09-13T18:06:42.083 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001679652 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 2, 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.003397321, 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001698660 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.084 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 600, 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 9.113364594, 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.015188940 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.085 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-09-13T18:06:42.086 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 32, 2024-09-13T18:06:42.087 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 2.479084606, 2024-09-13T18:06:42.087 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.077471393 2024-09-13T18:06:42.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.087 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-09-13T18:06:42.087 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.087 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.087 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.087 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.087 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.088 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 8, 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.021119049, 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002639881 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-09-13T18:06:42.089 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 9498, 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 10.818286643, 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001139006 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:42.090 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 1, 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 3, 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 2, 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 1, 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 15298, 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 15298, 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 161, 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-09-13T18:06:42.091 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.092 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-09-13T18:06:42.092 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:42.092 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:42.092 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:42.092 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:42.092 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:42.092 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:42.093 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:42.094 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 311199, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 212, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 1672, 2024-09-13T18:06:42.095 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 19, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 7496, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 154, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:42.096 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 1711171, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 31708, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 13155, 2024-09-13T18:06:42.097 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 106953365, 2024-09-13T18:06:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 37, 2024-09-13T18:06:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 13155, 2024-09-13T18:06:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-09-13T18:06:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 13155, 2024-09-13T18:06:42.098 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 65.746415013, 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.004997827 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 13155, 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 13364 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 13155, 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 232, 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 12923, 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-09-13T18:06:42.099 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 11, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 232, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 1850, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 134, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 16, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 10729, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-09-13T18:06:42.100 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 22, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-09-13T18:06:42.101 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-09-13T18:06:42.102 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 88, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 3, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 12, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 12, 2024-09-13T18:06:42.103 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 337, 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 33 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-09-13T18:06:42.104 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 40, 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 6, 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 10145, 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 10026, 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-09-13T18:06:42.105 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 77064, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 16933582, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 77064, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 77064, 2024-09-13T18:06:42.106 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 16933582, 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:42.107 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 13155, 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 107966071, 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 13155, 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 107966071, 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:42.108 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 13155, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 13155, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 13155, 2024-09-13T18:06:42.109 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 13155, 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 10026, 2024-09-13T18:06:42.110 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1012706, 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 10026, 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 232, 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1012706, 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:42.111 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x559479e4a500": { 2024-09-13T18:06:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-13T18:06:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 49252, 2024-09-13T18:06:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 102093305, 2024-09-13T18:06:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:42.112 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 49252, 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 1618, 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 102093305, 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:42.113 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:42.114 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-13T18:06:42.752 INFO:tasks.check_counter:Daemon mds.b mds.exported=68 2024-09-13T18:06:42.752 INFO:tasks.check_counter:Daemon mds.b mds.imported=71 2024-09-13T18:06:42.752 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=2363 2024-09-13T18:06:42.752 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=34 2024-09-13T18:06:42.752 DEBUG:tasks.check_counter:Getting stats from e 2024-09-13T18:06:42.753 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-13T18:06:42.957 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:06:43.329 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:43 smithi122 ceph-mon[35310]: pgmap v441: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-13T18:06:43.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:43 smithi027 ceph-mon[30611]: pgmap v441: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-13T18:06:43.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:43 smithi143 ceph-mon[38210]: pgmap v441: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-13T18:06:44.624 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-13T18:06:44.625 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:44.625 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 121, 2024-09-13T18:06:44.625 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 100, 2024-09-13T18:06:44.625 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 810258, 2024-09-13T18:06:44.625 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 52157, 2024-09-13T18:06:44.626 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 5, 2024-09-13T18:06:44.626 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 1, 2024-09-13T18:06:44.626 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.021615010, 2024-09-13T18:06:44.626 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.006399654, 2024-09-13T18:06:44.626 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.021966916, 2024-09-13T18:06:44.627 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.000023834, 2024-09-13T18:06:44.627 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:44.627 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 100, 2024-09-13T18:06:44.627 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.011002703, 2024-09-13T18:06:44.627 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000110027 2024-09-13T18:06:44.627 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.629 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:44.629 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.629 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.629 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.629 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.630 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 809424, 2024-09-13T18:06:44.630 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 51840 2024-09-13T18:06:44.630 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.630 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:44.630 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 166, 2024-09-13T18:06:44.630 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 233, 2024-09-13T18:06:44.631 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 40772, 2024-09-13T18:06:44.631 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 240360, 2024-09-13T18:06:44.631 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 5, 2024-09-13T18:06:44.631 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 4, 2024-09-13T18:06:44.631 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.018418763, 2024-09-13T18:06:44.632 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.006937340, 2024-09-13T18:06:44.632 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.004192368, 2024-09-13T18:06:44.632 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.005322408, 2024-09-13T18:06:44.632 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:44.632 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 231, 2024-09-13T18:06:44.632 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.011334356, 2024-09-13T18:06:44.633 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000049066 2024-09-13T18:06:44.633 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.633 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:44.633 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.633 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.633 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.634 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:06:44.634 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 189040 2024-09-13T18:06:44.634 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.634 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:44.634 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 612, 2024-09-13T18:06:44.635 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 614, 2024-09-13T18:06:44.635 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 845838, 2024-09-13T18:06:44.635 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 190390, 2024-09-13T18:06:44.635 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 4, 2024-09-13T18:06:44.635 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 3, 2024-09-13T18:06:44.635 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.057783386, 2024-09-13T18:06:44.636 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.019697440, 2024-09-13T18:06:44.636 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.015760537, 2024-09-13T18:06:44.636 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.017165630, 2024-09-13T18:06:44.636 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:44.636 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 612, 2024-09-13T18:06:44.636 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.025750271, 2024-09-13T18:06:44.637 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000042075 2024-09-13T18:06:44.637 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.637 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:44.637 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.637 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.637 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.638 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:06:44.638 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:06:44.638 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.638 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-09-13T18:06:44.639 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-09-13T18:06:44.639 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-09-13T18:06:44.639 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.639 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-09-13T18:06:44.639 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-13T18:06:44.639 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-13T18:06:44.640 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1376, 2024-09-13T18:06:44.640 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.035331873, 2024-09-13T18:06:44.640 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000025677 2024-09-13T18:06:44.640 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:44.640 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.640 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-09-13T18:06:44.640 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-13T18:06:44.640 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 0, 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 0, 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-09-13T18:06:44.641 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 0, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 84, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-09-13T18:06:44.642 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 84, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 84, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 0, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 1, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 0, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 0, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 0, 2024-09-13T18:06:44.643 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:06:44.644 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-09-13T18:06:44.644 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-09-13T18:06:44.644 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-09-13T18:06:44.644 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-09-13T18:06:44.644 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-09-13T18:06:44.644 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-09-13T18:06:44.644 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-09-13T18:06:44.644 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:06:44.645 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:06:44.646 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 0 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-09-13T18:06:44.647 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.648 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 388, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 1, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 4858539, 2024-09-13T18:06:44.649 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 4857401, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 388 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 4, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 137, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 133, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 2, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 58, 2024-09-13T18:06:44.650 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 56, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 84, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 214, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 130, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 0, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 0, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 48408, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 207124 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 0, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-09-13T18:06:44.651 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 0, 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 0, 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.652 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.653 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.654 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-09-13T18:06:44.654 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.654 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.654 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.654 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.654 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-09-13T18:06:44.654 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.654 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.655 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.655 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-09-13T18:06:44.655 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.655 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.655 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.655 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.655 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-09-13T18:06:44.655 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.656 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.656 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.656 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.656 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-09-13T18:06:44.656 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.656 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.656 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.657 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-09-13T18:06:44.658 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.659 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.660 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.661 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-09-13T18:06:44.661 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.661 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.661 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.661 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.661 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-09-13T18:06:44.661 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.661 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.662 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.662 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.662 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-09-13T18:06:44.662 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.662 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.662 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.663 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-09-13T18:06:44.663 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.663 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.663 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.663 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.664 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-09-13T18:06:44.664 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.664 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.664 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.664 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.664 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-09-13T18:06:44.664 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.665 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.665 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.665 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.665 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-09-13T18:06:44.665 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.666 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.666 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.666 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.666 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-09-13T18:06:44.667 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.667 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.667 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.667 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.667 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-09-13T18:06:44.667 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.668 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.668 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.668 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.668 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-09-13T18:06:44.668 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.669 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.669 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.669 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.669 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-09-13T18:06:44.669 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.669 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.669 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.670 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-09-13T18:06:44.670 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.670 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.670 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.670 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.671 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:06:44.671 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:06:44.671 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-09-13T18:06:44.671 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.671 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.671 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.672 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:44.672 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.672 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-09-13T18:06:44.672 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 1, 2024-09-13T18:06:44.672 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 2, 2024-09-13T18:06:44.672 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-09-13T18:06:44.672 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 2, 2024-09-13T18:06:44.673 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-09-13T18:06:44.673 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 0, 2024-09-13T18:06:44.673 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 0, 2024-09-13T18:06:44.673 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 3040, 2024-09-13T18:06:44.673 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-09-13T18:06:44.673 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.674 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-09-13T18:06:44.674 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:44.674 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:44.674 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:44.674 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:44.674 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:44.674 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:44.675 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:44.675 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:44.675 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:44.675 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:44.675 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:44.675 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:44.676 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:44.676 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:44.676 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:44.676 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:44.676 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:44.676 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:44.676 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:44.677 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:44.677 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:44.677 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:44.677 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:44.677 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:44.677 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:44.677 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:44.678 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:44.678 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:44.678 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:44.678 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:44.678 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:44.678 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-09-13T18:06:44.679 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:44.679 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:44.679 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:44.679 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:44.679 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 189217, 2024-09-13T18:06:44.679 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 48, 2024-09-13T18:06:44.679 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:06:44.680 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-09-13T18:06:44.680 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-09-13T18:06:44.680 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-09-13T18:06:44.680 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:44.680 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:44.680 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:44.680 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:44.681 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 7496, 2024-09-13T18:06:44.681 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 154, 2024-09-13T18:06:44.681 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:44.681 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:44.681 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:44.681 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-09-13T18:06:44.681 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 71000, 2024-09-13T18:06:44.681 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 365, 2024-09-13T18:06:44.682 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:44.682 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-09-13T18:06:44.682 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:44.682 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-09-13T18:06:44.682 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.682 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-09-13T18:06:44.682 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-09-13T18:06:44.683 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-09-13T18:06:44.683 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 778, 2024-09-13T18:06:44.683 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 21, 2024-09-13T18:06:44.683 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 3, 2024-09-13T18:06:44.683 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 778, 2024-09-13T18:06:44.683 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-09-13T18:06:44.683 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 778, 2024-09-13T18:06:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.519987470, 2024-09-13T18:06:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000668364 2024-09-13T18:06:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-09-13T18:06:44.684 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-09-13T18:06:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 778, 2024-09-13T18:06:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 779 2024-09-13T18:06:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 778, 2024-09-13T18:06:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 778, 2024-09-13T18:06:44.685 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 0, 2024-09-13T18:06:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-09-13T18:06:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-09-13T18:06:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 455, 2024-09-13T18:06:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 0, 2024-09-13T18:06:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 321, 2024-09-13T18:06:44.686 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 0, 2024-09-13T18:06:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 0, 2024-09-13T18:06:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-09-13T18:06:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-09-13T18:06:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-09-13T18:06:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-09-13T18:06:44.687 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 0, 2024-09-13T18:06:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-09-13T18:06:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-09-13T18:06:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-09-13T18:06:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 1, 2024-09-13T18:06:44.688 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 0, 2024-09-13T18:06:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:06:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-09-13T18:06:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:06:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-09-13T18:06:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-09-13T18:06:44.689 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-09-13T18:06:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:06:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-09-13T18:06:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:06:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-09-13T18:06:44.690 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-09-13T18:06:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-09-13T18:06:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-09-13T18:06:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-09-13T18:06:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-09-13T18:06:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-09-13T18:06:44.691 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-09-13T18:06:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-09-13T18:06:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-09-13T18:06:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-09-13T18:06:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-09-13T18:06:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-09-13T18:06:44.692 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-09-13T18:06:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-09-13T18:06:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-09-13T18:06:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-09-13T18:06:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 88, 2024-09-13T18:06:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-09-13T18:06:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 2, 2024-09-13T18:06:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 5, 2024-09-13T18:06:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 5, 2024-09-13T18:06:44.693 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-09-13T18:06:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-09-13T18:06:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 0, 2024-09-13T18:06:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 2, 2024-09-13T18:06:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 0 2024-09-13T18:06:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-09-13T18:06:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 0, 2024-09-13T18:06:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:06:44.694 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-09-13T18:06:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-09-13T18:06:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-09-13T18:06:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-09-13T18:06:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-09-13T18:06:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-09-13T18:06:44.695 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:06:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-09-13T18:06:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-09-13T18:06:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-09-13T18:06:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-09-13T18:06:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-09-13T18:06:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:44.696 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-13T18:06:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 895, 2024-09-13T18:06:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 1607368, 2024-09-13T18:06:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 895, 2024-09-13T18:06:44.697 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 895, 2024-09-13T18:06:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 1607368, 2024-09-13T18:06:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.698 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:44.699 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 778, 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 664240, 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 778, 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 664240, 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-09-13T18:06:44.700 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 778, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 778, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 778, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 778, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.701 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:06:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-13T18:06:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:44.704 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55bc2049e820": { 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:44.705 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:44.706 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:44.707 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:44.707 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-13T18:06:45.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:45 smithi027 ceph-mon[30611]: pgmap v442: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-09-13T18:06:45.485 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-13T18:06:45.485 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-13T18:06:45.486 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-13T18:06:45.486 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-13T18:06:45.486 DEBUG:tasks.check_counter:Getting stats from h 2024-09-13T18:06:45.486 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-13T18:06:45.682 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:06:45.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:45 smithi122 ceph-mon[35310]: pgmap v442: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-09-13T18:06:45.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:45 smithi143 ceph-mon[38210]: pgmap v442: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 KiB/s wr, 14 op/s 2024-09-13T18:06:47.384 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-13T18:06:47.384 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:47.385 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 793, 2024-09-13T18:06:47.385 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 594, 2024-09-13T18:06:47.385 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 335566, 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 926414, 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 16, 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 7, 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.040057042, 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.013817908, 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.027577893, 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.002483480, 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 592, 2024-09-13T18:06:47.388 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.029491568, 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000049816 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1141, 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000139281, 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000122 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 736 2024-09-13T18:06:47.389 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 393, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 718, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 142974, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 561138, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 9, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 7, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.033830787, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.014850514, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.019716609, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.001576299, 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:47.390 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 717, 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.035900172, 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000050069 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 648, 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000092475, 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000142 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 121664, 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 516528 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 13697, 2024-09-13T18:06:47.391 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 6618, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 6490788, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 1329599, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 7, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 6, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.536942074, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.230953025, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.424674673, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.002467771, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 6617, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.099594971, 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000015051 2024-09-13T18:06:47.392 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 19807, 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.002105291, 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000106 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 818688, 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 56720 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-09-13T18:06:47.393 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 209, 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.079842789, 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000382022 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 186, 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.007906382, 2024-09-13T18:06:47.394 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000042507 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 168, 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 168, 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 168, 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.144153466, 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000858056 2024-09-13T18:06:47.395 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 11, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 28, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 9, 2024-09-13T18:06:47.396 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 9, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 10, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 13, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 1233, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 1, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 1, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 5, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 1795, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 1084, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 680, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-09-13T18:06:47.397 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-09-13T18:06:47.398 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-09-13T18:06:47.398 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-09-13T18:06:47.398 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 9, 2024-09-13T18:06:47.398 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 1, 2024-09-13T18:06:47.398 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 9, 2024-09-13T18:06:47.398 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 78, 2024-09-13T18:06:47.398 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-09-13T18:06:47.398 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:06:47.398 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 4, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 234, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:06:47.399 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 59, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 102, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 122, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 68, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 11, 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 163 2024-09-13T18:06:47.400 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 52, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 2213, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 1457, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 1529, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 57, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 83, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 83, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-09-13T18:06:47.401 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 9, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 388, 2024-09-13T18:06:47.402 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 388, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 1, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 1, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 4858539, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 0, 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-09-13T18:06:47.403 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 68, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.119467841, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001756880 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 0 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 34, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 734, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 700, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 33, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 837, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 804, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 28, 2024-09-13T18:06:47.404 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 1421, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 1393, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 1, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 94, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 93, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 53844, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 198932 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 214, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 63, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 168, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 7, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 145, 2024-09-13T18:06:47.405 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 5, 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.005103697, 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001020739 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.406 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 67, 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.019923830, 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000297370 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.407 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000113426, 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000113426 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.408 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.409 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.410 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.410 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.410 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-09-13T18:06:47.410 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.410 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.411 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 12, 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.007113182, 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000592765 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.412 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1, 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.008055201, 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.008055201 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.413 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.414 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-09-13T18:06:47.415 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 82, 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.103844130, 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.001266391 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.416 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 1, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 2, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 1, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-09-13T18:06:47.417 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 152, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 152, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 162, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:47.418 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:47.419 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 299783, 2024-09-13T18:06:47.420 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 124, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 176, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 2, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 7496, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 154, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:47.421 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 137549, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 510, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 244, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 694069, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 33, 2024-09-13T18:06:47.422 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 244, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 244, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.658984112, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.002700754 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 244, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 281 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 244, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 13, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 231, 2024-09-13T18:06:47.423 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 10, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 13, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 81, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 20, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 95, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-09-13T18:06:47.424 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 20, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-09-13T18:06:47.425 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 88, 2024-09-13T18:06:47.426 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 2, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 12, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 12, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 34, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 0, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 8 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 1, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-09-13T18:06:47.427 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 6, 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 6, 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 83, 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 83, 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:47.428 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 14879, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 5605993, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 14879, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 14879, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 5605993, 2024-09-13T18:06:47.429 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:47.430 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 244, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 702452, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 244, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 702452, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:47.431 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 244, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 244, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 244, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 244, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.432 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 83, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 8383, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 83, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:47.433 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 13, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 8383, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x557eb4cae500": { 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 388, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 664235, 2024-09-13T18:06:47.434 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 388, 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 68, 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 664235, 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:47.435 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-13T18:06:47.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:47 smithi122 ceph-mon[35310]: pgmap v443: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-13T18:06:47.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:47 smithi027 ceph-mon[30611]: pgmap v443: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-13T18:06:47.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:47 smithi143 ceph-mon[38210]: pgmap v443: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-13T18:06:48.127 INFO:tasks.check_counter:Daemon mds.h mds.exported=9 2024-09-13T18:06:48.127 INFO:tasks.check_counter:Daemon mds.h mds.imported=9 2024-09-13T18:06:48.127 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=52 2024-09-13T18:06:48.128 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=2213 2024-09-13T18:06:48.128 DEBUG:tasks.check_counter:Getting stats from k 2024-09-13T18:06:48.128 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-13T18:06:48.324 INFO:teuthology.orchestra.run.smithi122.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.b/config 2024-09-13T18:06:49.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:49 smithi122 ceph-mon[35310]: pgmap v444: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-13T18:06:49.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:49 smithi027 ceph-mon[30611]: pgmap v444: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-13T18:06:49.578 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:49 smithi143 ceph-mon[38210]: pgmap v444: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 511 B/s wr, 11 op/s 2024-09-13T18:06:49.978 INFO:teuthology.orchestra.run.smithi122.stdout:{ 2024-09-13T18:06:49.978 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:49.978 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 345, 2024-09-13T18:06:49.978 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 347, 2024-09-13T18:06:49.978 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 112985, 2024-09-13T18:06:49.978 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 107296, 2024-09-13T18:06:49.978 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 6, 2024-09-13T18:06:49.978 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 2, 2024-09-13T18:06:49.978 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.035356483, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.013498482, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.008588866, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.009122570, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 345, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.019489790, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000056492 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.979 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 177, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 245, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 46164, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 246744, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 5, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 4, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.019791128, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.006745053, 2024-09-13T18:06:49.980 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.006398387, 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.004850398, 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 244, 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.016670706, 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000068322 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 193184 2024-09-13T18:06:49.981 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_messages": 413, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages": 393, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_bytes": 3973474, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_bytes": 144572, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_created_connections": 3, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_active_connections": 2, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_total_time": 0.041283650, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_send_time": 0.013934936, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_recv_time": 0.027262630, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_running_fast_dispatch_time": 0.005979685, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 392, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.014293622, 2024-09-13T18:06:49.982 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000036463 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_recv_encrypted_bytes": 807472, 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "msgr_send_encrypted_bytes": 53760 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "cct": { 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "total_workers": 1, 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "unhealthy_workers": 0 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-MDSRank": { 2024-09-13T18:06:49.983 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 1437, 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.030901694, 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000021504 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "finisher-PurgeQueue": { 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "queue_len": 0, 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "complete_latency": { 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.984 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "mds": { 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "request": 0, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "reply": 0, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "reply_latency": { 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_reply": 0, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "forward": 0, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_complete": 0, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_fetch_keys": 0, 2024-09-13T18:06:49.985 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_commit": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_split": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_merge": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes": 404, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_top": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_bottom": 404, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pin_tail": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_pinned": 404, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_expired": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "inodes_with_caps": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "caps": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "subtrees": 1, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_hit": 0, 2024-09-13T18:06:49.986 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_forward": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_discover": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_remote_ino": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "traverse_lock": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "load_cent": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "q": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "exported": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "exported_inodes": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "imported": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "imported_inodes": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_dir_fetch": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "openino_peer_discover": 0, 2024-09-13T18:06:49.987 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rfiles": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rbytes": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "root_rsnaps": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_set_tag": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "scrub_file_inodes": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:06:49.988 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_cap_release": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "process_request_cap_release": 0 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_cache": { 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_update_receipt": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_try_discover": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_send_discover": 0, 2024-09-13T18:06:49.989 INFO:teuthology.orchestra.run.smithi122.stdout: "dir_handle_discover": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_delayed": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_created": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_enqueued": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_reintegrated": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "strays_migrated": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_processing": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_started": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "recovery_completed": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:06:49.990 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_exportdir": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_flush": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_fragstats": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "ireq_inodestats": 0 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_log": { 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "evadd": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "evex": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "evtrm": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "ev": 1872, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "evexg": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "evexd": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "segadd": 0, 2024-09-13T18:06:49.991 INFO:teuthology.orchestra.run.smithi122.stdout: "segex": 0, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "segtrm": 0, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "seg": 2, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "segexg": 0, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "segexd": 0, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "expos": 4194304, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "wrpos": 7284526, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "rdpos": 7283388, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "jlat": { 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: "replayed": 1872 2024-09-13T18:06:49.992 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_mem": { 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "ino": 5, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "ino+": 469, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "ino-": 464, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "dir": 3, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "dir+": 92, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "dir-": 89, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "dn": 404, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "dn+": 700, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "dn-": 296, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "cap": 0, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "cap+": 0, 2024-09-13T18:06:49.993 INFO:teuthology.orchestra.run.smithi122.stdout: "cap-": 0, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "rss": 49136, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "heap": 207124 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_server": { 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_client_request": 0, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "dispatch_server_request": 0, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_request": 0, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_client_session": 0, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "handle_peer_request": 0, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "req_create_latency": { 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.994 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getattr_latency": { 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getfilelock_latency": { 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "req_link_latency": { 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.995 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookup_latency": { 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookuphash_latency": { 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupino_latency": { 2024-09-13T18:06:49.996 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupname_latency": { 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupparent_latency": { 2024-09-13T18:06:49.997 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lookupsnap_latency": { 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "req_lssnap_latency": { 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.998 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.999 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mkdir_latency": { 2024-09-13T18:06:49.999 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:49.999 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:49.999 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:49.999 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:49.999 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mknod_latency": { 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "req_mksnap_latency": { 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "req_open_latency": { 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.000 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "req_readdir_latency": { 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rename_latency": { 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "req_renamesnap_latency": { 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.001 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "req_snapdiff_latency": { 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmdir_latency": { 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmsnap_latency": { 2024-09-13T18:06:50.002 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "req_rmxattr_latency": { 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setattr_latency": { 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.003 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setdirlayout_latency": { 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setfilelock_latency": { 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setlayout_latency": { 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.004 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "req_setxattr_latency": { 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "req_symlink_latency": { 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "req_unlink_latency": { 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.005 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "req_getvxattr_latency": { 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_sessions": { 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "session_count": 1, 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "session_add": 2, 2024-09-13T18:06:50.006 INFO:teuthology.orchestra.run.smithi122.stdout: "session_remove": 1, 2024-09-13T18:06:50.007 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_open": 1, 2024-09-13T18:06:50.007 INFO:teuthology.orchestra.run.smithi122.stdout: "sessions_stale": 0, 2024-09-13T18:06:50.007 INFO:teuthology.orchestra.run.smithi122.stdout: "total_load": 0, 2024-09-13T18:06:50.007 INFO:teuthology.orchestra.run.smithi122.stdout: "average_load": 0, 2024-09-13T18:06:50.007 INFO:teuthology.orchestra.run.smithi122.stdout: "avg_session_uptime": 1605, 2024-09-13T18:06:50.007 INFO:teuthology.orchestra.run.smithi122.stdout: "mdthresh_evicted": 0 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "mempool": { 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:50.008 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:50.009 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_items": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_bytes": 189257, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_anon_items": 49, 2024-09-13T18:06:50.010 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "buffer_meta_items": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_bytes": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_items": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_bytes": 7496, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_items": 154, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:50.011 INFO:teuthology.orchestra.run.smithi122.stdout: "pgmap_items": 0, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_bytes": 299736, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "mds_co_items": 1656, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_1_items": 0, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "unittest_2_items": 0 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "objecter": { 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "op_active": 0, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "op_laggy": 0, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send": 809, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "op_send_bytes": 21, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "op_resend": 3, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "op_reply": 809, 2024-09-13T18:06:50.012 INFO:teuthology.orchestra.run.smithi122.stdout: "op_latency": { 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 809, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.378990869, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000468468 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "op_inflight": 0, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "oplen_avg": { 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 809, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 810 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "op": 809, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "op_r": 809, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "op_w": 0, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "op_rmw": 0, 2024-09-13T18:06:50.013 INFO:teuthology.orchestra.run.smithi122.stdout: "op_pg": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_stat": 467, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_create": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_read": 340, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_write": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writefull": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_writesame": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_append": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_zero": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_truncate": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_delete": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_mapext": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_sparse_read": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_clonerange": 0, 2024-09-13T18:06:50.014 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_getxattr": 1, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_setxattr": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_rmxattr": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_call": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_watch": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_notify": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "osdop_other": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_active": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_send": 0, 2024-09-13T18:06:50.015 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_resend": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "linger_ping": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_active": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_send": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "poolop_resend": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_active": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_send": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "poolstat_resend": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_active": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_send": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "statfs_resend": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "command_active": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "command_send": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "command_resend": 0, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "map_epoch": 88, 2024-09-13T18:06:50.016 INFO:teuthology.orchestra.run.smithi122.stdout: "map_full": 0, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "map_inc": 2, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_sessions": 5, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_open": 5, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_session_close": 0, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "osd_laggy": 0, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_wr": 0, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_rd": 2, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_del": 0 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "oft": { 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_objs": 0, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_updates": 0, 2024-09-13T18:06:50.017 INFO:teuthology.orchestra.run.smithi122.stdout: "omap_total_removes": 0 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "osd-slow-ops": { 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "slow_ops_count": 0 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "purge_queue": { 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops": 0, 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing": 0, 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executing_high_water": 0, 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed_ops": 0, 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_executed": 0, 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "pq_item_in_journal": 0 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:50.018 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 931, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 4039675, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 931, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 931, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 4039675, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.019 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_bytes": { 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 104857600, 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 809, 2024-09-13T18:06:50.020 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 3090227, 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 809, 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 3090227, 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-objecter_ops": { 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 1024, 2024-09-13T18:06:50.021 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:50.022 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:50.022 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:50.022 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:50.022 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:50.022 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 809, 2024-09-13T18:06:50.022 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 809, 2024-09-13T18:06:50.022 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 809, 2024-09-13T18:06:50.022 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 809, 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:50.023 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.024 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: }, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "throttle-write_buf_throttle-0x55722dcd6780": { 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "val": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "max": 3758096384, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "get_started": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "get": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "get_sum": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "take": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "take_sum": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "put": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "put_sum": 0, 2024-09-13T18:06:50.025 INFO:teuthology.orchestra.run.smithi122.stdout: "wait": { 2024-09-13T18:06:50.026 INFO:teuthology.orchestra.run.smithi122.stdout: "avgcount": 0, 2024-09-13T18:06:50.026 INFO:teuthology.orchestra.run.smithi122.stdout: "sum": 0.000000000, 2024-09-13T18:06:50.026 INFO:teuthology.orchestra.run.smithi122.stdout: "avgtime": 0.000000000 2024-09-13T18:06:50.026 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:50.026 INFO:teuthology.orchestra.run.smithi122.stdout: } 2024-09-13T18:06:50.026 INFO:teuthology.orchestra.run.smithi122.stdout:} 2024-09-13T18:06:50.771 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-13T18:06:50.771 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-13T18:06:50.771 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-13T18:06:50.771 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-13T18:06:50.771 DEBUG:tasks.check_counter:Getting stats from c 2024-09-13T18:06:50.771 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-13T18:06:50.979 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:06:51.391 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:51 smithi143 ceph-mon[38210]: pgmap v445: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:06:51.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:51 smithi027 ceph-mon[30611]: pgmap v445: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:06:51.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:51 smithi122 ceph-mon[35310]: pgmap v445: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 255 B/s wr, 9 op/s 2024-09-13T18:06:52.763 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 660, 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 662, 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 29554813, 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 205270, 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 8, 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 4, 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.077836877, 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.019203447, 2024-09-13T18:06:52.764 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.033349888, 2024-09-13T18:06:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.018737759, 2024-09-13T18:06:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 660, 2024-09-13T18:06:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.028596055, 2024-09-13T18:06:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000043327 2024-09-13T18:06:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.765 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 229, 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 210, 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 42781312, 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 86731, 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 5, 2024-09-13T18:06:52.766 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 4, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.047694287, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.008613540, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.043148480, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.002257962, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 209, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.013697040, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000065536 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.767 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 806816, 2024-09-13T18:06:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 52144 2024-09-13T18:06:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 341, 2024-09-13T18:06:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 407, 2024-09-13T18:06:52.768 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 30884412, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 297329, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 6, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 5, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.048075773, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.013457519, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.022175762, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.008866339, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 406, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.020891022, 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000051455 2024-09-13T18:06:52.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 3200, 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 192832 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "cct": { 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "total_workers": 1, 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "unhealthy_workers": 0 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "finisher-MDSRank": { 2024-09-13T18:06:52.770 INFO:teuthology.orchestra.run.smithi143.stdout: "queue_len": 0, 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: "complete_latency": { 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 1750, 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.043827081, 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000025044 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: "finisher-PurgeQueue": { 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: "queue_len": 0, 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: "complete_latency": { 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.771 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": { 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "request": 0, 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "reply": 0, 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "reply_latency": { 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "slow_reply": 0, 2024-09-13T18:06:52.772 INFO:teuthology.orchestra.run.smithi143.stdout: "forward": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_fetch_complete": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_fetch_keys": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_commit": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_split": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_merge": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes": 12239, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_top": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_bottom": 12239, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_pin_tail": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_pinned": 12239, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_expired": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_with_caps": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": 0, 2024-09-13T18:06:52.773 INFO:teuthology.orchestra.run.smithi143.stdout: "subtrees": 2, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse": 0, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_hit": 0, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_forward": 0, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_discover": 0, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_remote_ino": 0, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_lock": 0, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "load_cent": 0, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "q": 0, 2024-09-13T18:06:52.774 INFO:teuthology.orchestra.run.smithi143.stdout: "exported": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "exported_inodes": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "imported": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "imported_inodes": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_dir_fetch": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_peer_discover": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rfiles": 4, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rbytes": 234, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rsnaps": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_set_tag": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:06:52.775 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:06:52.776 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:06:52.776 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:06:52.776 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_file_inodes": 0, 2024-09-13T18:06:52.776 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:06:52.776 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:06:52.776 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:06:52.776 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:06:52.776 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:06:52.776 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_caps": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_cap_release": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "process_request_cap_release": 0 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_cache": { 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_update": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_update_receipt": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_try_discover": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_send_discover": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_handle_discover": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays_delayed": 0, 2024-09-13T18:06:52.777 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_created": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_enqueued": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_reintegrated": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_migrated": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_processing": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "recovery_started": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "recovery_completed": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:06:52.778 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_exportdir": 0, 2024-09-13T18:06:52.779 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_flush": 0, 2024-09-13T18:06:52.779 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:06:52.779 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_fragstats": 0, 2024-09-13T18:06:52.779 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_inodestats": 0 2024-09-13T18:06:52.779 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.779 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_log": { 2024-09-13T18:06:52.779 INFO:teuthology.orchestra.run.smithi143.stdout: "evadd": 0, 2024-09-13T18:06:52.779 INFO:teuthology.orchestra.run.smithi143.stdout: "evex": 0, 2024-09-13T18:06:52.779 INFO:teuthology.orchestra.run.smithi143.stdout: "evtrm": 0, 2024-09-13T18:06:52.780 INFO:teuthology.orchestra.run.smithi143.stdout: "ev": 49252, 2024-09-13T18:06:52.780 INFO:teuthology.orchestra.run.smithi143.stdout: "evexg": 0, 2024-09-13T18:06:52.780 INFO:teuthology.orchestra.run.smithi143.stdout: "evexd": 0, 2024-09-13T18:06:52.780 INFO:teuthology.orchestra.run.smithi143.stdout: "segadd": 0, 2024-09-13T18:06:52.780 INFO:teuthology.orchestra.run.smithi143.stdout: "segex": 0, 2024-09-13T18:06:52.781 INFO:teuthology.orchestra.run.smithi143.stdout: "segtrm": 0, 2024-09-13T18:06:52.781 INFO:teuthology.orchestra.run.smithi143.stdout: "seg": 59, 2024-09-13T18:06:52.781 INFO:teuthology.orchestra.run.smithi143.stdout: "segexg": 0, 2024-09-13T18:06:52.781 INFO:teuthology.orchestra.run.smithi143.stdout: "segexd": 0, 2024-09-13T18:06:52.781 INFO:teuthology.orchestra.run.smithi143.stdout: "expos": 4194304, 2024-09-13T18:06:52.781 INFO:teuthology.orchestra.run.smithi143.stdout: "wrpos": 106287609, 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: "rdpos": 106286471, 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: "jlat": { 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: "replayed": 49252 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_mem": { 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: "ino": 95, 2024-09-13T18:06:52.782 INFO:teuthology.orchestra.run.smithi143.stdout: "ino+": 11087, 2024-09-13T18:06:52.783 INFO:teuthology.orchestra.run.smithi143.stdout: "ino-": 10992, 2024-09-13T18:06:52.783 INFO:teuthology.orchestra.run.smithi143.stdout: "dir": 108, 2024-09-13T18:06:52.783 INFO:teuthology.orchestra.run.smithi143.stdout: "dir+": 780, 2024-09-13T18:06:52.783 INFO:teuthology.orchestra.run.smithi143.stdout: "dir-": 672, 2024-09-13T18:06:52.783 INFO:teuthology.orchestra.run.smithi143.stdout: "dn": 12239, 2024-09-13T18:06:52.783 INFO:teuthology.orchestra.run.smithi143.stdout: "dn+": 18292, 2024-09-13T18:06:52.784 INFO:teuthology.orchestra.run.smithi143.stdout: "dn-": 6053, 2024-09-13T18:06:52.784 INFO:teuthology.orchestra.run.smithi143.stdout: "cap": 0, 2024-09-13T18:06:52.784 INFO:teuthology.orchestra.run.smithi143.stdout: "cap+": 0, 2024-09-13T18:06:52.784 INFO:teuthology.orchestra.run.smithi143.stdout: "cap-": 0, 2024-09-13T18:06:52.784 INFO:teuthology.orchestra.run.smithi143.stdout: "rss": 66468, 2024-09-13T18:06:52.784 INFO:teuthology.orchestra.run.smithi143.stdout: "heap": 207124 2024-09-13T18:06:52.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_server": { 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "dispatch_client_request": 0, 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "dispatch_server_request": 0, 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_request": 0, 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_session": 0, 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_peer_request": 0, 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "req_create_latency": { 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.785 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.786 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getattr_latency": { 2024-09-13T18:06:52.786 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.786 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.786 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.786 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getfilelock_latency": { 2024-09-13T18:06:52.786 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.786 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "req_link_latency": { 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookup_latency": { 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookuphash_latency": { 2024-09-13T18:06:52.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupino_latency": { 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupname_latency": { 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.788 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupparent_latency": { 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupsnap_latency": { 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lssnap_latency": { 2024-09-13T18:06:52.789 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.790 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.790 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.790 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mkdir_latency": { 2024-09-13T18:06:52.790 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.790 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.790 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.791 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mknod_latency": { 2024-09-13T18:06:52.791 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.791 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.791 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.792 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mksnap_latency": { 2024-09-13T18:06:52.792 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.792 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.792 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.792 INFO:teuthology.orchestra.run.smithi143.stdout: "req_open_latency": { 2024-09-13T18:06:52.792 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.793 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.793 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.793 INFO:teuthology.orchestra.run.smithi143.stdout: "req_readdir_latency": { 2024-09-13T18:06:52.793 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.793 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.794 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.794 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rename_latency": { 2024-09-13T18:06:52.794 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.794 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.794 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.794 INFO:teuthology.orchestra.run.smithi143.stdout: "req_renamesnap_latency": { 2024-09-13T18:06:52.794 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: "req_snapdiff_latency": { 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmdir_latency": { 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.795 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.796 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.796 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmsnap_latency": { 2024-09-13T18:06:52.796 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.796 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.796 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.796 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmxattr_latency": { 2024-09-13T18:06:52.796 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.797 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.797 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.797 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setattr_latency": { 2024-09-13T18:06:52.797 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.797 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.797 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.797 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setdirlayout_latency": { 2024-09-13T18:06:52.798 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.798 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.798 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.798 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setfilelock_latency": { 2024-09-13T18:06:52.798 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setlayout_latency": { 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setxattr_latency": { 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.799 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: "req_symlink_latency": { 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: "req_unlink_latency": { 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.800 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getvxattr_latency": { 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_sessions": { 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "session_count": 1, 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "session_add": 3, 2024-09-13T18:06:52.801 INFO:teuthology.orchestra.run.smithi143.stdout: "session_remove": 2, 2024-09-13T18:06:52.802 INFO:teuthology.orchestra.run.smithi143.stdout: "sessions_open": 2, 2024-09-13T18:06:52.802 INFO:teuthology.orchestra.run.smithi143.stdout: "sessions_stale": 0, 2024-09-13T18:06:52.802 INFO:teuthology.orchestra.run.smithi143.stdout: "total_load": 0, 2024-09-13T18:06:52.802 INFO:teuthology.orchestra.run.smithi143.stdout: "average_load": 0, 2024-09-13T18:06:52.802 INFO:teuthology.orchestra.run.smithi143.stdout: "avg_session_uptime": 3041, 2024-09-13T18:06:52.802 INFO:teuthology.orchestra.run.smithi143.stdout: "mdthresh_evicted": 0 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: "mempool": { 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:52.803 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:52.804 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:52.805 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:52.805 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:52.805 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:52.805 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:52.805 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:52.805 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_items": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_anon_bytes": 232343, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_anon_items": 141, 2024-09-13T18:06:52.806 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_meta_items": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_bytes": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_items": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_bytes": 7496, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_items": 154, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:52.807 INFO:teuthology.orchestra.run.smithi143.stdout: "pgmap_items": 0, 2024-09-13T18:06:52.808 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_co_bytes": 9000355, 2024-09-13T18:06:52.808 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_co_items": 73629, 2024-09-13T18:06:52.808 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:52.809 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_1_items": 0, 2024-09-13T18:06:52.809 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:52.809 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_2_items": 0 2024-09-13T18:06:52.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.809 INFO:teuthology.orchestra.run.smithi143.stdout: "objecter": { 2024-09-13T18:06:52.809 INFO:teuthology.orchestra.run.smithi143.stdout: "op_active": 0, 2024-09-13T18:06:52.810 INFO:teuthology.orchestra.run.smithi143.stdout: "op_laggy": 0, 2024-09-13T18:06:52.810 INFO:teuthology.orchestra.run.smithi143.stdout: "op_send": 1107, 2024-09-13T18:06:52.810 INFO:teuthology.orchestra.run.smithi143.stdout: "op_send_bytes": 26, 2024-09-13T18:06:52.810 INFO:teuthology.orchestra.run.smithi143.stdout: "op_resend": 4, 2024-09-13T18:06:52.810 INFO:teuthology.orchestra.run.smithi143.stdout: "op_reply": 1107, 2024-09-13T18:06:52.810 INFO:teuthology.orchestra.run.smithi143.stdout: "op_latency": { 2024-09-13T18:06:52.810 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 1107, 2024-09-13T18:06:52.811 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 1.285964320, 2024-09-13T18:06:52.811 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.001161666 2024-09-13T18:06:52.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.811 INFO:teuthology.orchestra.run.smithi143.stdout: "op_inflight": 0, 2024-09-13T18:06:52.811 INFO:teuthology.orchestra.run.smithi143.stdout: "oplen_avg": { 2024-09-13T18:06:52.811 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 1107, 2024-09-13T18:06:52.812 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 1108 2024-09-13T18:06:52.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.812 INFO:teuthology.orchestra.run.smithi143.stdout: "op": 1107, 2024-09-13T18:06:52.812 INFO:teuthology.orchestra.run.smithi143.stdout: "op_r": 1107, 2024-09-13T18:06:52.812 INFO:teuthology.orchestra.run.smithi143.stdout: "op_w": 0, 2024-09-13T18:06:52.812 INFO:teuthology.orchestra.run.smithi143.stdout: "op_rmw": 0, 2024-09-13T18:06:52.812 INFO:teuthology.orchestra.run.smithi143.stdout: "op_pg": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_stat": 701, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_create": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_read": 403, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_write": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_writefull": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_writesame": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_append": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_zero": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_truncate": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_delete": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_mapext": 0, 2024-09-13T18:06:52.813 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_sparse_read": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_clonerange": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_getxattr": 2, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_setxattr": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_rmxattr": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_call": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_watch": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_notify": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_pgls": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:06:52.814 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_other": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_active": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_send": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_resend": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_ping": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_active": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_send": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_resend": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_active": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_send": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_resend": 0, 2024-09-13T18:06:52.815 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_active": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_send": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_resend": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "command_active": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "command_send": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "command_resend": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "map_epoch": 88, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "map_full": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "map_inc": 2, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_sessions": 10, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_session_open": 10, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_session_close": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_laggy": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_wr": 0, 2024-09-13T18:06:52.816 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_rd": 2, 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_del": 0 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: "oft": { 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_objs": 0, 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_updates": 0, 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_removes": 0 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: "osd-slow-ops": { 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: "slow_ops_count": 0 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.817 INFO:teuthology.orchestra.run.smithi143.stdout: "purge_queue": { 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_ops": 0, 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing": 0, 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_high_water": 0, 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executed_ops": 0, 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executed": 0, 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_item_in_journal": 0 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:52.818 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 104857600, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 1226, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 103101149, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 1226, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 1226, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 103101149, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.819 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-objecter_bytes": { 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 104857600, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 1107, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 102102653, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 1107, 2024-09-13T18:06:52.820 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 102102653, 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-objecter_ops": { 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 1024, 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:52.821 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 1107, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 1107, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 1107, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 1107, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:06:52.822 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 3758096384, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.823 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-write_buf_throttle-0x5556a0c7c960": { 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 3758096384, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 0, 2024-09-13T18:06:52.824 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 0, 2024-09-13T18:06:52.825 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:52.825 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:52.825 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:52.825 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:52.825 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:52.825 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:52.825 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-13T18:06:53.594 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:53 smithi143 ceph-mon[38210]: pgmap v446: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-13T18:06:53.615 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-13T18:06:53.615 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-13T18:06:53.615 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-13T18:06:53.615 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-13T18:06:53.615 DEBUG:tasks.check_counter:Getting stats from f 2024-09-13T18:06:53.615 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-13T18:06:53.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:53 smithi122 ceph-mon[35310]: pgmap v446: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-13T18:06:53.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:53 smithi027 ceph-mon[30611]: pgmap v446: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-13T18:06:53.816 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:06:55.528 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-13T18:06:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 884, 2024-09-13T18:06:55.528 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 886, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 5123828, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 274931, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 6, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 2, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.076877306, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.024569299, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.021895307, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.024036910, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 884, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.033509491, 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000037906 2024-09-13T18:06:55.529 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 0 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 3, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 72, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 716, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 194828, 2024-09-13T18:06:55.530 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 4, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 3, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.004873375, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.002732058, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.001330951, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.000055651, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 70, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.005918010, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000084543 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.531 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 194144 2024-09-13T18:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 124, 2024-09-13T18:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 103, 2024-09-13T18:06:55.532 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 810508, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 53927, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 3, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 2, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.021693914, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.006520238, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.023224727, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.000043035, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 103, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.010915394, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000105974 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.533 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 810240, 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 53616 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "cct": { 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "total_workers": 1, 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "unhealthy_workers": 0 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "finisher-MDSRank": { 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "queue_len": 0, 2024-09-13T18:06:55.534 INFO:teuthology.orchestra.run.smithi143.stdout: "complete_latency": { 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 1536, 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.037471294, 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000024395 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "finisher-PurgeQueue": { 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "queue_len": 0, 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "complete_latency": { 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.535 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": { 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "request": 0, 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "reply": 0, 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "reply_latency": { 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "slow_reply": 0, 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "forward": 0, 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_fetch_complete": 0, 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_fetch_keys": 0, 2024-09-13T18:06:55.536 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_commit": 0, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_split": 0, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_merge": 0, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes": 674, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_top": 0, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_bottom": 674, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_pin_tail": 0, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_pinned": 674, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_expired": 1, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_with_caps": 0, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": 0, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "subtrees": 1, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse": 0, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_hit": 0, 2024-09-13T18:06:55.537 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_forward": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_discover": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_remote_ino": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_lock": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "load_cent": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "q": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "exported": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "exported_inodes": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "imported": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "imported_inodes": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_dir_fetch": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_peer_discover": 0, 2024-09-13T18:06:55.538 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rfiles": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rbytes": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rsnaps": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_set_tag": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_file_inodes": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_revoke": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_grant": 0, 2024-09-13T18:06:55.539 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_caps": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_caps_dirty": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_cap_release": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "process_request_cap_release": 0 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_cache": { 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_update": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_update_receipt": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_try_discover": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_send_discover": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_handle_discover": 0, 2024-09-13T18:06:55.540 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays_delayed": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_created": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_enqueued": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_reintegrated": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_migrated": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_processing": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "recovery_started": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "recovery_completed": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_exportdir": 0, 2024-09-13T18:06:55.541 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_flush": 0, 2024-09-13T18:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_fragstats": 0, 2024-09-13T18:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_inodestats": 0 2024-09-13T18:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_log": { 2024-09-13T18:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "evadd": 0, 2024-09-13T18:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "evex": 0, 2024-09-13T18:06:55.542 INFO:teuthology.orchestra.run.smithi143.stdout: "evtrm": 0, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "ev": 2870, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "evexg": 0, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "evexd": 0, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "segadd": 0, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "segex": 0, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "segtrm": 0, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "seg": 4, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "segexg": 0, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "segexd": 0, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "expos": 4194304, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "wrpos": 9066892, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "rdpos": 9065754, 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "jlat": { 2024-09-13T18:06:55.543 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "replayed": 2870 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_mem": { 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "ino": 7, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "ino+": 758, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "ino-": 751, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "dir": 5, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "dir+": 124, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "dir-": 119, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "dn": 674, 2024-09-13T18:06:55.544 INFO:teuthology.orchestra.run.smithi143.stdout: "dn+": 1153, 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "dn-": 479, 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "cap": 0, 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "cap+": 0, 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "cap-": 0, 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "rss": 49484, 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "heap": 207124 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_server": { 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "dispatch_client_request": 0, 2024-09-13T18:06:55.545 INFO:teuthology.orchestra.run.smithi143.stdout: "dispatch_server_request": 0, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_request": 0, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_session": 0, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_peer_request": 0, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "req_create_latency": { 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getattr_latency": { 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.546 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getfilelock_latency": { 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "req_link_latency": { 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookup_latency": { 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.547 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookuphash_latency": { 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupino_latency": { 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupname_latency": { 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.548 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupparent_latency": { 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupsnap_latency": { 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lssnap_latency": { 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.549 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mkdir_latency": { 2024-09-13T18:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.550 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mknod_latency": { 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mksnap_latency": { 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "req_open_latency": { 2024-09-13T18:06:55.551 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "req_readdir_latency": { 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rename_latency": { 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.552 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "req_renamesnap_latency": { 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "req_snapdiff_latency": { 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmdir_latency": { 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.553 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmsnap_latency": { 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmxattr_latency": { 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setattr_latency": { 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.554 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setdirlayout_latency": { 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setfilelock_latency": { 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setlayout_latency": { 2024-09-13T18:06:55.555 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setxattr_latency": { 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "req_symlink_latency": { 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.556 INFO:teuthology.orchestra.run.smithi143.stdout: "req_unlink_latency": { 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getvxattr_latency": { 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_sessions": { 2024-09-13T18:06:55.557 INFO:teuthology.orchestra.run.smithi143.stdout: "session_count": 1, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "session_add": 3, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "session_remove": 2, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "sessions_open": 1, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "sessions_stale": 0, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "total_load": 0, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "average_load": 0, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "avg_session_uptime": 1607, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "mdthresh_evicted": 0 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "mempool": { 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:55.558 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:55.559 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:55.560 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_items": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_anon_bytes": 181176, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_anon_items": 45, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_meta_bytes": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_meta_items": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_bytes": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_items": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:55.561 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_bytes": 7496, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_items": 154, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "pgmap_items": 0, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_co_bytes": 496728, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_co_items": 2758, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_1_items": 0, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_2_items": 0 2024-09-13T18:06:55.562 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "objecter": { 2024-09-13T18:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "op_active": 0, 2024-09-13T18:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "op_laggy": 0, 2024-09-13T18:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "op_send": 887, 2024-09-13T18:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "op_send_bytes": 21, 2024-09-13T18:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "op_resend": 3, 2024-09-13T18:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "op_reply": 887, 2024-09-13T18:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "op_latency": { 2024-09-13T18:06:55.563 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 887, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.394989022, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000445308 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "op_inflight": 0, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "oplen_avg": { 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 887, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 888 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "op": 887, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "op_r": 887, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "op_w": 0, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "op_rmw": 0, 2024-09-13T18:06:55.564 INFO:teuthology.orchestra.run.smithi143.stdout: "op_pg": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_stat": 532, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_create": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_read": 353, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_write": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_writefull": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_writesame": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_append": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_zero": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_truncate": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_delete": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_mapext": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_sparse_read": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_clonerange": 0, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_getxattr": 1, 2024-09-13T18:06:55.565 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_setxattr": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_rmxattr": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_call": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_watch": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_notify": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_pgls": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_other": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_active": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_send": 0, 2024-09-13T18:06:55.566 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_resend": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_ping": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_active": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_send": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_resend": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_active": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_send": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_resend": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_active": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_send": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_resend": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "command_active": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "command_send": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "command_resend": 0, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "map_epoch": 88, 2024-09-13T18:06:55.567 INFO:teuthology.orchestra.run.smithi143.stdout: "map_full": 0, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "map_inc": 2, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_sessions": 4, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_session_open": 4, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_session_close": 0, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_laggy": 0, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_wr": 0, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_rd": 2, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_del": 0 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "oft": { 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_objs": 0, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_updates": 0, 2024-09-13T18:06:55.568 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_removes": 0 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "osd-slow-ops": { 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "slow_ops_count": 0 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "purge_queue": { 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_ops": 0, 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_ops_high_water": 0, 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing": 0, 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_high_water": 0, 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executed_ops": 0, 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executed": 0, 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_item_in_journal": 0 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.569 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 104857600, 2024-09-13T18:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 1007, 2024-09-13T18:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 5835316, 2024-09-13T18:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 1007, 2024-09-13T18:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:06:55.570 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 1007, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 5835316, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-objecter_bytes": { 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 104857600, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:55.571 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 887, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 4873564, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 887, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 4873564, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-objecter_ops": { 2024-09-13T18:06:55.572 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 1024, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 887, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 887, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 887, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 887, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.573 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 3758096384, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 0, 2024-09-13T18:06:55.574 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 0, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-write_buf_throttle-0x558c60b0a8c0": { 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 3758096384, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:55.575 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 0, 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 0, 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:55.576 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-13T18:06:55.576 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:55 smithi143 ceph-mon[38210]: pgmap v447: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-13T18:06:55.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:55 smithi122 ceph-mon[35310]: pgmap v447: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-13T18:06:55.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:55 smithi027 ceph-mon[30611]: pgmap v447: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 255 B/s wr, 12 op/s 2024-09-13T18:06:56.315 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-13T18:06:56.315 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-13T18:06:56.315 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-13T18:06:56.315 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-13T18:06:56.315 DEBUG:tasks.check_counter:Getting stats from i 2024-09-13T18:06:56.315 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-13T18:06:56.512 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:06:57.599 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:57 smithi143 ceph-mon[38210]: pgmap v448: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:06:57.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:57 smithi122 ceph-mon[35310]: pgmap v448: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:06:57.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:57 smithi027 ceph-mon[30611]: pgmap v448: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:06:58.092 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-13T18:06:58.092 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:06:58.092 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 2056, 2024-09-13T18:06:58.092 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 3344, 2024-09-13T18:06:58.092 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 827738, 2024-09-13T18:06:58.092 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 1826876, 2024-09-13T18:06:58.092 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 15, 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 8, 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.120435677, 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.053594355, 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.097302850, 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.004127349, 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 3342, 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.105765265, 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000031647 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:58.093 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 3931, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000498859, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000126 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 668336, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 1556480 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 482, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 564, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 156417, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 2967125, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 10, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 8, 2024-09-13T18:06:58.094 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.043059810, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.016821037, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.014372453, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.008126231, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 560, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.030257604, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000054031 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 347, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000049517, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000142 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.095 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 195552 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 14246, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 7014, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 6836713, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 1546614, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 7, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 5, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.543031952, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.202268016, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.468021500, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.004999839, 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:06:58.096 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 7016, 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.125606554, 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000017902 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 20535, 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.002536002, 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000123 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 816672, 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 57392 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "cct": { 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "total_workers": 1, 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: "unhealthy_workers": 0 2024-09-13T18:06:58.097 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "finisher-MDSRank": { 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "queue_len": 0, 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "complete_latency": { 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 301, 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.409820172, 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.001361528 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "finisher-PurgeQueue": { 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "queue_len": 0, 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "complete_latency": { 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 780, 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.045718013, 2024-09-13T18:06:58.098 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000058612 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": { 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "request": 798, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "reply": 797, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "reply_latency": { 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 797, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.583619806, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000732270 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "slow_reply": 0, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "forward": 1, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_fetch_complete": 0, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_fetch_keys": 0, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_commit": 20, 2024-09-13T18:06:58.099 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_split": 1, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_merge": 0, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes": 27, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_top": 8, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_bottom": 9, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_pin_tail": 10, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_pinned": 13, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_expired": 1233, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_with_caps": 0, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": 0, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "subtrees": 5, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse": 2503, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_hit": 1779, 2024-09-13T18:06:58.100 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_forward": 0, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_discover": 668, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_remote_ino": 0, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_lock": 0, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "load_cent": 0, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "q": 0, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "exported": 20, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "exported_inodes": 2, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "imported": 15, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "imported_inodes": 230, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_dir_fetch": 0, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_peer_discover": 0, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rfiles": 4, 2024-09-13T18:06:58.101 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rbytes": 234, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rsnaps": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_set_tag": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_file_inodes": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_inode_file_caps": 2, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_revoke": 44, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_grant": 750, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:06:58.102 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_caps": 595, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_caps_dirty": 388, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_cap_release": 131, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "process_request_cap_release": 796 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_cache": { 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_update": 125, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_update_receipt": 2100, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_try_discover": 1377, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_send_discover": 1444, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_handle_discover": 111, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays": 0, 2024-09-13T18:06:58.103 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays_delayed": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_created": 402, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_enqueued": 402, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_reintegrated": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_migrated": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_processing": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "recovery_started": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "recovery_completed": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_exportdir": 20, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_flush": 0, 2024-09-13T18:06:58.104 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_fragmentdir": 1, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_fragstats": 0, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_inodestats": 0 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_log": { 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "evadd": 1872, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "evex": 0, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "evtrm": 0, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "ev": 1872, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "evexg": 0, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "evexd": 0, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "segadd": 2, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "segex": 0, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "segtrm": 0, 2024-09-13T18:06:58.105 INFO:teuthology.orchestra.run.smithi143.stdout: "seg": 2, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "segexg": 0, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "segexd": 0, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "expos": 4194304, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "wrpos": 7284526, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "rdpos": 0, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "jlat": { 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 111, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.422249141, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.003804046 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "replayed": 0 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_mem": { 2024-09-13T18:06:58.106 INFO:teuthology.orchestra.run.smithi143.stdout: "ino": 33, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "ino+": 1052, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "ino-": 1019, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "dir": 32, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "dir+": 833, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "dir-": 801, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "dn": 27, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "dn+": 1890, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "dn-": 1863, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "cap": 0, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "cap+": 415, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "cap-": 415, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "rss": 58040, 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: "heap": 198932 2024-09-13T18:06:58.107 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_server": { 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "dispatch_client_request": 868, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "dispatch_server_request": 64, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_request": 798, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_session": 6, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_peer_request": 174, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "req_create_latency": { 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 172, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.103140188, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000599652 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getattr_latency": { 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 1, 2024-09-13T18:06:58.108 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000524266, 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000524266 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getfilelock_latency": { 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "req_link_latency": { 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookup_latency": { 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 196, 2024-09-13T18:06:58.109 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.048778065, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000248867 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookuphash_latency": { 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupino_latency": { 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupname_latency": { 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.110 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupparent_latency": { 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupsnap_latency": { 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lssnap_latency": { 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.111 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.112 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.112 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.112 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mkdir_latency": { 2024-09-13T18:06:58.112 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.112 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mknod_latency": { 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mksnap_latency": { 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "req_open_latency": { 2024-09-13T18:06:58.113 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "req_readdir_latency": { 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 26, 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.014321232, 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000550816 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rename_latency": { 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.114 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "req_renamesnap_latency": { 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "req_snapdiff_latency": { 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmdir_latency": { 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 2, 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.032249346, 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.016124673 2024-09-13T18:06:58.115 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmsnap_latency": { 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmxattr_latency": { 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setattr_latency": { 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.116 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setdirlayout_latency": { 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setfilelock_latency": { 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setlayout_latency": { 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.117 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setxattr_latency": { 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "req_symlink_latency": { 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "req_unlink_latency": { 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 400, 2024-09-13T18:06:58.118 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.384606709, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000961516 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getvxattr_latency": { 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_sessions": { 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "session_count": 1, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "session_add": 2, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "session_remove": 1, 2024-09-13T18:06:58.119 INFO:teuthology.orchestra.run.smithi143.stdout: "sessions_open": 1, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "sessions_stale": 0, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "total_load": 550, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "average_load": 550, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "avg_session_uptime": 1610, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "mdthresh_evicted": 0 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "mempool": { 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "bloom_filter_items": 0, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:06:58.120 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_extent_items": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_blob_items": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:06:58.121 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_txc_items": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_items": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_bytes": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_items": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:06:58.122 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_anon_bytes": 281399, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_anon_items": 113, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_meta_bytes": 352, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_meta_items": 4, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_bytes": 0, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_items": 0, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_mapbl_items": 0, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_pglog_items": 0, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_bytes": 7496, 2024-09-13T18:06:58.123 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_items": 154, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "pgmap_bytes": 0, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "pgmap_items": 0, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_co_bytes": 133197, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_co_items": 499, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_1_bytes": 0, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_1_items": 0, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_2_bytes": 0, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_2_items": 0 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "objecter": { 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "op_active": 0, 2024-09-13T18:06:58.124 INFO:teuthology.orchestra.run.smithi143.stdout: "op_laggy": 0, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "op_send": 642, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "op_send_bytes": 3361041, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "op_resend": 27, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "op_reply": 642, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "op_latency": { 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 642, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 2.100941801, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.003272495 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "op_inflight": 0, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "oplen_avg": { 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 642, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 691 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.125 INFO:teuthology.orchestra.run.smithi143.stdout: "op": 642, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "op_r": 23, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "op_w": 619, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "op_rmw": 0, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "op_pg": 0, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_stat": 0, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_create": 10, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_read": 23, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_write": 134, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_writefull": 25, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_writesame": 0, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_append": 0, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_zero": 0, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_truncate": 1, 2024-09-13T18:06:58.126 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_delete": 414, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_mapext": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_sparse_read": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_clonerange": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_getxattr": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_setxattr": 20, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_rmxattr": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_call": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_watch": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_notify": 0, 2024-09-13T18:06:58.127 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_pgls": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_other": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_active": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_send": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_resend": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_ping": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_active": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_send": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_resend": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_active": 0, 2024-09-13T18:06:58.128 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_send": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_resend": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_active": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_send": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_resend": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "command_active": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "command_send": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "command_resend": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "map_epoch": 88, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "map_full": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "map_inc": 2, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_sessions": 12, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_session_open": 12, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_session_close": 0, 2024-09-13T18:06:58.129 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_laggy": 0, 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_wr": 54, 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_rd": 0, 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_del": 10 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "oft": { 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_objs": 1, 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_updates": 0, 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_removes": 0 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "osd-slow-ops": { 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: "slow_ops_count": 0 2024-09-13T18:06:58.130 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "purge_queue": { 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_ops": 0, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_ops_high_water": 6, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing": 0, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_high_water": 6, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executed_ops": 402, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executed": 402, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_item_in_journal": 0 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 104857600, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 16780, 2024-09-13T18:06:58.131 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 6224740, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 16780, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 16780, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 6224740, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-objecter_bytes": { 2024-09-13T18:06:58.132 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 104857600, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 642, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 3401643, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 642, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 3401643, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.133 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-objecter_ops": { 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 1024, 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:06:58.134 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:58.135 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:06:58.135 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 642, 2024-09-13T18:06:58.135 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 642, 2024-09-13T18:06:58.135 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 642, 2024-09-13T18:06:58.135 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 642, 2024-09-13T18:06:58.135 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:58.135 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.135 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.135 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 3758096384, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 402, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 40602, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 402, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 23, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 40602, 2024-09-13T18:06:58.136 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-write_buf_throttle-0x563d24244500": { 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 3758096384, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 1872, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 3090222, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 1872, 2024-09-13T18:06:58.137 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 111, 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 3090222, 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:06:58.138 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-13T18:06:58.869 INFO:tasks.check_counter:Daemon mds.i mds.exported=20 2024-09-13T18:06:58.870 INFO:tasks.check_counter:Daemon mds.i mds.imported=15 2024-09-13T18:06:58.870 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=125 2024-09-13T18:06:58.870 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=2100 2024-09-13T18:06:58.870 DEBUG:tasks.check_counter:Getting stats from l 2024-09-13T18:06:58.870 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 shell --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-13T18:06:59.065 INFO:teuthology.orchestra.run.smithi143.stderr:Inferring config /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/mon.c/config 2024-09-13T18:06:59.451 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:06:59 smithi143 ceph-mon[38210]: pgmap v449: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:06:59.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:06:59 smithi122 ceph-mon[35310]: pgmap v449: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:06:59.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:06:59 smithi027 ceph-mon[30611]: pgmap v449: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi143.stdout:{ 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-0": { 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 1116, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 904, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 1234406, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 3466356, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 15, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 7, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.077584268, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.027975380, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.055974112, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.007332814, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 904, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.034664058, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000038345 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 1090, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000152601, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000140 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 812368, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 62464 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-1": { 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 13811, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 6684, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 5945290, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 1512940, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 9, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 7, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.498495784, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.187462202, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.428658317, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.004975272, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 6682, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.117944043, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000017651 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 19930, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.002690728, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000135 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 196432 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "AsyncMessenger::Worker-2": { 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_messages": 2048, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages": 3807, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_bytes": 828423, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_bytes": 2053946, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_created_connections": 8, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_active_connections": 6, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_total_time": 0.146356120, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_send_time": 0.066920909, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_recv_time": 0.099743778, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_running_fast_dispatch_time": 0.005327817, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_messages_queue_lat": { 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 3805, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.100788680, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000026488 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_handle_ack_lat": { 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 4174, 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000687174, 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000164 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_recv_encrypted_bytes": 764352, 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "msgr_send_encrypted_bytes": 1935840 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "cct": { 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "total_workers": 1, 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "unhealthy_workers": 0 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "finisher-MDSRank": { 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "queue_len": 0, 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "complete_latency": { 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 218, 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.440488582, 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.002020589 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "finisher-PurgeQueue": { 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "queue_len": 0, 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "complete_latency": { 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 981, 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.049958156, 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000050925 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "mds": { 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "request": 1037, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "reply": 1037, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "reply_latency": { 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 1037, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.779975431, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000752146 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "slow_reply": 0, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "forward": 0, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_fetch_complete": 0, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_fetch_keys": 0, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_commit": 11, 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_split": 0, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_merge": 0, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes": 29, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_top": 9, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_bottom": 20, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_pin_tail": 0, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_pinned": 13, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_expired": 1233, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "inodes_with_caps": 1, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "caps": 1, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "subtrees": 6, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse": 2837, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_hit": 2111, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_forward": 0, 2024-09-13T18:07:00.775 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_discover": 684, 2024-09-13T18:07:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_dir_fetch": 0, 2024-09-13T18:07:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_remote_ino": 0, 2024-09-13T18:07:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "traverse_lock": 0, 2024-09-13T18:07:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "load_cent": 0, 2024-09-13T18:07:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "q": 0, 2024-09-13T18:07:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "exported": 15, 2024-09-13T18:07:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "exported_inodes": 0, 2024-09-13T18:07:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "imported": 15, 2024-09-13T18:07:00.776 INFO:teuthology.orchestra.run.smithi143.stdout: "imported_inodes": 269, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_dir_fetch": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_backtrace_fetch": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "openino_peer_discover": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rfiles": 4, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rbytes": 234, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "root_rsnaps": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_backtrace_fetch": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_set_tag": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_backtrace_repaired": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_inotable_repaired": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dir_inodes": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dir_base_inodes": 0, 2024-09-13T18:07:00.777 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_dirfrag_rstats": 0, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "scrub_file_inodes": 0, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_inode_file_caps": 0, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_revoke": 16, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_grant": 761, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_trunc": 0, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_caps": 507, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_caps_dirty": 485, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_cap_release": 13, 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: "process_request_cap_release": 1036 2024-09-13T18:07:00.778 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_cache": { 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_update": 117, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_update_receipt": 2139, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_try_discover": 1419, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_send_discover": 1468, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "dir_handle_discover": 117, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays": 0, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays_delayed": 0, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "num_strays_enqueuing": 0, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_created": 508, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_enqueued": 508, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_reintegrated": 0, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "strays_migrated": 0, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_processing": 0, 2024-09-13T18:07:00.779 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_enqueued": 0, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "num_recovering_prioritized": 0, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "recovery_started": 0, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "recovery_completed": 0, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_enqueue_scrub": 0, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_exportdir": 15, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_flush": 0, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_fragmentdir": 0, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_fragstats": 0, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "ireq_inodestats": 0 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_log": { 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "evadd": 2130, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "evex": 0, 2024-09-13T18:07:00.780 INFO:teuthology.orchestra.run.smithi143.stdout: "evtrm": 0, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "ev": 2130, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "evexg": 0, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "evexd": 0, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "segadd": 3, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "segex": 0, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "segtrm": 0, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "seg": 3, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "segexg": 0, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "segexd": 0, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "expos": 4194304, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "wrpos": 7439955, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "rdpos": 0, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "jlat": { 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 84, 2024-09-13T18:07:00.781 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.219354723, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.002611365 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "replayed": 0 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_mem": { 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "ino": 36, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "ino+": 1161, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "ino-": 1125, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "dir": 35, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "dir+": 823, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "dir-": 788, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "dn": 29, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "dn+": 2039, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "dn-": 2010, 2024-09-13T18:07:00.782 INFO:teuthology.orchestra.run.smithi143.stdout: "cap": 1, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "cap+": 527, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "cap-": 526, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "rss": 60688, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "heap": 198932 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_server": { 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "dispatch_client_request": 1080, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "dispatch_server_request": 63, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_request": 1037, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_client_session": 7, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "handle_peer_request": 155, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "req_create_latency": { 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 239, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.137405613, 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000574918 2024-09-13T18:07:00.783 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getattr_latency": { 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getfilelock_latency": { 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "req_link_latency": { 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.784 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookup_latency": { 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 261, 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.077088647, 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000295358 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookuphash_latency": { 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupino_latency": { 2024-09-13T18:07:00.785 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 1, 2024-09-13T18:07:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000311809, 2024-09-13T18:07:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000311809 2024-09-13T18:07:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupname_latency": { 2024-09-13T18:07:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.786 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupparent_latency": { 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lookupsnap_latency": { 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.787 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "req_lssnap_latency": { 2024-09-13T18:07:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mkdir_latency": { 2024-09-13T18:07:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.788 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mknod_latency": { 2024-09-13T18:07:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.789 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "req_mksnap_latency": { 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "req_open_latency": { 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.790 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "req_readdir_latency": { 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 28, 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.016701769, 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000596491 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rename_latency": { 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "req_renamesnap_latency": { 2024-09-13T18:07:00.791 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "req_snapdiff_latency": { 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmdir_latency": { 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.792 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmsnap_latency": { 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "req_rmxattr_latency": { 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setattr_latency": { 2024-09-13T18:07:00.793 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setdirlayout_latency": { 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setfilelock_latency": { 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.794 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setlayout_latency": { 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "req_setxattr_latency": { 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.795 INFO:teuthology.orchestra.run.smithi143.stdout: "req_symlink_latency": { 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "req_unlink_latency": { 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 508, 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.548467593, 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.001079660 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "cap_revoke_eviction": 0, 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "cap_acquisition_throttle": 0, 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "req_getvxattr_latency": { 2024-09-13T18:07:00.796 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_sessions": { 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "session_count": 1, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "session_add": 2, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "session_remove": 1, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "sessions_open": 1, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "sessions_stale": 0, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "total_load": 705, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "average_load": 705, 2024-09-13T18:07:00.797 INFO:teuthology.orchestra.run.smithi143.stdout: "avg_session_uptime": 178, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "mdthresh_evicted": 0 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "mempool": { 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bloom_filter_bytes": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bloom_filter_items": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_alloc_bytes": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_alloc_items": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_data_bytes": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_data_items": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_onode_items": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_meta_items": 0, 2024-09-13T18:07:00.798 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_other_bytes": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_other_items": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_cache_buffer_items": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_extent_bytes": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_extent_items": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_blob_bytes": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_blob_items": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_shared_blob_items": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_inline_bl_items": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_fsck_bytes": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_fsck_items": 0, 2024-09-13T18:07:00.799 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_txc_bytes": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_txc_items": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_deferred_items": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_bytes": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluestore_writing_items": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_bytes": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_items": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_reader_bytes": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_reader_items": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_writer_bytes": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "bluefs_file_writer_items": 0, 2024-09-13T18:07:00.800 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_anon_bytes": 308759, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_anon_items": 134, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_meta_bytes": 792, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "buffer_meta_items": 9, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_bytes": 0, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_items": 0, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_mapbl_bytes": 0, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_mapbl_items": 0, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_pglog_bytes": 0, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_pglog_items": 0, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_bytes": 7496, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_items": 154, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_mapping_bytes": 0, 2024-09-13T18:07:00.801 INFO:teuthology.orchestra.run.smithi143.stdout: "osdmap_mapping_items": 0, 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "pgmap_bytes": 0, 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "pgmap_items": 0, 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_co_bytes": 144405, 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "mds_co_items": 505, 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_1_bytes": 0, 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_1_items": 0, 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_2_bytes": 0, 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "unittest_2_items": 0 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.802 INFO:teuthology.orchestra.run.smithi143.stdout: "objecter": { 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "op_active": 0, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "op_laggy": 0, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "op_send": 712, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "op_send_bytes": 3342713, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "op_resend": 33, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "op_reply": 712, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "op_latency": { 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 712, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 1.578956298, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.002217635 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "op_inflight": 0, 2024-09-13T18:07:00.803 INFO:teuthology.orchestra.run.smithi143.stdout: "oplen_avg": { 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 712, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 753 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "op": 712, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "op_r": 24, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "op_w": 688, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "op_rmw": 0, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "op_pg": 0, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_stat": 0, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_create": 10, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_read": 24, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_write": 108, 2024-09-13T18:07:00.804 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_writefull": 24, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_writesame": 0, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_append": 0, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_zero": 0, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_truncate": 0, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_delete": 520, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_mapext": 0, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_sparse_read": 0, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_clonerange": 0, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_getxattr": 0, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_setxattr": 20, 2024-09-13T18:07:00.805 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_cmpxattr": 0, 2024-09-13T18:07:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_rmxattr": 0, 2024-09-13T18:07:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_resetxattrs": 0, 2024-09-13T18:07:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_call": 0, 2024-09-13T18:07:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_watch": 0, 2024-09-13T18:07:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_notify": 0, 2024-09-13T18:07:00.806 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_src_cmpxattr": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_pgls": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_pgls_filter": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "osdop_other": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_active": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_send": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_resend": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "linger_ping": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_active": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_send": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "poolop_resend": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_active": 0, 2024-09-13T18:07:00.807 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_send": 0, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "poolstat_resend": 0, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_active": 0, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_send": 0, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "statfs_resend": 0, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "command_active": 0, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "command_send": 0, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "command_resend": 0, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "map_epoch": 88, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "map_full": 0, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "map_inc": 2, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_sessions": 12, 2024-09-13T18:07:00.808 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_session_open": 12, 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_session_close": 0, 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "osd_laggy": 0, 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_wr": 37, 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_rd": 0, 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_del": 10 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "oft": { 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_objs": 1, 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_kv_pairs": 0, 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_updates": 0, 2024-09-13T18:07:00.809 INFO:teuthology.orchestra.run.smithi143.stdout: "omap_total_removes": 0 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "osd-slow-ops": { 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "slow_ops_count": 0 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "purge_queue": { 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_ops": 0, 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_ops_high_water": 6, 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing": 0, 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executing_high_water": 6, 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executed_ops": 508, 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_executed": 508, 2024-09-13T18:07:00.810 INFO:teuthology.orchestra.run.smithi143.stdout: "pq_item_in_journal": 0 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 104857600, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 16971, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 6385497, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 16971, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 16971, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 6385497, 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:07:00.811 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-objecter_bytes": { 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 104857600, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 712, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 3394021, 2024-09-13T18:07:00.812 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 712, 2024-09-13T18:07:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 3394021, 2024-09-13T18:07:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:07:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:07:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-objecter_ops": { 2024-09-13T18:07:00.813 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 1024, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 0, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 0, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 0, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 712, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 712, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 712, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 712, 2024-09-13T18:07:00.814 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-write_buf_throttle": { 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 3758096384, 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 508, 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 51308, 2024-09-13T18:07:00.815 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 508, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 24, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 51308, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: }, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "throttle-write_buf_throttle-0x56374ab32500": { 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "val": 0, 2024-09-13T18:07:00.816 INFO:teuthology.orchestra.run.smithi143.stdout: "max": 3758096384, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "get_started": 0, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "get": 2130, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "get_sum": 3245651, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_fail": 0, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "get_or_fail_success": 2130, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "take": 0, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "take_sum": 0, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "put": 84, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "put_sum": 3245651, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "wait": { 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "avgcount": 0, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "sum": 0.000000000, 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: "avgtime": 0.000000000 2024-09-13T18:07:00.817 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:07:00.818 INFO:teuthology.orchestra.run.smithi143.stdout: } 2024-09-13T18:07:00.818 INFO:teuthology.orchestra.run.smithi143.stdout:} 2024-09-13T18:07:01.525 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:01 smithi143 ceph-mon[38210]: pgmap v450: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:07:01.551 INFO:tasks.check_counter:Daemon mds.l mds.exported=15 2024-09-13T18:07:01.551 INFO:tasks.check_counter:Daemon mds.l mds.imported=15 2024-09-13T18:07:01.551 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=117 2024-09-13T18:07:01.551 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=2139 2024-09-13T18:07:01.551 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T18:07:01.563 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T18:07:01.564 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T18:07:01.564 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:07:01.608 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2024-09-13T18:07:01.608 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:07:01.689 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:07:01.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:01 smithi122 ceph-mon[35310]: pgmap v450: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:07:01.782 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:01 smithi027 ceph-mon[30611]: pgmap v450: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-13T18:07:01.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.894+0000 7fbd6f400640 1 -- 172.21.15.27:0/3284215695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd680ffda0 msgr2=0x7fbd681001a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:01.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.894+0000 7fbd6f400640 1 --2- 172.21.15.27:0/3284215695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd680ffda0 0x7fbd681001a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009900 tx=0x7fbd5802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:07:01.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.894+0000 7fbd6f400640 1 -- 172.21.15.27:0/3284215695 shutdown_connections 2024-09-13T18:07:01.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.894+0000 7fbd6f400640 1 --2- 172.21.15.27:0/3284215695 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd68101950 0x7fbd681081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:01.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.894+0000 7fbd6f400640 1 --2- 172.21.15.27:0/3284215695 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd68100f90 0x7fbd68101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:01.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.894+0000 7fbd6f400640 1 --2- 172.21.15.27:0/3284215695 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd680ffda0 0x7fbd681001a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:01.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.894+0000 7fbd6f400640 1 -- 172.21.15.27:0/3284215695 >> 172.21.15.27:0/3284215695 conn(0x7fbd680fb520 msgr2=0x7fbd680fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:01.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.894+0000 7fbd6f400640 1 -- 172.21.15.27:0/3284215695 shutdown_connections 2024-09-13T18:07:01.897 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.895+0000 7fbd6f400640 1 -- 172.21.15.27:0/3284215695 wait complete. 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.895+0000 7fbd6f400640 1 Processor -- start 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6f400640 1 -- start start 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6f400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd680ffda0 0x7fbd68198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6f400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd68100f90 0x7fbd681985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6f400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd68101950 0x7fbd6819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6f400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6819fb80 con 0x7fbd68101950 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6f400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6819fcf0 con 0x7fbd680ffda0 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6f400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6819feb0 con 0x7fbd68100f90 2024-09-13T18:07:01.899 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6d400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd68101950 0x7fbd6819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd680ffda0 0x7fbd68198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6ca00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd680ffda0 0x7fbd68198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:54346/0 (socket says 172.21.15.27:54346) 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6d400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd68101950 0x7fbd6819f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48478/0 (socket says 172.21.15.27:48478) 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd6ca00640 1 -- 172.21.15.27:0/239753697 learned_addr learned my addr 172.21.15.27:0/239753697 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.896+0000 7fbd5fe00640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd68100f90 0x7fbd681985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd6ca00640 1 -- 172.21.15.27:0/239753697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd68100f90 msgr2=0x7fbd681985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd6ca00640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd68100f90 0x7fbd681985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd6ca00640 1 -- 172.21.15.27:0/239753697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd68101950 msgr2=0x7fbd6819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd6ca00640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd68101950 0x7fbd6819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:01.900 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd6ca00640 1 -- 172.21.15.27:0/239753697 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd50009490 con 0x7fbd680ffda0 2024-09-13T18:07:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd6ca00640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd680ffda0 0x7fbd68198090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd58031510 tx=0x7fbd58004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd66000640 1 -- 172.21.15.27:0/239753697 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58005000 con 0x7fbd680ffda0 2024-09-13T18:07:01.901 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd58009560 con 0x7fbd680ffda0 2024-09-13T18:07:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd66000640 1 -- 172.21.15.27:0/239753697 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd580046c0 con 0x7fbd680ffda0 2024-09-13T18:07:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.897+0000 7fbd66000640 1 -- 172.21.15.27:0/239753697 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58003a10 con 0x7fbd680ffda0 2024-09-13T18:07:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.898+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd681a0450 con 0x7fbd680ffda0 2024-09-13T18:07:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.898+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6810b7e0 con 0x7fbd680ffda0 2024-09-13T18:07:01.902 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.900+0000 7fbd66000640 1 -- 172.21.15.27:0/239753697 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbd58004bc0 con 0x7fbd680ffda0 2024-09-13T18:07:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.902+0000 7fbd66000640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbd4c0a1090 0x7fbd4c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.902+0000 7fbd66000640 1 -- 172.21.15.27:0/239753697 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbd580ed6d0 con 0x7fbd680ffda0 2024-09-13T18:07:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.902+0000 7fbd5fe00640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbd4c0a1090 0x7fbd4c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:01.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.903+0000 7fbd5fe00640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbd4c0a1090 0x7fbd4c0a3550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbd681995a0 tx=0x7fbd50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:01.906 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:01.904+0000 7fbd66000640 1 -- 172.21.15.27:0/239753697 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fbd580b6ec0 con 0x7fbd680ffda0 2024-09-13T18:07:02.085 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.083+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd6810b9f0 con 0x7fbd680ffda0 2024-09-13T18:07:02.087 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.086+0000 7fbd66000640 1 -- 172.21.15.27:0/239753697 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7fbd58035090 con 0x7fbd680ffda0 2024-09-13T18:07:02.088 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:07:02.088 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":88,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:02:37.160677+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:07:02.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbd4c0a1090 msgr2=0x7fbd4c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbd4c0a1090 0x7fbd4c0a3550 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbd681995a0 tx=0x7fbd50005f90 comp rx=0 tx=0).stop 2024-09-13T18:07:02.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd680ffda0 msgr2=0x7fbd68198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd680ffda0 0x7fbd68198090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd58031510 tx=0x7fbd58004270 comp rx=0 tx=0).stop 2024-09-13T18:07:02.090 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 shutdown_connections 2024-09-13T18:07:02.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fbd4c0a1090 0x7fbd4c0a3550 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fbd68101950 0x7fbd6819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fbd68100f90 0x7fbd681985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 --2- 172.21.15.27:0/239753697 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fbd680ffda0 0x7fbd68198090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 >> 172.21.15.27:0/239753697 conn(0x7fbd680fb520 msgr2=0x7fbd68106760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:02.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 shutdown_connections 2024-09-13T18:07:02.091 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.088+0000 7fbd6f400640 1 -- 172.21.15.27:0/239753697 wait complete. 2024-09-13T18:07:02.108 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T17:57:10.088488+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:01:44.492835+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:01:45.883650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:07:02.110 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:07:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.271+0000 7f5657e00640 1 -- 172.21.15.27:0/2049476273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5658103940 msgr2=0x7f565810a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.271+0000 7f5657e00640 1 --2- 172.21.15.27:0/2049476273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5658103940 0x7f565810a260 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5650009ca0 tx=0x7f565002a8b0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.271+0000 7f5657e00640 1 -- 172.21.15.27:0/2049476273 shutdown_connections 2024-09-13T18:07:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.271+0000 7f5657e00640 1 --2- 172.21.15.27:0/2049476273 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5658103940 0x7f565810a260 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.271+0000 7f5657e00640 1 --2- 172.21.15.27:0/2049476273 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5658102f80 0x7f5658103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.271+0000 7f5657e00640 1 --2- 172.21.15.27:0/2049476273 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5658101e30 0x7f5658102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.271+0000 7f5657e00640 1 -- 172.21.15.27:0/2049476273 >> 172.21.15.27:0/2049476273 conn(0x7f56580fd5b0 msgr2=0x7f56580ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.272+0000 7f5657e00640 1 -- 172.21.15.27:0/2049476273 shutdown_connections 2024-09-13T18:07:02.274 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.272+0000 7f5657e00640 1 -- 172.21.15.27:0/2049476273 wait complete. 2024-09-13T18:07:02.276 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.272+0000 7f5657e00640 1 Processor -- start 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5657e00640 1 -- start start 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5657e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5658101e30 0x7f5658197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5657e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5658102f80 0x7f56581983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5657e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5658103940 0x7f565819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5657e00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565819f990 con 0x7f5658102f80 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5657e00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565819fb00 con 0x7f5658101e30 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5657e00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565819fcc0 con 0x7f5658103940 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5656a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5658101e30 0x7f5658197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5656a00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5658101e30 0x7f5658197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.122:3300/0 says I am v2:172.21.15.27:54374/0 (socket says 172.21.15.27:54374) 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5656a00640 1 -- 172.21.15.27:0/3382783904 learned_addr learned my addr 172.21.15.27:0/3382783904 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f564fe00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5658102f80 0x7f56581983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:02.277 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.273+0000 7f5657400640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5658103940 0x7f565819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f5656a00640 1 -- 172.21.15.27:0/3382783904 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5658103940 msgr2=0x7f565819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f5656a00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5658103940 0x7f565819f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f5656a00640 1 -- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5658102f80 msgr2=0x7f56581983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f5656a00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5658102f80 0x7f56581983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f5656a00640 1 -- 172.21.15.27:0/3382783904 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650009900 con 0x7f5658101e30 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f5657400640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5658103940 0x7f565819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f5656a00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5658101e30 0x7f5658197ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f564800e9f0 tx=0x7f564800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f564f400640 1 -- 172.21.15.27:0/3382783904 <== mon.2 v2:172.21.15.122:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648009700 con 0x7f5658101e30 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f564f400640 1 -- 172.21.15.27:0/3382783904 <== mon.2 v2:172.21.15.122:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f564800cd80 con 0x7f5658101e30 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565819ffa0 con 0x7f5658101e30 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f564f400640 1 -- 172.21.15.27:0/3382783904 <== mon.2 v2:172.21.15.122:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648018920 con 0x7f5658101e30 2024-09-13T18:07:02.278 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.274+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56581a0420 con 0x7f5658101e30 2024-09-13T18:07:02.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.275+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5658109140 con 0x7f5658101e30 2024-09-13T18:07:02.279 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.277+0000 7f564f400640 1 -- 172.21.15.27:0/3382783904 <== mon.2 v2:172.21.15.122:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5648018a80 con 0x7f5658101e30 2024-09-13T18:07:02.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.279+0000 7f564f400640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f563c0a1110 0x7f563c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:02.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.279+0000 7f564f400640 1 -- 172.21.15.27:0/3382783904 <== mon.2 v2:172.21.15.122:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5648014070 con 0x7f5658101e30 2024-09-13T18:07:02.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.279+0000 7f564fe00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f563c0a1110 0x7f563c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:02.281 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.280+0000 7f564fe00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f563c0a1110 0x7f563c0a35d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f56581993b0 tx=0x7f5640005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:02.282 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.281+0000 7f564f400640 1 -- 172.21.15.27:0/3382783904 <== mon.2 v2:172.21.15.122:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5648096880 con 0x7f5658101e30 2024-09-13T18:07:02.464 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.462+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f565802c3e0 con 0x7f5658101e30 2024-09-13T18:07:02.465 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.464+0000 7f564f400640 1 -- 172.21.15.27:0/3382783904 <== mon.2 v2:172.21.15.122:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5648099ea0 con 0x7f5658101e30 2024-09-13T18:07:02.466 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 1 2024-09-13T18:07:02.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f563c0a1110 msgr2=0x7f563c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f563c0a1110 0x7f563c0a35d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f56581993b0 tx=0x7f5640005f90 comp rx=0 tx=0).stop 2024-09-13T18:07:02.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5658101e30 msgr2=0x7f5658197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5658101e30 0x7f5658197ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f564800e9f0 tx=0x7f564800eeb0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 shutdown_connections 2024-09-13T18:07:02.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f563c0a1110 0x7f563c0a35d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.468 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5658103940 0x7f565819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5658102f80 0x7f56581983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 --2- 172.21.15.27:0/3382783904 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5658101e30 0x7f5658197ea0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 >> 172.21.15.27:0/3382783904 conn(0x7f56580fd5b0 msgr2=0x7f5658106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:02.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 shutdown_connections 2024-09-13T18:07:02.469 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.466+0000 7f5657e00640 1 -- 172.21.15.27:0/3382783904 wait complete. 2024-09-13T18:07:02.482 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:02 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/239753697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:07:02.484 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:07:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.645+0000 7fde39c00640 1 -- 172.21.15.27:0/2600356052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde34103080 msgr2=0x7fde34103500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.645+0000 7fde39c00640 1 --2- 172.21.15.27:0/2600356052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde34103080 0x7fde34103500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde20009900 tx=0x7fde2002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.645+0000 7fde39c00640 1 -- 172.21.15.27:0/2600356052 shutdown_connections 2024-09-13T18:07:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.645+0000 7fde39c00640 1 --2- 172.21.15.27:0/2600356052 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde34103a40 0x7fde3410a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.645+0000 7fde39c00640 1 --2- 172.21.15.27:0/2600356052 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde34103080 0x7fde34103500 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.645+0000 7fde39c00640 1 --2- 172.21.15.27:0/2600356052 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde34101ea0 0x7fde341022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.645+0000 7fde39c00640 1 -- 172.21.15.27:0/2600356052 >> 172.21.15.27:0/2600356052 conn(0x7fde340fd670 msgr2=0x7fde340ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.645+0000 7fde39c00640 1 -- 172.21.15.27:0/2600356052 shutdown_connections 2024-09-13T18:07:02.648 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.645+0000 7fde39c00640 1 -- 172.21.15.27:0/2600356052 wait complete. 2024-09-13T18:07:02.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.646+0000 7fde39c00640 1 Processor -- start 2024-09-13T18:07:02.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.646+0000 7fde39c00640 1 -- start start 2024-09-13T18:07:02.650 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39c00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde34101ea0 0x7fde34197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39c00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde34103080 0x7fde341984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde34103a40 0x7fde3419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39c00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3419fa50 con 0x7fde34103a40 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39c00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3419fbc0 con 0x7fde34103080 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39c00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3419fd80 con 0x7fde34101ea0 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde33e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde34101ea0 0x7fde34197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde34103a40 0x7fde3419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde33e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde34101ea0 0x7fde34197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.143:3300/0 says I am v2:172.21.15.27:60820/0 (socket says 172.21.15.27:60820) 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde33e00640 1 -- 172.21.15.27:0/2633778336 learned_addr learned my addr 172.21.15.27:0/2633778336 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde33400640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde34103080 0x7fde341984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39200640 1 -- 172.21.15.27:0/2633778336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde34101ea0 msgr2=0x7fde34197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39200640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde34101ea0 0x7fde34197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39200640 1 -- 172.21.15.27:0/2633778336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde34103080 msgr2=0x7fde341984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.651 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.647+0000 7fde39200640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde34103080 0x7fde341984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.648+0000 7fde39200640 1 -- 172.21.15.27:0/2633778336 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde20009560 con 0x7fde34103a40 2024-09-13T18:07:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.648+0000 7fde33400640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde34103080 0x7fde341984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.648+0000 7fde39200640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde34103a40 0x7fde3419f510 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009fd0 tx=0x7fde2c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.648+0000 7fde30c00640 1 -- 172.21.15.27:0/2633778336 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c00ce20 con 0x7fde34103a40 2024-09-13T18:07:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.648+0000 7fde30c00640 1 -- 172.21.15.27:0/2633778336 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fde2c005020 con 0x7fde34103a40 2024-09-13T18:07:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.648+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde341a0060 con 0x7fde34103a40 2024-09-13T18:07:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.648+0000 7fde30c00640 1 -- 172.21.15.27:0/2633778336 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c010690 con 0x7fde34103a40 2024-09-13T18:07:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.648+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde341a04f0 con 0x7fde34103a40 2024-09-13T18:07:02.652 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.649+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde341093b0 con 0x7fde34103a40 2024-09-13T18:07:02.653 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.651+0000 7fde30c00640 1 -- 172.21.15.27:0/2633778336 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fde2c005500 con 0x7fde34103a40 2024-09-13T18:07:02.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.653+0000 7fde30c00640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde180a1090 0x7fde180a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:02.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.653+0000 7fde30c00640 1 -- 172.21.15.27:0/2633778336 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fde2c014070 con 0x7fde34103a40 2024-09-13T18:07:02.655 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.653+0000 7fde33e00640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde180a1090 0x7fde180a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:02.656 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.654+0000 7fde33e00640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde180a1090 0x7fde180a3550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fde240058c0 tx=0x7fde24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:02.659 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.657+0000 7fde30c00640 1 -- 172.21.15.27:0/2633778336 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fde2c0967e0 con 0x7fde34103a40 2024-09-13T18:07:02.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:02 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/239753697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:07:02.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:02 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/239753697' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:07:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.837+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde34108e20 con 0x7fde34103a40 2024-09-13T18:07:02.839 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.837+0000 7fde30c00640 1 -- 172.21.15.27:0/2633778336 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde2c005190 con 0x7fde34103a40 2024-09-13T18:07:02.839 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 32 2024-09-13T18:07:02.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde180a1090 msgr2=0x7fde180a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde180a1090 0x7fde180a3550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fde240058c0 tx=0x7fde24005f90 comp rx=0 tx=0).stop 2024-09-13T18:07:02.841 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde34103a40 msgr2=0x7fde3419f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:02.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde34103a40 0x7fde3419f510 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009fd0 tx=0x7fde2c00ef10 comp rx=0 tx=0).stop 2024-09-13T18:07:02.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 shutdown_connections 2024-09-13T18:07:02.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fde180a1090 0x7fde180a3550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fde34103a40 0x7fde3419f510 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fde34103080 0x7fde341984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 --2- 172.21.15.27:0/2633778336 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fde34101ea0 0x7fde34197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:02.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 >> 172.21.15.27:0/2633778336 conn(0x7fde340fd670 msgr2=0x7fde34106580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:02.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.839+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 shutdown_connections 2024-09-13T18:07:02.842 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:02.840+0000 7fde39c00640 1 -- 172.21.15.27:0/2633778336 wait complete. 2024-09-13T18:07:02.858 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:07:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.019+0000 7fec1d800640 1 -- 172.21.15.27:0/1832815920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 msgr2=0x7fec18108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.019+0000 7fec1d800640 1 --2- 172.21.15.27:0/1832815920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 0x7fec18108160 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fec10009ca0 tx=0x7fec1002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.019+0000 7fec1d800640 1 -- 172.21.15.27:0/1832815920 shutdown_connections 2024-09-13T18:07:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.019+0000 7fec1d800640 1 --2- 172.21.15.27:0/1832815920 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 0x7fec18108160 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.022 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.019+0000 7fec1d800640 1 --2- 172.21.15.27:0/1832815920 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec18100f10 0x7fec18101390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.019+0000 7fec1d800640 1 --2- 172.21.15.27:0/1832815920 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec180ffd20 0x7fec18100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.019+0000 7fec1d800640 1 -- 172.21.15.27:0/1832815920 >> 172.21.15.27:0/1832815920 conn(0x7fec180fb480 msgr2=0x7fec180fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:03.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.020+0000 7fec1d800640 1 -- 172.21.15.27:0/1832815920 shutdown_connections 2024-09-13T18:07:03.023 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.020+0000 7fec1d800640 1 -- 172.21.15.27:0/1832815920 wait complete. 2024-09-13T18:07:03.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.020+0000 7fec1d800640 1 Processor -- start 2024-09-13T18:07:03.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec1d800640 1 -- start start 2024-09-13T18:07:03.025 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec1d800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec180ffd20 0x7fec18074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec1d800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec18100f10 0x7fec180728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec1d800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 0x7fec18072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec1d800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec18073540 con 0x7fec181018d0 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec1d800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec180736b0 con 0x7fec18100f10 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec1d800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1819fe40 con 0x7fec180ffd20 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec17400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 0x7fec18072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec17400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 0x7fec18072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48520/0 (socket says 172.21.15.27:48520) 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec17400640 1 -- 172.21.15.27:0/2672705762 learned_addr learned my addr 172.21.15.27:0/2672705762 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec0e000640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec18100f10 0x7fec180728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.021+0000 7fec16a00640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec180ffd20 0x7fec18074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec17400640 1 -- 172.21.15.27:0/2672705762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec180ffd20 msgr2=0x7fec18074260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec17400640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec180ffd20 0x7fec18074260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.026 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec17400640 1 -- 172.21.15.27:0/2672705762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec18100f10 msgr2=0x7fec180728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec17400640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec18100f10 0x7fec180728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec17400640 1 -- 172.21.15.27:0/2672705762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10009900 con 0x7fec181018d0 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec16a00640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec180ffd20 0x7fec18074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec17400640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 0x7fec18072de0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec10033040 tx=0x7fec10003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec0fe00640 1 -- 172.21.15.27:0/2672705762 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10031450 con 0x7fec181018d0 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec181a0090 con 0x7fec181018d0 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec0fe00640 1 -- 172.21.15.27:0/2672705762 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fec10040070 con 0x7fec181018d0 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec0fe00640 1 -- 172.21.15.27:0/2672705762 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec10030820 con 0x7fec181018d0 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.022+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec181a05a0 con 0x7fec181018d0 2024-09-13T18:07:03.027 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.023+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec181070e0 con 0x7fec181018d0 2024-09-13T18:07:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.025+0000 7fec0fe00640 1 -- 172.21.15.27:0/2672705762 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fec10042030 con 0x7fec181018d0 2024-09-13T18:07:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.026+0000 7fec0fe00640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7febfc0a1090 0x7febfc0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:03.028 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.027+0000 7fec0fe00640 1 -- 172.21.15.27:0/2672705762 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fec100ede00 con 0x7fec181018d0 2024-09-13T18:07:03.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.027+0000 7fec16a00640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7febfc0a1090 0x7febfc0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:03.029 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.027+0000 7fec16a00640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7febfc0a1090 0x7febfc0a3550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fec18100d70 tx=0x7fec08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:03.032 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.030+0000 7fec0fe00640 1 -- 172.21.15.27:0/2672705762 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fec100b7660 con 0x7fec181018d0 2024-09-13T18:07:03.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.210+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fec1802c3e0 con 0x7fec181018d0 2024-09-13T18:07:03.212 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.210+0000 7fec0fe00640 1 -- 172.21.15.27:0/2672705762 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fec100bac80 con 0x7fec181018d0 2024-09-13T18:07:03.212 INFO:teuthology.orchestra.run.smithi027.stdout:pg_num: 64 2024-09-13T18:07:03.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.212+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7febfc0a1090 msgr2=0x7febfc0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.212+0000 7fec1d800640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7febfc0a1090 0x7febfc0a3550 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fec18100d70 tx=0x7fec08005f90 comp rx=0 tx=0).stop 2024-09-13T18:07:03.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.212+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 msgr2=0x7fec18072de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.212+0000 7fec1d800640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 0x7fec18072de0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fec10033040 tx=0x7fec10003ba0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.212+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 shutdown_connections 2024-09-13T18:07:03.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.212+0000 7fec1d800640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7febfc0a1090 0x7febfc0a3550 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.215 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.213+0000 7fec1d800640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fec181018d0 0x7fec18072de0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.213+0000 7fec1d800640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fec18100f10 0x7fec180728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.213+0000 7fec1d800640 1 --2- 172.21.15.27:0/2672705762 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fec180ffd20 0x7fec18074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.213+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 >> 172.21.15.27:0/2672705762 conn(0x7fec180fb480 msgr2=0x7fec181042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:03.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.213+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 shutdown_connections 2024-09-13T18:07:03.216 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.213+0000 7fec1d800640 1 -- 172.21.15.27:0/2672705762 wait complete. 2024-09-13T18:07:03.232 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:07:03.394 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.392+0000 7f418c200640 1 -- 172.21.15.27:0/3140547406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41840ffd60 msgr2=0x7f4184100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.392+0000 7f418c200640 1 --2- 172.21.15.27:0/3140547406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41840ffd60 0x7f4184100160 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4178009860 tx=0x7f417802a340 comp rx=0 tx=0).stop 2024-09-13T18:07:03.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.392+0000 7f418c200640 1 -- 172.21.15.27:0/3140547406 shutdown_connections 2024-09-13T18:07:03.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.392+0000 7f418c200640 1 --2- 172.21.15.27:0/3140547406 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f4184101910 0x7f41841081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.392+0000 7f418c200640 1 --2- 172.21.15.27:0/3140547406 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4184100f50 0x7f41841013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.392+0000 7f418c200640 1 --2- 172.21.15.27:0/3140547406 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f41840ffd60 0x7f4184100160 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.392+0000 7f418c200640 1 -- 172.21.15.27:0/3140547406 >> 172.21.15.27:0/3140547406 conn(0x7f41840fb4c0 msgr2=0x7f41840fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:03.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.392+0000 7f418c200640 1 -- 172.21.15.27:0/3140547406 shutdown_connections 2024-09-13T18:07:03.395 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.392+0000 7f418c200640 1 -- 172.21.15.27:0/3140547406 wait complete. 2024-09-13T18:07:03.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.393+0000 7f418c200640 1 Processor -- start 2024-09-13T18:07:03.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.393+0000 7f418c200640 1 -- start start 2024-09-13T18:07:03.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.393+0000 7f418c200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41840ffd60 0x7f4184074260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:03.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.393+0000 7f418c200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4184100f50 0x7f41840728a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:03.397 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.393+0000 7f418c200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4184101910 0x7f4184072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f418c200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4184073540 con 0x7f41840ffd60 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f418c200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41840736b0 con 0x7f4184101910 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f418c200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418419feb0 con 0x7f4184100f50 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f4189800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41840ffd60 0x7f4184074260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f418a200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4184101910 0x7f4184072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f4189800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41840ffd60 0x7f4184074260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48540/0 (socket says 172.21.15.27:48540) 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f4189800640 1 -- 172.21.15.27:0/671281624 learned_addr learned my addr 172.21.15.27:0/671281624 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f4188e00640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4184100f50 0x7f41840728a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f4189800640 1 -- 172.21.15.27:0/671281624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4184100f50 msgr2=0x7f41840728a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f4189800640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4184100f50 0x7f41840728a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f4189800640 1 -- 172.21.15.27:0/671281624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4184101910 msgr2=0x7f4184072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f4189800640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4184101910 0x7f4184072de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.394+0000 7f4189800640 1 -- 172.21.15.27:0/671281624 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178009490 con 0x7f41840ffd60 2024-09-13T18:07:03.398 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.395+0000 7f4189800640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41840ffd60 0x7f4184074260 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4178009780 tx=0x7f41780326f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:03.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.395+0000 7f4182000640 1 -- 172.21.15.27:0/671281624 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4178032ea0 con 0x7f41840ffd60 2024-09-13T18:07:03.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.395+0000 7f4182000640 1 -- 172.21.15.27:0/671281624 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4178030340 con 0x7f41840ffd60 2024-09-13T18:07:03.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.395+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41841a0100 con 0x7f41840ffd60 2024-09-13T18:07:03.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.395+0000 7f4182000640 1 -- 172.21.15.27:0/671281624 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417803b430 con 0x7f41840ffd60 2024-09-13T18:07:03.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.395+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41841a05a0 con 0x7f41840ffd60 2024-09-13T18:07:03.399 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.396+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41841071c0 con 0x7f41840ffd60 2024-09-13T18:07:03.400 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.398+0000 7f4182000640 1 -- 172.21.15.27:0/671281624 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f4178039040 con 0x7f41840ffd60 2024-09-13T18:07:03.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.399+0000 7f4182000640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f416c0a1110 0x7f416c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:03.401 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.400+0000 7f4182000640 1 -- 172.21.15.27:0/671281624 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f41780ecc90 con 0x7f41840ffd60 2024-09-13T18:07:03.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.400+0000 7f4188e00640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f416c0a1110 0x7f416c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:03.402 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.400+0000 7f4188e00640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f416c0a1110 0x7f416c0a35d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4184073fd0 tx=0x7f4170005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:03.405 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.403+0000 7f4182000640 1 -- 172.21.15.27:0/671281624 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f41780b63d0 con 0x7f41840ffd60 2024-09-13T18:07:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:03 smithi027 ceph-mon[30611]: pgmap v451: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:07:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:03 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/3382783904' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:07:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:03 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2633778336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:07:03.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:03 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2672705762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:07:03.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.597+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f418410b7a0 con 0x7f41840ffd60 2024-09-13T18:07:03.599 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.597+0000 7f4182000640 1 -- 172.21.15.27:0/671281624 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+590 (secure 0 0 0) 0x7f4178037080 con 0x7f41840ffd60 2024-09-13T18:07:03.599 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/1188602618 2024-09-14T17:54:35.275484+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/3579424943 2024-09-14T17:54:35.275484+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/246522964 2024-09-14T17:54:35.275484+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/1083878216 2024-09-14T17:54:35.275484+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/1083878216 2024-09-14T17:54:35.275484+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6801/2456729013 2024-09-14T17:54:06.682080+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:6800/2456729013 2024-09-14T17:54:06.682080+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2249948778 2024-09-14T17:54:06.682080+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/852564053 2024-09-14T17:54:06.682080+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27:0/2742710546 2024-09-14T17:54:06.682080+0000 2024-09-13T18:07:03.600 INFO:teuthology.orchestra.run.smithi027.stderr:listed 10 entries 2024-09-13T18:07:03.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f416c0a1110 msgr2=0x7f416c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.601 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f416c0a1110 0x7f416c0a35d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4184073fd0 tx=0x7f4170005f90 comp rx=0 tx=0).stop 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41840ffd60 msgr2=0x7f4184074260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41840ffd60 0x7f4184074260 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4178009780 tx=0x7f41780326f0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 shutdown_connections 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f416c0a1110 0x7f416c0a35d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f4184101910 0x7f4184072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f4184100f50 0x7f41840728a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 --2- 172.21.15.27:0/671281624 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f41840ffd60 0x7f4184074260 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.599+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 >> 172.21.15.27:0/671281624 conn(0x7f41840fb4c0 msgr2=0x7f4184104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.600+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 shutdown_connections 2024-09-13T18:07:03.602 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:03.600+0000 7f418c200640 1 -- 172.21.15.27:0/671281624 wait complete. 2024-09-13T18:07:03.618 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:07:03.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:07:03.618 DEBUG:teuthology.orchestra.run.smithi027:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:07:03.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:03 smithi122 ceph-mon[35310]: pgmap v451: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:07:03.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:03 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/3382783904' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:07:03.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:03 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2633778336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:07:03.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:03 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2672705762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:07:03.730 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2024-09-13T18:07:03.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:07:03.730 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:07:03.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:03 smithi143 ceph-mon[38210]: pgmap v451: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-13T18:07:03.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:03 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/3382783904' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T18:07:03.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:03 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2633778336' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-13T18:07:03.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:03 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2672705762' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-13T18:07:03.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:07:03.835 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2024-09-13T18:07:03.914 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:07:03.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:07:03.915 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:07:03.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:07:03.980 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2024-09-13T18:07:04.316 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T18:07:04.326 INFO:tasks.cephadm:Teardown begin 2024-09-13T18:07:04.326 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:07:04.327 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:07:04.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.489+0000 7f5abd800640 1 -- 172.21.15.27:0/4011058485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ab8103190 msgr2=0x7f5ab8103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:04.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.489+0000 7f5abd800640 1 --2- 172.21.15.27:0/4011058485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ab8103190 0x7f5ab8103610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009900 tx=0x7f5aa002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.491 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.489+0000 7f5abd800640 1 -- 172.21.15.27:0/4011058485 shutdown_connections 2024-09-13T18:07:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.489+0000 7f5abd800640 1 --2- 172.21.15.27:0/4011058485 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ab8103b50 0x7f5ab810a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.489+0000 7f5abd800640 1 --2- 172.21.15.27:0/4011058485 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ab8103190 0x7f5ab8103610 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.489+0000 7f5abd800640 1 --2- 172.21.15.27:0/4011058485 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ab8101fa0 0x7f5ab81023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.489+0000 7f5abd800640 1 -- 172.21.15.27:0/4011058485 >> 172.21.15.27:0/4011058485 conn(0x7f5ab80fd700 msgr2=0x7f5ab80ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.489+0000 7f5abd800640 1 -- 172.21.15.27:0/4011058485 shutdown_connections 2024-09-13T18:07:04.492 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.489+0000 7f5abd800640 1 -- 172.21.15.27:0/4011058485 wait complete. 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.490+0000 7f5abd800640 1 Processor -- start 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.490+0000 7f5abd800640 1 -- start start 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.490+0000 7f5abd800640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ab8101fa0 0x7f5ab81980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5abd800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ab8103190 0x7f5ab81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5abd800640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ab8103b50 0x7f5ab819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5abd800640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab819fba0 con 0x7f5ab8103190 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5abd800640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab819fd10 con 0x7f5ab8101fa0 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5abd800640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab819fed0 con 0x7f5ab8103b50 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5aafe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ab8103190 0x7f5ab81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5aafe00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ab8103190 0x7f5ab81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48560/0 (socket says 172.21.15.27:48560) 2024-09-13T18:07:04.494 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5aafe00640 1 -- 172.21.15.27:0/1839758431 learned_addr learned my addr 172.21.15.27:0/1839758431 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5ab6a00640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ab8101fa0 0x7f5ab81980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5ab7400640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ab8103b50 0x7f5ab819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5aafe00640 1 -- 172.21.15.27:0/1839758431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ab8103b50 msgr2=0x7f5ab819f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5aafe00640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ab8103b50 0x7f5ab819f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5aafe00640 1 -- 172.21.15.27:0/1839758431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ab8101fa0 msgr2=0x7f5ab81980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5aafe00640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ab8101fa0 0x7f5ab81980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5aafe00640 1 -- 172.21.15.27:0/1839758431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab0009840 con 0x7f5ab8103190 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.491+0000 7f5ab6a00640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ab8101fa0 0x7f5ab81980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.492+0000 7f5aafe00640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ab8103190 0x7f5ab81985f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0031510 tx=0x7f5aa00055a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.492+0000 7f5aaf400640 1 -- 172.21.15.27:0/1839758431 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0004b50 con 0x7f5ab8103190 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.492+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa0009560 con 0x7f5ab8103190 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.492+0000 7f5aaf400640 1 -- 172.21.15.27:0/1839758431 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5aa0004cb0 con 0x7f5ab8103190 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.492+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab81a0470 con 0x7f5ab8103190 2024-09-13T18:07:04.495 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.492+0000 7f5aaf400640 1 -- 172.21.15.27:0/1839758431 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0031a50 con 0x7f5ab8103190 2024-09-13T18:07:04.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.493+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab8109430 con 0x7f5ab8103190 2024-09-13T18:07:04.496 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.495+0000 7f5aaf400640 1 -- 172.21.15.27:0/1839758431 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5aa00035f0 con 0x7f5ab8103190 2024-09-13T18:07:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.496+0000 7f5aaf400640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5a9c0a1090 0x7f5a9c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.496+0000 7f5aaf400640 1 -- 172.21.15.27:0/1839758431 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5aa00ed8f0 con 0x7f5ab8103190 2024-09-13T18:07:04.498 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.497+0000 7f5ab6a00640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5a9c0a1090 0x7f5a9c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:04.499 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.497+0000 7f5ab6a00640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5a9c0a1090 0x7f5a9c0a3550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8102ff0 tx=0x7f5aa8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:04.501 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.500+0000 7f5aaf400640 1 -- 172.21.15.27:0/1839758431 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f5aa00b7030 con 0x7f5ab8103190 2024-09-13T18:07:04.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:04 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/671281624' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:07:04.713 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:04 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/671281624' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:07:04.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.721+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ab810d9f0 con 0x7f5ab8103190 2024-09-13T18:07:04.723 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.721+0000 7f5aaf400640 1 -- 172.21.15.27:0/1839758431 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+10947 (secure 0 0 0) 0x7f5aa00ba650 con 0x7f5ab8103190 2024-09-13T18:07:04.723 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:07:04.724 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:01:46.320502+0000","modified":"2024-09-13T18:06:24.251126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24556,"mds_2":24533,"mds_3":24529,"mds_4":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24448":{"gid":24448,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24529":{"gid":24529,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24556":{"gid":24556,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[0,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/1102491877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1102491877},{"type":"v1","addr":"172.21.15.122:6839","nonce":1102491877}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:07:04.724 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 37 2024-09-13T18:07:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5a9c0a1090 msgr2=0x7f5a9c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5a9c0a1090 0x7f5a9c0a3550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8102ff0 tx=0x7f5aa8005f90 comp rx=0 tx=0).stop 2024-09-13T18:07:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ab8103190 msgr2=0x7f5ab81985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ab8103190 0x7f5ab81985f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0031510 tx=0x7f5aa00055a0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 shutdown_connections 2024-09-13T18:07:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f5a9c0a1090 0x7f5a9c0a3550 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f5ab8103b50 0x7f5ab819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f5ab8103190 0x7f5ab81985f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.726 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 --2- 172.21.15.27:0/1839758431 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f5ab8101fa0 0x7f5ab81980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 >> 172.21.15.27:0/1839758431 conn(0x7f5ab80fd700 msgr2=0x7f5ab8106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:04.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 shutdown_connections 2024-09-13T18:07:04.727 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.724+0000 7f5abd800640 1 -- 172.21.15.27:0/1839758431 wait complete. 2024-09-13T18:07:04.742 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:07:04.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:04 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/671281624' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T18:07:04.904 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.902+0000 7fdccfa00640 1 -- 172.21.15.27:0/2200712361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8105a80 msgr2=0x7fdcc8107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:04.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.902+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2200712361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8105a80 0x7fdcc8107ef0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0009ca0 tx=0x7fdcc002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.902+0000 7fdccfa00640 1 -- 172.21.15.27:0/2200712361 shutdown_connections 2024-09-13T18:07:04.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.902+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2200712361 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8105a80 0x7fdcc8107ef0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.902+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2200712361 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc8103150 0x7fdcc8105540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.902+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2200712361 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc8100820 0x7fdcc8102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.902+0000 7fdccfa00640 1 -- 172.21.15.27:0/2200712361 >> 172.21.15.27:0/2200712361 conn(0x7fdcc80fa420 msgr2=0x7fdcc80fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:04.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.902+0000 7fdccfa00640 1 -- 172.21.15.27:0/2200712361 shutdown_connections 2024-09-13T18:07:04.905 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.902+0000 7fdccfa00640 1 -- 172.21.15.27:0/2200712361 wait complete. 2024-09-13T18:07:04.907 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.903+0000 7fdccfa00640 1 Processor -- start 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.903+0000 7fdccfa00640 1 -- start start 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.903+0000 7fdccfa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc8100820 0x7fdcc81980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.903+0000 7fdccfa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8103150 0x7fdcc81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccfa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc8105a80 0x7fdcc819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccfa00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc819fba0 con 0x7fdcc8103150 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccfa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc819fd10 con 0x7fdcc8105a80 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccfa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc819fed0 con 0x7fdcc8100820 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdcc7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8103150 0x7fdcc81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccd000640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc8100820 0x7fdcc81980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdcc7e00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8103150 0x7fdcc81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48588/0 (socket says 172.21.15.27:48588) 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdcc7e00640 1 -- 172.21.15.27:0/2701357140 learned_addr learned my addr 172.21.15.27:0/2701357140 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:04.908 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccda00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc8105a80 0x7fdcc819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccd000640 1 -- 172.21.15.27:0/2701357140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc8105a80 msgr2=0x7fdcc819f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccd000640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc8105a80 0x7fdcc819f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccd000640 1 -- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8103150 msgr2=0x7fdcc81985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccd000640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8103150 0x7fdcc81985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdccd000640 1 -- 172.21.15.27:0/2701357140 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc0009900 con 0x7fdcc8100820 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.904+0000 7fdcc7e00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8103150 0x7fdcc81985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.905+0000 7fdccd000640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc8100820 0x7fdcc81980b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00e9f0 tx=0x7fdcbc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.905+0000 7fdcc5600640 1 -- 172.21.15.27:0/2701357140 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00ccc0 con 0x7fdcc8100820 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.905+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc81a01b0 con 0x7fdcc8100820 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.905+0000 7fdcc5600640 1 -- 172.21.15.27:0/2701357140 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdcbc00ce20 con 0x7fdcc8100820 2024-09-13T18:07:04.909 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.905+0000 7fdcc5600640 1 -- 172.21.15.27:0/2701357140 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc018920 con 0x7fdcc8100820 2024-09-13T18:07:04.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.905+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc81a06c0 con 0x7fdcc8100820 2024-09-13T18:07:04.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.906+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc80fbf10 con 0x7fdcc8100820 2024-09-13T18:07:04.910 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.908+0000 7fdcc5600640 1 -- 172.21.15.27:0/2701357140 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fdcbc018a80 con 0x7fdcc8100820 2024-09-13T18:07:04.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.909+0000 7fdcc5600640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdcb00a1090 0x7fdcb00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:04.911 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.910+0000 7fdcc5600640 1 -- 172.21.15.27:0/2701357140 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdcbc014070 con 0x7fdcc8100820 2024-09-13T18:07:04.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.910+0000 7fdcc7e00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdcb00a1090 0x7fdcb00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:04.912 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.910+0000 7fdcc7e00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdcb00a1090 0x7fdcb00a3550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdcc81995c0 tx=0x7fdcb4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:04.913 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:04.911+0000 7fdcc5600640 1 -- 172.21.15.27:0/2701357140 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fdcbc0965f0 con 0x7fdcc8100820 2024-09-13T18:07:05.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.130+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcc810d9d0 con 0x7fdcc8100820 2024-09-13T18:07:05.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.130+0000 7fdcc5600640 1 -- 172.21.15.27:0/2701357140 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+10947 (secure 0 0 0) 0x7fdcbc099c10 con 0x7fdcc8100820 2024-09-13T18:07:05.133 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:07:05.133 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14439,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6835/2543999093","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6834","nonce":2543999093},{"type":"v1","addr":"172.21.15.27:6835","nonce":2543999093}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14457,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.27:6837/1224306728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6836","nonce":1224306728},{"type":"v1","addr":"172.21.15.27:6837","nonce":1224306728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T18:01:46.320502+0000","modified":"2024-09-13T18:06:24.251126+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24584,"mds_1":24556,"mds_2":24533,"mds_3":24529,"mds_4":24448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14505":{"gid":14505,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.27:6839/91312549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6838","nonce":91312549},{"type":"v1","addr":"172.21.15.27:6839","nonce":91312549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24448":{"gid":24448,"name":"l","rank":4,"incarnation":24,"state":"up:active","state_seq":12,"addr":"172.21.15.143:6833/2820864881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6832","nonce":2820864881},{"type":"v1","addr":"172.21.15.143:6833","nonce":2820864881}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24455":{"gid":24455,"name":"k","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6833/1100066007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6832","nonce":1100066007},{"type":"v1","addr":"172.21.15.122:6833","nonce":1100066007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24497":{"gid":24497,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.122:6835/1011366471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6834","nonce":1011366471},{"type":"v1","addr":"172.21.15.122:6835","nonce":1011366471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24499":{"gid":24499,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6835/1530941636","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6834","nonce":1530941636},{"type":"v1","addr":"172.21.15.143:6835","nonce":1530941636}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24511":{"gid":24511,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.143:6837/3738799013","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6836","nonce":3738799013},{"type":"v1","addr":"172.21.15.143:6837","nonce":3738799013}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24529":{"gid":24529,"name":"i","rank":3,"incarnation":22,"state":"up:active","state_seq":7,"addr":"172.21.15.143:6839/1150747117","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6838","nonce":1150747117},{"type":"v1","addr":"172.21.15.143:6839","nonce":1150747117}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24533":{"gid":24533,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":7,"addr":"172.21.15.122:6837/65111779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6836","nonce":65111779},{"type":"v1","addr":"172.21.15.122:6837","nonce":65111779}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24556":{"gid":24556,"name":"a","rank":1,"incarnation":18,"state":"up:active","state_seq":4,"addr":"172.21.15.27:6841/3673158651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6840","nonce":3673158651},{"type":"v1","addr":"172.21.15.27:6841","nonce":3673158651}]},"join_fscid":-1,"export_targets":[0,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24584":{"gid":24584,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.122:6839/1102491877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6838","nonce":1102491877},{"type":"v1","addr":"172.21.15.122:6839","nonce":1102491877}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:07:05.133 INFO:teuthology.orchestra.run.smithi027.stderr:dumped fsmap epoch 37 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdcb00a1090 msgr2=0x7fdcb00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdcb00a1090 0x7fdcb00a3550 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdcc81995c0 tx=0x7fdcb4005f90 comp rx=0 tx=0).stop 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc8100820 msgr2=0x7fdcc81980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc8100820 0x7fdcc81980b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00e9f0 tx=0x7fdcbc00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 shutdown_connections 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fdcb00a1090 0x7fdcb00a3550 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fdcc8105a80 0x7fdcc819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fdcc8103150 0x7fdcc81985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 --2- 172.21.15.27:0/2701357140 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fdcc8100820 0x7fdcc81980b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 >> 172.21.15.27:0/2701357140 conn(0x7fdcc80fa420 msgr2=0x7fdcc8101260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:05.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 shutdown_connections 2024-09-13T18:07:05.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.133+0000 7fdccfa00640 1 -- 172.21.15.27:0/2701357140 wait complete. 2024-09-13T18:07:05.151 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:07:05.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.309+0000 7f113ec00640 1 -- 172.21.15.27:0/1170772675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1138101fb0 msgr2=0x7f11381023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.309+0000 7f113ec00640 1 --2- 172.21.15.27:0/1170772675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1138101fb0 0x7f11381023b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1128009900 tx=0x7f112802a3f0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.315 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.309+0000 7f113ec00640 1 -- 172.21.15.27:0/1170772675 shutdown_connections 2024-09-13T18:07:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.309+0000 7f113ec00640 1 --2- 172.21.15.27:0/1170772675 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1138103b60 0x7f113810a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.309+0000 7f113ec00640 1 --2- 172.21.15.27:0/1170772675 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11381031a0 0x7f1138103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.309+0000 7f113ec00640 1 --2- 172.21.15.27:0/1170772675 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1138101fb0 0x7f11381023b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.309+0000 7f113ec00640 1 -- 172.21.15.27:0/1170772675 >> 172.21.15.27:0/1170772675 conn(0x7f11380fd730 msgr2=0x7f11380ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.309+0000 7f113ec00640 1 -- 172.21.15.27:0/1170772675 shutdown_connections 2024-09-13T18:07:05.316 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.309+0000 7f113ec00640 1 -- 172.21.15.27:0/1170772675 wait complete. 2024-09-13T18:07:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.310+0000 7f113ec00640 1 Processor -- start 2024-09-13T18:07:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.310+0000 7f113ec00640 1 -- start start 2024-09-13T18:07:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.310+0000 7f113ec00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1138101fb0 0x7f11381980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.310+0000 7f113ec00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11381031a0 0x7f11381985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.310+0000 7f113ec00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1138103b60 0x7f113819f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:05.317 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.310+0000 7f113ec00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113819fba0 con 0x7f1138103b60 2024-09-13T18:07:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.310+0000 7f113ec00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113819fd10 con 0x7f1138101fb0 2024-09-13T18:07:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.310+0000 7f113ec00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113819fed0 con 0x7f11381031a0 2024-09-13T18:07:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f113cc00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1138103b60 0x7f113819f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f113cc00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1138103b60 0x7f113819f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48608/0 (socket says 172.21.15.27:48608) 2024-09-13T18:07:05.318 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f113cc00640 1 -- 172.21.15.27:0/2241328592 learned_addr learned my addr 172.21.15.27:0/2241328592 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f112f400640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11381031a0 0x7f11381985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f1137e00640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1138101fb0 0x7f11381980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f112f400640 1 -- 172.21.15.27:0/2241328592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1138101fb0 msgr2=0x7f11381980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f112f400640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1138101fb0 0x7f11381980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f112f400640 1 -- 172.21.15.27:0/2241328592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1138103b60 msgr2=0x7f113819f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.319 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f112f400640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1138103b60 0x7f113819f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f112f400640 1 -- 172.21.15.27:0/2241328592 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128009560 con 0x7f11381031a0 2024-09-13T18:07:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.311+0000 7f112f400640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11381031a0 0x7f11381985f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f112000e9f0 tx=0x7f112000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.312+0000 7f1135600640 1 -- 172.21.15.27:0/2241328592 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112000ccc0 con 0x7f11381031a0 2024-09-13T18:07:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.312+0000 7f1135600640 1 -- 172.21.15.27:0/2241328592 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f112000ce20 con 0x7f11381031a0 2024-09-13T18:07:05.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.312+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11381a01b0 con 0x7f11381031a0 2024-09-13T18:07:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.312+0000 7f1135600640 1 -- 172.21.15.27:0/2241328592 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120004a00 con 0x7f11381031a0 2024-09-13T18:07:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.312+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11381a06c0 con 0x7f11381031a0 2024-09-13T18:07:05.321 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.313+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11381093c0 con 0x7f11381031a0 2024-09-13T18:07:05.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.315+0000 7f1135600640 1 -- 172.21.15.27:0/2241328592 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1120004b60 con 0x7f11381031a0 2024-09-13T18:07:05.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.316+0000 7f1135600640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f111c0a1110 0x7f111c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:05.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.316+0000 7f1135600640 1 -- 172.21.15.27:0/2241328592 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1120014070 con 0x7f11381031a0 2024-09-13T18:07:05.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.316+0000 7f1137e00640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f111c0a1110 0x7f111c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:05.323 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.317+0000 7f1137e00640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f111c0a1110 0x7f111c0a35d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1128009230 tx=0x7f1128005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:05.324 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.320+0000 7f1135600640 1 -- 172.21.15.27:0/2241328592 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f1120095f90 con 0x7f11381031a0 2024-09-13T18:07:05.506 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.504+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f113810da00 con 0x7f11381031a0 2024-09-13T18:07:05.507 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.505+0000 7f1135600640 1 -- 172.21.15.27:0/2241328592 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22527 (secure 0 0 0) 0x7f11200995b0 con 0x7f11381031a0 2024-09-13T18:07:05.508 INFO:teuthology.orchestra.run.smithi027.stdout: 2024-09-13T18:07:05.508 INFO:teuthology.orchestra.run.smithi027.stdout:{"epoch":88,"fsid":"f5527e2e-71f8-11ef-bceb-c7b262605968","created":"2024-09-13T17:53:40.282980+0000","modified":"2024-09-13T18:02:37.160677+0000","last_up_change":"2024-09-13T18:00:56.102330+0000","last_in_change":"2024-09-13T18:00:36.968526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T17:57:10.088488+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:01:44.492835+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:01:45.883650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"54ed9933-44c6-4fe4-b442-fc797b98c8bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6802","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6803","nonce":3184758537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6804","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6805","nonce":3184758537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6808","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6809","nonce":3184758537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6806","nonce":3184758537},{"type":"v1","addr":"172.21.15.27:6807","nonce":3184758537}]},"public_addr":"172.21.15.27:6803/3184758537","cluster_addr":"172.21.15.27:6805/3184758537","heartbeat_back_addr":"172.21.15.27:6809/3184758537","heartbeat_front_addr":"172.21.15.27:6807/3184758537","state":["exists","up"]},{"osd":1,"uuid":"66669cca-0b9c-4b87-b8b3-3581b2959c02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6800","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6801","nonce":4170403737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6802","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6803","nonce":4170403737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6806","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6807","nonce":4170403737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6804","nonce":4170403737},{"type":"v1","addr":"172.21.15.122:6805","nonce":4170403737}]},"public_addr":"172.21.15.122:6801/4170403737","cluster_addr":"172.21.15.122:6803/4170403737","heartbeat_back_addr":"172.21.15.122:6807/4170403737","heartbeat_front_addr":"172.21.15.122:6805/4170403737","state":["exists","up"]},{"osd":2,"uuid":"2db6f706-d974-4498-b969-2d2382873bf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6800","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6801","nonce":134202082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6802","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6803","nonce":134202082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6806","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6807","nonce":134202082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6804","nonce":134202082},{"type":"v1","addr":"172.21.15.143:6805","nonce":134202082}]},"public_addr":"172.21.15.143:6801/134202082","cluster_addr":"172.21.15.143:6803/134202082","heartbeat_back_addr":"172.21.15.143:6807/134202082","heartbeat_front_addr":"172.21.15.143:6805/134202082","state":["exists","up"]},{"osd":3,"uuid":"14528e45-0ca2-401e-9cf7-8cafd2beb354","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6810","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6811","nonce":3127939559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6812","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6813","nonce":3127939559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6816","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6817","nonce":3127939559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6814","nonce":3127939559},{"type":"v1","addr":"172.21.15.27:6815","nonce":3127939559}]},"public_addr":"172.21.15.27:6811/3127939559","cluster_addr":"172.21.15.27:6813/3127939559","heartbeat_back_addr":"172.21.15.27:6817/3127939559","heartbeat_front_addr":"172.21.15.27:6815/3127939559","state":["exists","up"]},{"osd":4,"uuid":"ea7f87fd-4b4c-4c02-ae70-ce1bfdd22c28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6808","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6809","nonce":854453885}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6810","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6811","nonce":854453885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6814","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6815","nonce":854453885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6812","nonce":854453885},{"type":"v1","addr":"172.21.15.122:6813","nonce":854453885}]},"public_addr":"172.21.15.122:6809/854453885","cluster_addr":"172.21.15.122:6811/854453885","heartbeat_back_addr":"172.21.15.122:6815/854453885","heartbeat_front_addr":"172.21.15.122:6813/854453885","state":["exists","up"]},{"osd":5,"uuid":"5676151a-5792-4ec2-b503-b9ca28b51dd6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6808","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6809","nonce":3812784407}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6810","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6811","nonce":3812784407}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6814","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6815","nonce":3812784407}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6812","nonce":3812784407},{"type":"v1","addr":"172.21.15.143:6813","nonce":3812784407}]},"public_addr":"172.21.15.143:6809/3812784407","cluster_addr":"172.21.15.143:6811/3812784407","heartbeat_back_addr":"172.21.15.143:6815/3812784407","heartbeat_front_addr":"172.21.15.143:6813/3812784407","state":["exists","up"]},{"osd":6,"uuid":"34db282b-ab45-44ce-9bc1-de0de6c820e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6818","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6819","nonce":1338968311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6820","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6821","nonce":1338968311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6824","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6825","nonce":1338968311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6822","nonce":1338968311},{"type":"v1","addr":"172.21.15.27:6823","nonce":1338968311}]},"public_addr":"172.21.15.27:6819/1338968311","cluster_addr":"172.21.15.27:6821/1338968311","heartbeat_back_addr":"172.21.15.27:6825/1338968311","heartbeat_front_addr":"172.21.15.27:6823/1338968311","state":["exists","up"]},{"osd":7,"uuid":"0b75e0da-1e0f-425c-abd6-36f99a066e11","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6816","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6817","nonce":4046950984}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6818","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6819","nonce":4046950984}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6822","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6823","nonce":4046950984}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6820","nonce":4046950984},{"type":"v1","addr":"172.21.15.122:6821","nonce":4046950984}]},"public_addr":"172.21.15.122:6817/4046950984","cluster_addr":"172.21.15.122:6819/4046950984","heartbeat_back_addr":"172.21.15.122:6823/4046950984","heartbeat_front_addr":"172.21.15.122:6821/4046950984","state":["exists","up"]},{"osd":8,"uuid":"ba26500a-70ee-4016-bbbe-6b625a329bd7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6816","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6817","nonce":2661911433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6818","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6819","nonce":2661911433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6822","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6823","nonce":2661911433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6820","nonce":2661911433},{"type":"v1","addr":"172.21.15.143:6821","nonce":2661911433}]},"public_addr":"172.21.15.143:6817/2661911433","cluster_addr":"172.21.15.143:6819/2661911433","heartbeat_back_addr":"172.21.15.143:6823/2661911433","heartbeat_front_addr":"172.21.15.143:6821/2661911433","state":["exists","up"]},{"osd":9,"uuid":"6044d334-8e68-415d-b23b-ca534e3fdd5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6826","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6827","nonce":154819265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6828","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6829","nonce":154819265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6832","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6833","nonce":154819265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.27:6830","nonce":154819265},{"type":"v1","addr":"172.21.15.27:6831","nonce":154819265}]},"public_addr":"172.21.15.27:6827/154819265","cluster_addr":"172.21.15.27:6829/154819265","heartbeat_back_addr":"172.21.15.27:6833/154819265","heartbeat_front_addr":"172.21.15.27:6831/154819265","state":["exists","up"]},{"osd":10,"uuid":"cd55cd55-918b-4927-ab29-1f0e04d05c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":73,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6824","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6825","nonce":465237167}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6826","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6827","nonce":465237167}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6830","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6831","nonce":465237167}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.122:6828","nonce":465237167},{"type":"v1","addr":"172.21.15.122:6829","nonce":465237167}]},"public_addr":"172.21.15.122:6825/465237167","cluster_addr":"172.21.15.122:6827/465237167","heartbeat_back_addr":"172.21.15.122:6831/465237167","heartbeat_front_addr":"172.21.15.122:6829/465237167","state":["exists","up"]},{"osd":11,"uuid":"5f6c673e-6209-4e56-b97d-50419c0e0500","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":81,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6824","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6825","nonce":378792736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6826","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6827","nonce":378792736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6830","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6831","nonce":378792736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.143:6828","nonce":378792736},{"type":"v1","addr":"172.21.15.143:6829","nonce":378792736}]},"public_addr":"172.21.15.143:6825/378792736","cluster_addr":"172.21.15.143:6827/378792736","heartbeat_back_addr":"172.21.15.143:6831/378792736","heartbeat_front_addr":"172.21.15.143:6829/378792736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:21.582340+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:56:44.942406+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:06.885735+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:35.794251+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:57:59.438834+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:21.789395+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:58:50.251916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:14.397590+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T17:59:37.193274+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:06.176446+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:30.711785+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:00:54.234266+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"2.c","mappings":[{"from":2,"to":4}]},{"pgid":"2.1f","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.27:0/1188602618":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/3579424943":"2024-09-14T17:54:35.275484+0000","172.21.15.27:0/246522964":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6800/1083878216":"2024-09-14T17:54:35.275484+0000","172.21.15.27:6801/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:6800/2456729013":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2249948778":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/852564053":"2024-09-14T17:54:06.682080+0000","172.21.15.27:0/2742710546":"2024-09-14T17:54:06.682080+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:07:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f111c0a1110 msgr2=0x7f111c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f111c0a1110 0x7f111c0a35d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1128009230 tx=0x7f1128005a20 comp rx=0 tx=0).stop 2024-09-13T18:07:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11381031a0 msgr2=0x7f11381985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11381031a0 0x7f11381985f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f112000e9f0 tx=0x7f112000eeb0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 shutdown_connections 2024-09-13T18:07:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f111c0a1110 0x7f111c0a35d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f1138103b60 0x7f113819f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f11381031a0 0x7f11381985f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.510 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 --2- 172.21.15.27:0/2241328592 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f1138101fb0 0x7f11381980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 >> 172.21.15.27:0/2241328592 conn(0x7f11380fd730 msgr2=0x7f1138106590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:05.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 shutdown_connections 2024-09-13T18:07:05.511 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.508+0000 7f113ec00640 1 -- 172.21.15.27:0/2241328592 wait complete. 2024-09-13T18:07:05.524 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:05 smithi027 ceph-mon[30611]: pgmap v452: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:07:05.524 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:05 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/1839758431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:07:05.524 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:05 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2701357140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:07:05.528 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:07:05.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.687+0000 7f3ed0400640 1 -- 172.21.15.27:0/4126772588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8100f60 msgr2=0x7f3ec81013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.693 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.687+0000 7f3ed0400640 1 --2- 172.21.15.27:0/4126772588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8100f60 0x7f3ec81013e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009900 tx=0x7f3eb402a3f0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.687+0000 7f3ed0400640 1 -- 172.21.15.27:0/4126772588 shutdown_connections 2024-09-13T18:07:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.687+0000 7f3ed0400640 1 --2- 172.21.15.27:0/4126772588 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec8101920 0x7f3ec81081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.687+0000 7f3ed0400640 1 --2- 172.21.15.27:0/4126772588 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8100f60 0x7f3ec81013e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.687+0000 7f3ed0400640 1 --2- 172.21.15.27:0/4126772588 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.694 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.687+0000 7f3ed0400640 1 -- 172.21.15.27:0/4126772588 >> 172.21.15.27:0/4126772588 conn(0x7f3ec80fb4d0 msgr2=0x7f3ec80fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.687+0000 7f3ed0400640 1 -- 172.21.15.27:0/4126772588 shutdown_connections 2024-09-13T18:07:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.687+0000 7f3ed0400640 1 -- 172.21.15.27:0/4126772588 wait complete. 2024-09-13T18:07:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.688+0000 7f3ed0400640 1 Processor -- start 2024-09-13T18:07:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.688+0000 7f3ed0400640 1 -- start start 2024-09-13T18:07:05.695 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.688+0000 7f3ed0400640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.688+0000 7f3ed0400640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec8100f60 0x7f3ec81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.688+0000 7f3ed0400640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8101920 0x7f3ec819d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.688+0000 7f3ed0400640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec819d950 con 0x7f3ec8100f60 2024-09-13T18:07:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.688+0000 7f3ed0400640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec819dac0 con 0x7f3ec80ffd70 2024-09-13T18:07:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.688+0000 7f3ed0400640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec819dc80 con 0x7f3ec8101920 2024-09-13T18:07:05.696 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ecd000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec8100f60 0x7f3ec81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ecd000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec8100f60 0x7f3ec81963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48620/0 (socket says 172.21.15.27:48620) 2024-09-13T18:07:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ecd000640 1 -- 172.21.15.27:0/2011179715 learned_addr learned my addr 172.21.15.27:0/2011179715 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ece400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8101920 0x7f3ec819d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ecda00640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:05.697 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ece400640 1 -- 172.21.15.27:0/2011179715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec80ffd70 msgr2=0x7f3ec8195e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ece400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8195e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ece400640 1 -- 172.21.15.27:0/2011179715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec8100f60 msgr2=0x7f3ec81963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ece400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec8100f60 0x7f3ec81963a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ece400640 1 -- 172.21.15.27:0/2011179715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb4009560 con 0x7f3ec8101920 2024-09-13T18:07:05.698 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.689+0000 7f3ecda00640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:05.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.690+0000 7f3ece400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8101920 0x7f3ec819d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009fd0 tx=0x7f3ec000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:05.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.690+0000 7f3ec6000640 1 -- 172.21.15.27:0/2011179715 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000ce20 con 0x7f3ec8101920 2024-09-13T18:07:05.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.690+0000 7f3ec6000640 1 -- 172.21.15.27:0/2011179715 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3ec0005020 con 0x7f3ec8101920 2024-09-13T18:07:05.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.690+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec819df60 con 0x7f3ec8101920 2024-09-13T18:07:05.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.690+0000 7f3ec6000640 1 -- 172.21.15.27:0/2011179715 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0010690 con 0x7f3ec8101920 2024-09-13T18:07:05.699 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.690+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec819e390 con 0x7f3ec8101920 2024-09-13T18:07:05.700 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.691+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec81071b0 con 0x7f3ec8101920 2024-09-13T18:07:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.693+0000 7f3ec6000640 1 -- 172.21.15.27:0/2011179715 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3ec0005500 con 0x7f3ec8101920 2024-09-13T18:07:05.701 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.694+0000 7f3ec6000640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1090 0x7f3eb00a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.694+0000 7f3ec6000640 1 -- 172.21.15.27:0/2011179715 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3ec0014070 con 0x7f3ec8101920 2024-09-13T18:07:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.694+0000 7f3ecda00640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1090 0x7f3eb00a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.695+0000 7f3ecda00640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1090 0x7f3eb00a3550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8100dc0 tx=0x7f3ebc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:05.702 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.697+0000 7f3ec6000640 1 -- 172.21.15.27:0/2011179715 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3ec00967d0 con 0x7f3ec8101920 2024-09-13T18:07:05.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-mon[35310]: pgmap v452: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:07:05.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/1839758431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:07:05.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2701357140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:07:05.775 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-mon[38210]: pgmap v452: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-09-13T18:07:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/1839758431' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:07:05.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2701357140' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T18:07:05.919 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.917+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3ec810b800 con 0x7f3ec8101920 2024-09-13T18:07:05.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.933+0000 7f3ec6000640 1 -- 172.21.15.27:0/2011179715 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3ec0005190 con 0x7f3ec8101920 2024-09-13T18:07:05.936 INFO:teuthology.orchestra.run.smithi027.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1090 msgr2=0x7f3eb00a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1090 0x7f3eb00a3550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8100dc0 tx=0x7f3ebc005f90 comp rx=0 tx=0).stop 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8101920 msgr2=0x7f3ec819d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8101920 0x7f3ec819d410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009fd0 tx=0x7f3ec000ef10 comp rx=0 tx=0).stop 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 shutdown_connections 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1090 0x7f3eb00a3550 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8101920 0x7f3ec819d410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec8100f60 0x7f3ec81963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 --2- 172.21.15.27:0/2011179715 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8195e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:05.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 >> 172.21.15.27:0/2011179715 conn(0x7f3ec80fb4d0 msgr2=0x7f3ec8104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:05.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 shutdown_connections 2024-09-13T18:07:05.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:05.936+0000 7f3ed0400640 1 -- 172.21.15.27:0/2011179715 wait complete. 2024-09-13T18:07:05.957 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:07:06.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.134+0000 7f3ecfa00640 1 -- 172.21.15.27:0/3288819769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8101920 msgr2=0x7f3ec81081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.134+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/3288819769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8101920 0x7f3ec81081b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009ca0 tx=0x7f3ec002a8c0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.134+0000 7f3ecfa00640 1 -- 172.21.15.27:0/3288819769 shutdown_connections 2024-09-13T18:07:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.134+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/3288819769 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8101920 0x7f3ec81081b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.134+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/3288819769 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec8100f60 0x7f3ec81013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.134+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/3288819769 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.134+0000 7f3ecfa00640 1 -- 172.21.15.27:0/3288819769 >> 172.21.15.27:0/3288819769 conn(0x7f3ec80fb4d0 msgr2=0x7f3ec80fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.134+0000 7f3ecfa00640 1 -- 172.21.15.27:0/3288819769 shutdown_connections 2024-09-13T18:07:06.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.134+0000 7f3ecfa00640 1 -- 172.21.15.27:0/3288819769 wait complete. 2024-09-13T18:07:06.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.135+0000 7f3ecfa00640 1 Processor -- start 2024-09-13T18:07:06.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecfa00640 1 -- start start 2024-09-13T18:07:06.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecfa00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:06.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecfa00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8100f60 0x7f3ec8198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecfa00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec8101920 0x7f3ec819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecfa00640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec819fad0 con 0x7f3ec80ffd70 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecfa00640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec819fc40 con 0x7f3ec8101920 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecfa00640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec819fe00 con 0x7f3ec8100f60 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecd000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecd000640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48642/0 (socket says 172.21.15.27:48642) 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ec7e00640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8100f60 0x7f3ec8198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecda00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec8101920 0x7f3ec819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.136+0000 7f3ecd000640 1 -- 172.21.15.27:0/4144265034 learned_addr learned my addr 172.21.15.27:0/4144265034 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ec7e00640 1 -- 172.21.15.27:0/4144265034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec8101920 msgr2=0x7f3ec819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ec7e00640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec8101920 0x7f3ec819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ec7e00640 1 -- 172.21.15.27:0/4144265034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec80ffd70 msgr2=0x7f3ec8197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ec7e00640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ec7e00640 1 -- 172.21.15.27:0/4144265034 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc009490 con 0x7f3ec8100f60 2024-09-13T18:07:06.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ec7e00640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8100f60 0x7f3ec8198520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400e9f0 tx=0x7f3eb400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:06.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ec5600640 1 -- 172.21.15.27:0/4144265034 <== mon.1 v2:172.21.15.143:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb400ccc0 con 0x7f3ec8100f60 2024-09-13T18:07:06.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ec5600640 1 -- 172.21.15.27:0/4144265034 <== mon.1 v2:172.21.15.143:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3eb400ce20 con 0x7f3ec8100f60 2024-09-13T18:07:06.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ec5600640 1 -- 172.21.15.27:0/4144265034 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb4004a00 con 0x7f3ec8100f60 2024-09-13T18:07:06.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec0009900 con 0x7f3ec8100f60 2024-09-13T18:07:06.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.137+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec81a0410 con 0x7f3ec8100f60 2024-09-13T18:07:06.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.138+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec810b7b0 con 0x7f3ec8100f60 2024-09-13T18:07:06.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.140+0000 7f3ec5600640 1 -- 172.21.15.27:0/4144265034 <== mon.1 v2:172.21.15.143:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3eb4004b60 con 0x7f3ec8100f60 2024-09-13T18:07:06.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.142+0000 7f3ec5600640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1110 0x7f3eb00a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:06.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.142+0000 7f3ec5600640 1 -- 172.21.15.27:0/4144265034 <== mon.1 v2:172.21.15.143:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8641+0+0 (secure 0 0 0) 0x7f3eb4014070 con 0x7f3ec8100f60 2024-09-13T18:07:06.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.142+0000 7f3ecd000640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1110 0x7f3eb00a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:06.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.143+0000 7f3ecd000640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1110 0x7f3eb00a35d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0058c0 tx=0x7f3ebc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:06.145 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.143+0000 7f3ec5600640 1 -- 172.21.15.27:0/4144265034 <== mon.1 v2:172.21.15.143:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7f3eb4096660 con 0x7f3ec8100f60 2024-09-13T18:07:06.276 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f[68433]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.276 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f[68433]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.276 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-mds[68437]: -- 172.21.15.143:0/3478900160 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563337becd00 con 0x563337bc1400 2024-09-13T18:07:06.276 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f[68433]: starting mds.f at 2024-09-13T18:07:06.276 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c[68734]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.276 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c[68734]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.276 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-mds[68738]: -- 172.21.15.143:0/718369526 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fc4cafed00 con 0x55fc4cad3000 2024-09-13T18:07:06.276 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c[68734]: starting mds.c at 2024-09-13T18:07:06.277 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l[68119]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.277 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l[68119]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.277 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-mds[68123]: -- 172.21.15.143:0/2936045373 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55979399cd00 con 0x559793971400 2024-09-13T18:07:06.277 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l[68119]: starting mds.l at 2024-09-13T18:07:06.277 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i[69035]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.277 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i[69035]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.277 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-mds[69039]: -- 172.21.15.143:0/2759504131 <== mon.1 v2:172.21.15.143:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f1e76902c0 con 0x55f1e765e800 2024-09-13T18:07:06.277 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-mds[69039]: -- 172.21.15.143:0/2759504131 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f1e768ad00 con 0x55f1e765e800 2024-09-13T18:07:06.278 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:07:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i[69035]: starting mds.i at 2024-09-13T18:07:06.307 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a[30606]: 2024-09-13T18:07:05.919+0000 7f7f1e200640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:07:06.307 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g[70779]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.307 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g[70779]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.307 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mds[70785]: -- 172.21.15.27:0/3718407227 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558caf2f6d00 con 0x558caf2cb400 2024-09-13T18:07:06.308 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g[70779]: starting mds.g at 2024-09-13T18:07:06.308 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-a[71160]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.308 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-a[71160]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.308 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mds[71166]: -- 172.21.15.27:0/2841202343 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5569eaeead00 con 0x5569eaebe800 2024-09-13T18:07:06.308 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-a[71160]: starting mds.a at 2024-09-13T18:07:06.347 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b[65606]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.348 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b[65606]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.348 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-mds[65610]: -- 172.21.15.122:0/3591561651 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559b00afed00 con 0x559b00ad3400 2024-09-13T18:07:06.348 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b[65606]: starting mds.b at 2024-09-13T18:07:06.348 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h[65299]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.348 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h[65299]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.348 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-mds[65303]: -- 172.21.15.122:0/693761430 <== mon.1 v2:172.21.15.143:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5589e4a48d00 con 0x5589e4a1c800 2024-09-13T18:07:06.348 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h[65299]: starting mds.h at 2024-09-13T18:07:06.349 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k[64683]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.349 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k[64683]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.349 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-mds[64687]: -- 172.21.15.122:0/2773596207 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5557c68b2d00 con 0x5557c6886800 2024-09-13T18:07:06.349 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k[64683]: starting mds.k at 2024-09-13T18:07:06.349 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e[64997]: ignoring --setuser ceph since I am not root 2024-09-13T18:07:06.349 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e[64997]: ignoring --setgroup ceph since I am not root 2024-09-13T18:07:06.349 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-mds[65001]: -- 172.21.15.122:0/2000388011 <== mon.2 v2:172.21.15.122:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f0c5830d00 con 0x55f0c5805400 2024-09-13T18:07:06.349 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:07:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e[64997]: starting mds.e at 2024-09-13T18:07:06.372 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.370+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3ec81a0870 con 0x7f3ec8100f60 2024-09-13T18:07:06.678 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2241328592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:07:06.678 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2011179715' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T18:07:06.678 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T18:07:06.678 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mon[30611]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:07:06.678 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mon[30611]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:07:06.678 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mon[30611]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T18:07:06.679 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T18:07:06.679 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:06 smithi027 ceph-mon[30611]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-13T18:07:06.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:06 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2241328592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:07:06.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:06 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2011179715' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T18:07:06.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:06 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T18:07:06.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:06 smithi122 ceph-mon[35310]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:07:06.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:06 smithi122 ceph-mon[35310]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:07:06.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:06 smithi122 ceph-mon[35310]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T18:07:06.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:06 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T18:07:06.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:06 smithi122 ceph-mon[35310]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-13T18:07:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:06 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2241328592' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T18:07:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:06 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2011179715' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T18:07:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:06 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-13T18:07:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:06 smithi143 ceph-mon[38210]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T18:07:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:06 smithi143 ceph-mon[38210]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:07:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:06 smithi143 ceph-mon[38210]: osdmap e89: 12 total, 12 up, 12 in 2024-09-13T18:07:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:06 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-13T18:07:06.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:06 smithi143 ceph-mon[38210]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-13T18:07:06.936 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.934+0000 7f3ec5600640 1 -- 172.21.15.27:0/4144265034 <== mon.1 v2:172.21.15.143:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3eb4099c80 con 0x7f3ec8100f60 2024-09-13T18:07:06.939 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.937+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1110 msgr2=0x7f3eb00a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:06.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.937+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1110 0x7f3eb00a35d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0058c0 tx=0x7f3ebc005f90 comp rx=0 tx=0).stop 2024-09-13T18:07:06.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8100f60 msgr2=0x7f3ec8198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:06.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8100f60 0x7f3ec8198520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3eb400e9f0 tx=0x7f3eb400eeb0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.940 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 shutdown_connections 2024-09-13T18:07:06.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7f3eb00a1110 0x7f3eb00a35d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7f3ec8101920 0x7f3ec819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7f3ec8100f60 0x7f3ec8198520 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 --2- 172.21.15.27:0/4144265034 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7f3ec80ffd70 0x7f3ec8197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:06.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 >> 172.21.15.27:0/4144265034 conn(0x7f3ec80fb4d0 msgr2=0x7f3ec80726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:06.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 shutdown_connections 2024-09-13T18:07:06.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:06.938+0000 7f3ecfa00640 1 -- 172.21.15.27:0/4144265034 wait complete. 2024-09-13T18:07:06.965 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:07:07.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.133+0000 7fca3b600640 1 -- 172.21.15.27:0/3332930754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca34103190 msgr2=0x7fca34103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:07.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.133+0000 7fca3b600640 1 --2- 172.21.15.27:0/3332930754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca34103190 0x7fca34103610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fca20009900 tx=0x7fca2002a3f0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.133+0000 7fca3b600640 1 -- 172.21.15.27:0/3332930754 shutdown_connections 2024-09-13T18:07:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.133+0000 7fca3b600640 1 --2- 172.21.15.27:0/3332930754 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca34103b50 0x7fca3410a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.133+0000 7fca3b600640 1 --2- 172.21.15.27:0/3332930754 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca34103190 0x7fca34103610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.133+0000 7fca3b600640 1 --2- 172.21.15.27:0/3332930754 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca34101fa0 0x7fca341023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.133+0000 7fca3b600640 1 -- 172.21.15.27:0/3332930754 >> 172.21.15.27:0/3332930754 conn(0x7fca340fd700 msgr2=0x7fca340ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.133+0000 7fca3b600640 1 -- 172.21.15.27:0/3332930754 shutdown_connections 2024-09-13T18:07:07.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.133+0000 7fca3b600640 1 -- 172.21.15.27:0/3332930754 wait complete. 2024-09-13T18:07:07.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.134+0000 7fca3b600640 1 Processor -- start 2024-09-13T18:07:07.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.134+0000 7fca3b600640 1 -- start start 2024-09-13T18:07:07.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.134+0000 7fca3b600640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca34101fa0 0x7fca341980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:07.138 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.134+0000 7fca3b600640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca34103190 0x7fca341985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.134+0000 7fca3b600640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca34103b50 0x7fca3419f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.134+0000 7fca3b600640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3419fba0 con 0x7fca34101fa0 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.134+0000 7fca3b600640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3419fd10 con 0x7fca34103190 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.134+0000 7fca3b600640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3419fed0 con 0x7fca34103b50 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca38c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca34101fa0 0x7fca341980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca38c00640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca34101fa0 0x7fca341980b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48656/0 (socket says 172.21.15.27:48656) 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca38c00640 1 -- 172.21.15.27:0/2496752887 learned_addr learned my addr 172.21.15.27:0/2496752887 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca33e00640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca34103190 0x7fca341985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca39600640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca34103b50 0x7fca3419f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca38c00640 1 -- 172.21.15.27:0/2496752887 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca34103b50 msgr2=0x7fca3419f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca38c00640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca34103b50 0x7fca3419f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca38c00640 1 -- 172.21.15.27:0/2496752887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca34103190 msgr2=0x7fca341985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca38c00640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca34103190 0x7fca341985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca38c00640 1 -- 172.21.15.27:0/2496752887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009560 con 0x7fca34101fa0 2024-09-13T18:07:07.139 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.135+0000 7fca38c00640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca34101fa0 0x7fca341980b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fca2800e9c0 tx=0x7fca2800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.136+0000 7fca31600640 1 -- 172.21.15.27:0/2496752887 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28009700 con 0x7fca34101fa0 2024-09-13T18:07:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.136+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca341a01b0 con 0x7fca34101fa0 2024-09-13T18:07:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.136+0000 7fca31600640 1 -- 172.21.15.27:0/2496752887 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fca2800cd80 con 0x7fca34101fa0 2024-09-13T18:07:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.136+0000 7fca31600640 1 -- 172.21.15.27:0/2496752887 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28010430 con 0x7fca34101fa0 2024-09-13T18:07:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.136+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca341a0690 con 0x7fca34101fa0 2024-09-13T18:07:07.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.137+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca34109430 con 0x7fca34101fa0 2024-09-13T18:07:07.141 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.139+0000 7fca31600640 1 -- 172.21.15.27:0/2496752887 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fca28003680 con 0x7fca34101fa0 2024-09-13T18:07:07.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.140+0000 7fca31600640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fca1c0a1090 0x7fca1c0a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:07.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.140+0000 7fca31600640 1 -- 172.21.15.27:0/2496752887 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8641+0+0 (secure 0 0 0) 0x7fca28014070 con 0x7fca34101fa0 2024-09-13T18:07:07.142 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.140+0000 7fca33e00640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fca1c0a1090 0x7fca1c0a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:07.143 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.141+0000 7fca33e00640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fca1c0a1090 0x7fca1c0a3550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fca20005ab0 tx=0x7fca20005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:07.144 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.142+0000 7fca31600640 1 -- 172.21.15.27:0/2496752887 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fca280965b0 con 0x7fca34101fa0 2024-09-13T18:07:07.326 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.324+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca3410d9f0 con 0x7fca34101fa0 2024-09-13T18:07:07.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: pgmap v453: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:07:07.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/4144265034' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:07:07.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:07:07.714 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: Cluster is now healthy 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6832/2654955660,v1:172.21.15.143:6833/2654955660] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6832/2695259761,v1:172.21.15.122:6833/2695259761] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6834/3049247714,v1:172.21.15.122:6835/3049247714] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6834/1436023059,v1:172.21.15.143:6835/1436023059] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6836/3293576061,v1:172.21.15.143:6837/3293576061] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.143:6838/2942689736,v1:172.21.15.143:6839/2942689736] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6836/661435838,v1:172.21.15.122:6838/661435838] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.122:6837/729972260,v1:172.21.15.122:6839/729972260] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.27:6838/1642465241,v1:172.21.15.27:6839/1642465241] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: mds.? [v2:172.21.15.27:6840/532028531,v1:172.21.15.27:6841/532028531] up:boot 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:07:07.715 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: fsmap 12 up:standby 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:07:07.716 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:07 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2496752887' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:07:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: pgmap v453: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:07:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/4144265034' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:07:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:07:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:07:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:07:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: Cluster is now healthy 2024-09-13T18:07:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6832/2654955660,v1:172.21.15.143:6833/2654955660] up:boot 2024-09-13T18:07:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6832/2695259761,v1:172.21.15.122:6833/2695259761] up:boot 2024-09-13T18:07:07.776 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6834/3049247714,v1:172.21.15.122:6835/3049247714] up:boot 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6834/1436023059,v1:172.21.15.143:6835/1436023059] up:boot 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6836/3293576061,v1:172.21.15.143:6837/3293576061] up:boot 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.143:6838/2942689736,v1:172.21.15.143:6839/2942689736] up:boot 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6836/661435838,v1:172.21.15.122:6838/661435838] up:boot 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.122:6837/729972260,v1:172.21.15.122:6839/729972260] up:boot 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.27:6838/1642465241,v1:172.21.15.27:6839/1642465241] up:boot 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: mds.? [v2:172.21.15.27:6840/532028531,v1:172.21.15.27:6841/532028531] up:boot 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: fsmap 12 up:standby 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:07:07.777 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:07:07.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:07:07.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:07:07.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T18:07:07.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:07:07.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:07:07.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:07:07.778 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:07 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2496752887' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:07:07.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: pgmap v453: 97 pgs: 97 active+clean; 110 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-09-13T18:07:07.807 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/4144265034' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: Cluster is now healthy 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6832/2654955660,v1:172.21.15.143:6833/2654955660] up:boot 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6832/2695259761,v1:172.21.15.122:6833/2695259761] up:boot 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6834/3049247714,v1:172.21.15.122:6835/3049247714] up:boot 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6834/1436023059,v1:172.21.15.143:6835/1436023059] up:boot 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6836/3293576061,v1:172.21.15.143:6837/3293576061] up:boot 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.143:6838/2942689736,v1:172.21.15.143:6839/2942689736] up:boot 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6836/661435838,v1:172.21.15.122:6838/661435838] up:boot 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.122:6837/729972260,v1:172.21.15.122:6839/729972260] up:boot 2024-09-13T18:07:07.808 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.27:6838/1642465241,v1:172.21.15.27:6839/1642465241] up:boot 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: mds.? [v2:172.21.15.27:6840/532028531,v1:172.21.15.27:6841/532028531] up:boot 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: fsmap 12 up:standby 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='mgr.14150 172.21.15.27:0/4272384802' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-13T18:07:07.809 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:07 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2496752887' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:07:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.935+0000 7fca31600640 1 -- 172.21.15.27:0/2496752887 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 181+0+0 (secure 0 0 0) 0x7fca28099bd0 con 0x7fca34101fa0 2024-09-13T18:07:07.938 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:07:07.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fca1c0a1090 msgr2=0x7fca1c0a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:07.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fca1c0a1090 0x7fca1c0a3550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fca20005ab0 tx=0x7fca20005a20 comp rx=0 tx=0).stop 2024-09-13T18:07:07.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca34101fa0 msgr2=0x7fca341980b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:07.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca34101fa0 0x7fca341980b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fca2800e9c0 tx=0x7fca2800ee80 comp rx=0 tx=0).stop 2024-09-13T18:07:07.941 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 shutdown_connections 2024-09-13T18:07:07.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fca1c0a1090 0x7fca1c0a3550 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fca34103b50 0x7fca3419f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fca34103190 0x7fca341985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 --2- 172.21.15.27:0/2496752887 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fca34101fa0 0x7fca341980b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:07.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 >> 172.21.15.27:0/2496752887 conn(0x7fca340fd700 msgr2=0x7fca34106600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:07.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 shutdown_connections 2024-09-13T18:07:07.942 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:07.939+0000 7fca3b600640 1 -- 172.21.15.27:0/2496752887 wait complete. 2024-09-13T18:07:07.960 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:07:08.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.127+0000 7fe37c200640 1 -- 172.21.15.27:0/3708170520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3740760b0 msgr2=0x7fe374076510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:08.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.127+0000 7fe37c200640 1 --2- 172.21.15.27:0/3708170520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3740760b0 0x7fe374076510 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe360009900 tx=0x7fe36002a410 comp rx=0 tx=0).stop 2024-09-13T18:07:08.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.127+0000 7fe37c200640 1 -- 172.21.15.27:0/3708170520 shutdown_connections 2024-09-13T18:07:08.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.127+0000 7fe37c200640 1 --2- 172.21.15.27:0/3708170520 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe374076a50 0x7fe3740772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.127+0000 7fe37c200640 1 --2- 172.21.15.27:0/3708170520 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe3740760b0 0x7fe374076510 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.127+0000 7fe37c200640 1 --2- 172.21.15.27:0/3708170520 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe374074e70 0x7fe374075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.127+0000 7fe37c200640 1 -- 172.21.15.27:0/3708170520 >> 172.21.15.27:0/3708170520 conn(0x7fe3740fd700 msgr2=0x7fe3740ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:08.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.127+0000 7fe37c200640 1 -- 172.21.15.27:0/3708170520 shutdown_connections 2024-09-13T18:07:08.130 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.127+0000 7fe37c200640 1 -- 172.21.15.27:0/3708170520 wait complete. 2024-09-13T18:07:08.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.128+0000 7fe37c200640 1 Processor -- start 2024-09-13T18:07:08.132 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.128+0000 7fe37c200640 1 -- start start 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe37c200640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe374074e70 0x7fe37419c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe37c200640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3740760b0 0x7fe37419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe37c200640 1 --2- >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe374076a50 0x7fe3741a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe37c200640 1 -- --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3741a3fa0 con 0x7fe374074e70 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe37c200640 1 -- --> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3741a4110 con 0x7fe3740760b0 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe37c200640 1 -- --> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3741a42d0 con 0x7fe374076a50 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe379800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe374074e70 0x7fe37419c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe379800640 1 --2- >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe374074e70 0x7fe37419c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.27:3300/0 says I am v2:172.21.15.27:48674/0 (socket says 172.21.15.27:48674) 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe378e00640 1 --2- >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3740760b0 0x7fe37419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe379800640 1 -- 172.21.15.27:0/2285516031 learned_addr learned my addr 172.21.15.27:0/2285516031 (peer_addr_for_me v2:172.21.15.27:0/0) 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe37a200640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe374076a50 0x7fe3741a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:08.133 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe379800640 1 -- 172.21.15.27:0/2285516031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe374076a50 msgr2=0x7fe3741a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe379800640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe374076a50 0x7fe3741a3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe379800640 1 -- 172.21.15.27:0/2285516031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3740760b0 msgr2=0x7fe37419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe379800640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3740760b0 0x7fe37419c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe379800640 1 -- 172.21.15.27:0/2285516031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe360009560 con 0x7fe374074e70 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.129+0000 7fe37a200640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe374076a50 0x7fe3741a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.130+0000 7fe379800640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe374074e70 0x7fe37419c4b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe36800e9f0 tx=0x7fe36800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.130+0000 7fe372000640 1 -- 172.21.15.27:0/2285516031 <== mon.0 v2:172.21.15.27:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368009720 con 0x7fe374074e70 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.130+0000 7fe372000640 1 -- 172.21.15.27:0/2285516031 <== mon.0 v2:172.21.15.27:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe36800cd80 con 0x7fe374074e70 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.130+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3741a45b0 con 0x7fe374074e70 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.130+0000 7fe372000640 1 -- 172.21.15.27:0/2285516031 <== mon.0 v2:172.21.15.27:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368010690 con 0x7fe374074e70 2024-09-13T18:07:08.134 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.130+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3741a4a90 con 0x7fe374074e70 2024-09-13T18:07:08.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.131+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37410e8f0 con 0x7fe374074e70 2024-09-13T18:07:08.135 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.133+0000 7fe372000640 1 -- 172.21.15.27:0/2285516031 <== mon.0 v2:172.21.15.27:3300/0 4 ==== mgrmap(e 20) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe3680046c0 con 0x7fe374074e70 2024-09-13T18:07:08.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.134+0000 7fe372000640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe35c0a1110 0x7fe35c0a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:08.136 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.135+0000 7fe372000640 1 -- 172.21.15.27:0/2285516031 <== mon.0 v2:172.21.15.27:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8087+0+0 (secure 0 0 0) 0x7fe368014070 con 0x7fe374074e70 2024-09-13T18:07:08.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.135+0000 7fe378e00640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe35c0a1110 0x7fe35c0a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:08.137 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.135+0000 7fe378e00640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe35c0a1110 0x7fe35c0a35d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe360031510 tx=0x7fe3600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:08.140 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.138+0000 7fe372000640 1 -- 172.21.15.27:0/2285516031 <== mon.0 v2:172.21.15.27:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183819 (secure 0 0 0) 0x7fe368096380 con 0x7fe374074e70 2024-09-13T18:07:08.320 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.318+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 --> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe374111de0 con 0x7fe374074e70 2024-09-13T18:07:08.945 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.942+0000 7fe372000640 1 -- 172.21.15.27:0/2285516031 <== mon.0 v2:172.21.15.27:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe3680999a0 con 0x7fe374074e70 2024-09-13T18:07:08.945 INFO:teuthology.orchestra.run.smithi027.stderr:pool 'cephfs_data' removed 2024-09-13T18:07:08.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.947+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe35c0a1110 msgr2=0x7fe35c0a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:08.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.947+0000 7fe37c200640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe35c0a1110 0x7fe35c0a35d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe360031510 tx=0x7fe3600058d0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.947+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe374074e70 msgr2=0x7fe37419c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:08.949 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.947+0000 7fe37c200640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe374074e70 0x7fe37419c4b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe36800e9f0 tx=0x7fe36800edf0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.948+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 shutdown_connections 2024-09-13T18:07:08.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.948+0000 7fe37c200640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:6800/3586663065,v1:172.21.15.27:6801/3586663065] conn(0x7fe35c0a1110 0x7fe35c0a35d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.951 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.948+0000 7fe37c200640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.143:3300/0,v1:172.21.15.143:6789/0] conn(0x7fe374076a50 0x7fe3741a3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.948+0000 7fe37c200640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.122:3300/0,v1:172.21.15.122:6789/0] conn(0x7fe3740760b0 0x7fe37419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.948+0000 7fe37c200640 1 --2- 172.21.15.27:0/2285516031 >> [v2:172.21.15.27:3300/0,v1:172.21.15.27:6789/0] conn(0x7fe374074e70 0x7fe37419c4b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.948+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 >> 172.21.15.27:0/2285516031 conn(0x7fe3740fd700 msgr2=0x7fe3740ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.949+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 shutdown_connections 2024-09-13T18:07:08.952 INFO:teuthology.orchestra.run.smithi027.stderr:2024-09-13T18:07:08.949+0000 7fe37c200640 1 -- 172.21.15.27:0/2285516031 wait complete. 2024-09-13T18:07:08.983 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:07:09.044 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:07:09.076 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:07:09.105 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T18:07:09.106 DEBUG:teuthology.orchestra.run.smithi027:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:07:09.141 DEBUG:teuthology.orchestra.run.smithi122:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:07:09.157 DEBUG:teuthology.orchestra.run.smithi143:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T18:07:09.173 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T18:07:09.174 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-13T18:07:09.174 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.a 2024-09-13T18:07:09.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:08 smithi122 ceph-mon[35310]: pgmap v455: 97 pgs: 97 active+clean; 110 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-13T18:07:09.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:08 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2496752887' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T18:07:09.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:08 smithi122 ceph-mon[35310]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T18:07:09.214 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:08 smithi122 ceph-mon[35310]: from='client.? 172.21.15.27:0/2285516031' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:07:09.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:08 smithi027 ceph-mon[30611]: pgmap v455: 97 pgs: 97 active+clean; 110 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-13T18:07:09.230 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:08 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2496752887' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T18:07:09.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:08 smithi027 ceph-mon[30611]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T18:07:09.231 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:08 smithi027 ceph-mon[30611]: from='client.? 172.21.15.27:0/2285516031' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:07:09.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:08 smithi143 ceph-mon[38210]: pgmap v455: 97 pgs: 97 active+clean; 110 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-13T18:07:09.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:08 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2496752887' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-13T18:07:09.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:08 smithi143 ceph-mon[38210]: osdmap e90: 12 total, 12 up, 12 in 2024-09-13T18:07:09.276 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:08 smithi143 ceph-mon[38210]: from='client.? 172.21.15.27:0/2285516031' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-13T18:07:09.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:09 smithi027 systemd[1]: Stopping Ceph mon.a for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:09.971 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a[30606]: 2024-09-13T18:07:09.605+0000 7f7f25000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:09.971 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a[30606]: 2024-09-13T18:07:09.605+0000 7f7f25000640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T18:07:09.971 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:09 smithi027 podman[84287]: 2024-09-13 18:07:09.636438642 +0000 UTC m=+0.167962381 container died 29c954fa87cfe000e7caf8e15b6200c66f19afb8b5c73bbb4eac4254553d7271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T18:07:10.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:10 smithi027 podman[84287]: 2024-09-13 18:07:10.226722318 +0000 UTC m=+0.758246056 container cleanup 29c954fa87cfe000e7caf8e15b6200c66f19afb8b5c73bbb4eac4254553d7271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T18:07:10.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:10 smithi027 bash[84287]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a 2024-09-13T18:07:10.557 INFO:journalctl@ceph.mon.a.smithi027.stdout:Sep 13 18:07:10 smithi027 podman[84299]: 2024-09-13 18:07:10.411322428 +0000 UTC m=+0.758558228 container remove 29c954fa87cfe000e7caf8e15b6200c66f19afb8b5c73bbb4eac4254553d7271 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:07:10.679 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.a.service' 2024-09-13T18:07:10.780 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:10.781 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-13T18:07:10.781 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-13T18:07:10.781 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.b 2024-09-13T18:07:11.096 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:10 smithi122 systemd[1]: Stopping Ceph mon.b for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:11 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-b[35306]: 2024-09-13T18:07:11.093+0000 7f8176034640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:11 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-b[35306]: 2024-09-13T18:07:11.093+0000 7f8176034640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-13T18:07:11.464 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:11 smithi122 podman[68534]: 2024-09-13 18:07:11.104606261 +0000 UTC m=+0.133280780 container died 889580ada60ef2b86330a7bc94fe1f20240aa0f0541d1ee81113e27fc0362ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T18:07:11.838 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:11 smithi122 podman[68534]: 2024-09-13 18:07:11.593726045 +0000 UTC m=+0.622400562 container cleanup 889580ada60ef2b86330a7bc94fe1f20240aa0f0541d1ee81113e27fc0362ecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:07:11.838 INFO:journalctl@ceph.mon.b.smithi122.stdout:Sep 13 18:07:11 smithi122 bash[68534]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-b 2024-09-13T18:07:12.019 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.b.service' 2024-09-13T18:07:12.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:12.064 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-13T18:07:12.064 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-13T18:07:12.065 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.c 2024-09-13T18:07:12.384 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:12 smithi143 systemd[1]: Stopping Ceph mon.c for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:12.768 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:12 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-c[38196]: 2024-09-13T18:07:12.381+0000 7f3b421ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:12.768 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:12 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-c[38196]: 2024-09-13T18:07:12.381+0000 7f3b421ba640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T18:07:12.768 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:12 smithi143 podman[72019]: 2024-09-13 18:07:12.484648018 +0000 UTC m=+0.229572921 container died 03c582cf67a3697a927925c22c0c37dc7837d15e33643b6c50ec2a6042baf446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:07:13.025 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:12 smithi143 podman[72019]: 2024-09-13 18:07:12.864788127 +0000 UTC m=+0.609713030 container cleanup 03c582cf67a3697a927925c22c0c37dc7837d15e33643b6c50ec2a6042baf446 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:07:13.026 INFO:journalctl@ceph.mon.c.smithi143.stdout:Sep 13 18:07:12 smithi143 bash[72019]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mon-c 2024-09-13T18:07:13.234 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mon.c.service' 2024-09-13T18:07:13.282 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:13.283 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-13T18:07:13.283 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-13T18:07:13.283 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.x 2024-09-13T18:07:13.720 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:07:13 smithi027 systemd[1]: Stopping Ceph mgr.x for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:14.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:07:13 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:07:13.717+0000 7f4f23600640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:14.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:07:13 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x[30836]: 2024-09-13T18:07:13.717+0000 7f4f23600640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-13T18:07:14.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:07:13 smithi027 podman[84405]: 2024-09-13 18:07:13.800471621 +0000 UTC m=+0.222649239 container died 5049dcf0971f6353f18900dfbf60fbc5226c0a3f0ba68ea80640dd8158649808 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:07:14.397 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:07:14 smithi027 podman[84405]: 2024-09-13 18:07:14.390786863 +0000 UTC m=+0.812964462 container cleanup 5049dcf0971f6353f18900dfbf60fbc5226c0a3f0ba68ea80640dd8158649808 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T18:07:14.398 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:07:14 smithi027 bash[84405]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x 2024-09-13T18:07:15.057 INFO:journalctl@ceph.mgr.x.smithi027.stdout:Sep 13 18:07:14 smithi027 podman[84416]: 2024-09-13 18:07:14.767505615 +0000 UTC m=+0.957403357 container remove 5049dcf0971f6353f18900dfbf60fbc5226c0a3f0ba68ea80640dd8158649808 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:07:15.094 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-13T18:07:15.169 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:15.169 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-13T18:07:15.170 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-13T18:07:15.170 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.y 2024-09-13T18:07:15.463 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 18:07:15 smithi122 systemd[1]: Stopping Ceph mgr.y for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:15.759 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 18:07:15 smithi122 podman[68656]: 2024-09-13 18:07:15.48596793 +0000 UTC m=+0.121931573 container died b2981fac8317f45daa729bee9cd618c517ea0c7c9cb7b62d7c88d1e3a43efd3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:07:16.159 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 18:07:15 smithi122 podman[68656]: 2024-09-13 18:07:15.85699747 +0000 UTC m=+0.492961122 container cleanup b2981fac8317f45daa729bee9cd618c517ea0c7c9cb7b62d7c88d1e3a43efd3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T18:07:16.160 INFO:journalctl@ceph.mgr.y.smithi122.stdout:Sep 13 18:07:15 smithi122 bash[68656]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-y 2024-09-13T18:07:16.339 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-13T18:07:16.374 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:16.375 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-13T18:07:16.375 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-13T18:07:16.375 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.z 2024-09-13T18:07:16.691 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 18:07:16 smithi143 systemd[1]: Stopping Ceph mgr.z for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:16.970 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 18:07:16 smithi143 podman[72145]: 2024-09-13 18:07:16.689539301 +0000 UTC m=+0.123355954 container died 6dbea186e507364bdcd4827cd9221fefae5b6ca9c0f41b4e9939db78ff044979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:07:17.238 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 18:07:17 smithi143 podman[72145]: 2024-09-13 18:07:17.052262415 +0000 UTC m=+0.486079067 container cleanup 6dbea186e507364bdcd4827cd9221fefae5b6ca9c0f41b4e9939db78ff044979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:07:17.238 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 18:07:17 smithi143 bash[72145]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z 2024-09-13T18:07:17.466 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-13T18:07:17.489 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 18:07:17 smithi143 podman[72157]: 2024-09-13 18:07:17.236847074 +0000 UTC m=+0.522222359 container remove 6dbea186e507364bdcd4827cd9221fefae5b6ca9c0f41b4e9939db78ff044979 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:07:17.489 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 18:07:17 smithi143 systemd[1]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-13T18:07:17.489 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 18:07:17 smithi143 systemd[1]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.z.service: Failed with result 'exit-code'. 2024-09-13T18:07:17.489 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 18:07:17 smithi143 systemd[1]: Stopped Ceph mgr.z for f5527e2e-71f8-11ef-bceb-c7b262605968. 2024-09-13T18:07:17.489 INFO:journalctl@ceph.mgr.z.smithi143.stdout:Sep 13 18:07:17 smithi143 systemd[1]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mgr.z.service: Consumed 6.170s CPU time. 2024-09-13T18:07:17.500 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:17.501 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-13T18:07:17.501 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T18:07:17.501 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.0 2024-09-13T18:07:17.807 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:17 smithi027 systemd[1]: Stopping Ceph osd.0 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:18.307 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:17 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0[44826]: 2024-09-13T18:07:17.931+0000 7fceb3c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:18.307 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:17 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0[44826]: 2024-09-13T18:07:17.931+0000 7fceb3c00640 -1 osd.0 91 *** Got signal Terminated *** 2024-09-13T18:07:18.307 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:17 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0[44826]: 2024-09-13T18:07:17.931+0000 7fceb3c00640 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:07:23.807 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:23 smithi027 podman[84521]: 2024-09-13 18:07:23.515182236 +0000 UTC m=+5.713216856 container died 35a67f9a6979aa3ce3222012e17f963ee225d34cb2c961feb35d436bc52d14de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-13T18:07:24.557 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:24 smithi027 podman[84521]: 2024-09-13 18:07:24.114598179 +0000 UTC m=+6.312632861 container cleanup 35a67f9a6979aa3ce3222012e17f963ee225d34cb2c961feb35d436bc52d14de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD) 2024-09-13T18:07:24.557 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:24 smithi027 bash[84521]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0 2024-09-13T18:07:24.557 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:24 smithi027 podman[84539]: 2024-09-13 18:07:24.305797048 +0000 UTC m=+0.783351397 container remove 35a67f9a6979aa3ce3222012e17f963ee225d34cb2c961feb35d436bc52d14de (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T18:07:25.177 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:24 smithi027 podman[84624]: 2024-09-13 18:07:24.794926215 +0000 UTC m=+0.028195112 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:07:25.177 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:24 smithi027 podman[84624]: 2024-09-13 18:07:24.906456551 +0000 UTC m=+0.139725452 container create efff8ae56245c3e79fa5d4184c199e542981d24d85ef29cd87dd60ebc788adbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-13T18:07:25.440 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:25 smithi027 podman[84624]: 2024-09-13 18:07:25.175957701 +0000 UTC m=+0.409226597 container init efff8ae56245c3e79fa5d4184c199e542981d24d85ef29cd87dd60ebc788adbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-13T18:07:25.440 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:25 smithi027 podman[84624]: 2024-09-13 18:07:25.183099093 +0000 UTC m=+0.416367990 container start efff8ae56245c3e79fa5d4184c199e542981d24d85ef29cd87dd60ebc788adbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T18:07:25.440 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:25 smithi027 podman[84624]: 2024-09-13 18:07:25.258872004 +0000 UTC m=+0.492140900 container attach efff8ae56245c3e79fa5d4184c199e542981d24d85ef29cd87dd60ebc788adbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:07:25.754 INFO:journalctl@ceph.osd.0.smithi027.stdout:Sep 13 18:07:25 smithi027 podman[84646]: 2024-09-13 18:07:25.47930099 +0000 UTC m=+0.027019685 container died efff8ae56245c3e79fa5d4184c199e542981d24d85ef29cd87dd60ebc788adbc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:07:26.159 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T18:07:26.239 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:26.240 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T18:07:26.240 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T18:07:26.240 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.1 2024-09-13T18:07:26.588 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:26 smithi122 systemd[1]: Stopping Ceph osd.1 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:26.964 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:26 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1[39774]: 2024-09-13T18:07:26.585+0000 7fd23f812640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:26.964 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:26 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1[39774]: 2024-09-13T18:07:26.585+0000 7fd23f812640 -1 osd.1 91 *** Got signal Terminated *** 2024-09-13T18:07:26.964 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:26 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1[39774]: 2024-09-13T18:07:26.585+0000 7fd23f812640 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:07:32.247 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:31 smithi122 podman[68790]: 2024-09-13 18:07:31.968737805 +0000 UTC m=+5.533980618 container died 7cf473291454966a8501c6f33b18e9b737e5e124bac65db4c3784421a3b7a645 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:07:32.622 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:32 smithi122 podman[68790]: 2024-09-13 18:07:32.344498839 +0000 UTC m=+5.909741640 container cleanup 7cf473291454966a8501c6f33b18e9b737e5e124bac65db4c3784421a3b7a645 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T18:07:32.622 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:32 smithi122 bash[68790]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1 2024-09-13T18:07:32.956 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:32 smithi122 podman[68808]: 2024-09-13 18:07:32.621036712 +0000 UTC m=+0.645480767 container remove 7cf473291454966a8501c6f33b18e9b737e5e124bac65db4c3784421a3b7a645 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:07:33.214 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:32 smithi122 podman[68895]: 2024-09-13 18:07:32.858148686 +0000 UTC m=+0.015872514 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:07:33.214 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:32 smithi122 podman[68895]: 2024-09-13 18:07:32.96370002 +0000 UTC m=+0.121423820 container create 02f4a246f583c94d50a66137470e527eb9acb5f095f8f82fdb2a00be719f5076 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T18:07:33.214 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:33 smithi122 podman[68895]: 2024-09-13 18:07:33.190852559 +0000 UTC m=+0.348576360 container init 02f4a246f583c94d50a66137470e527eb9acb5f095f8f82fdb2a00be719f5076 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:07:33.214 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:33 smithi122 podman[68895]: 2024-09-13 18:07:33.194110771 +0000 UTC m=+0.351834584 container start 02f4a246f583c94d50a66137470e527eb9acb5f095f8f82fdb2a00be719f5076 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T18:07:33.653 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:33 smithi122 podman[68895]: 2024-09-13 18:07:33.2993586 +0000 UTC m=+0.457082408 container attach 02f4a246f583c94d50a66137470e527eb9acb5f095f8f82fdb2a00be719f5076 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T18:07:33.653 INFO:journalctl@ceph.osd.1.smithi122.stdout:Sep 13 18:07:33 smithi122 podman[68918]: 2024-09-13 18:07:33.403963307 +0000 UTC m=+0.016584859 container died 02f4a246f583c94d50a66137470e527eb9acb5f095f8f82fdb2a00be719f5076 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-13T18:07:33.977 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T18:07:34.017 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:34.018 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T18:07:34.018 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T18:07:34.018 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.2 2024-09-13T18:07:34.315 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:34 smithi143 systemd[1]: Stopping Ceph osd.2 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:34.776 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:34 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2[43235]: 2024-09-13T18:07:34.313+0000 7f0721a99640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:34.776 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:34 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2[43235]: 2024-09-13T18:07:34.313+0000 7f0721a99640 -1 osd.2 91 *** Got signal Terminated *** 2024-09-13T18:07:34.776 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:34 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2[43235]: 2024-09-13T18:07:34.313+0000 7f0721a99640 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:07:40.131 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:39 smithi143 podman[72284]: 2024-09-13 18:07:39.842846489 +0000 UTC m=+5.635126720 container died 512e73860ad075c54dee22d34b970fffd948f7494651d120977ff1f17282e478 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-13T18:07:40.390 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:40 smithi143 podman[72284]: 2024-09-13 18:07:40.129535223 +0000 UTC m=+5.921815453 container cleanup 512e73860ad075c54dee22d34b970fffd948f7494651d120977ff1f17282e478 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T18:07:40.390 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:40 smithi143 bash[72284]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2 2024-09-13T18:07:40.741 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:40 smithi143 podman[72299]: 2024-09-13 18:07:40.389064444 +0000 UTC m=+0.544573689 container remove 512e73860ad075c54dee22d34b970fffd948f7494651d120977ff1f17282e478 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T18:07:41.026 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:40 smithi143 podman[72389]: 2024-09-13 18:07:40.740055917 +0000 UTC m=+0.103476385 container create 56539909e1f593f672e67e74abd3d57b311e181feb6111841e52d8e1c1c0ab01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD) 2024-09-13T18:07:41.026 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:40 smithi143 podman[72389]: 2024-09-13 18:07:40.652331956 +0000 UTC m=+0.015752438 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:07:41.026 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:40 smithi143 podman[72389]: 2024-09-13 18:07:40.9758484 +0000 UTC m=+0.339268877 container init 56539909e1f593f672e67e74abd3d57b311e181feb6111841e52d8e1c1c0ab01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T18:07:41.026 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:40 smithi143 podman[72389]: 2024-09-13 18:07:40.979613484 +0000 UTC m=+0.343033971 container start 56539909e1f593f672e67e74abd3d57b311e181feb6111841e52d8e1c1c0ab01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T18:07:41.296 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:41 smithi143 podman[72389]: 2024-09-13 18:07:41.075781501 +0000 UTC m=+0.439201979 container attach 56539909e1f593f672e67e74abd3d57b311e181feb6111841e52d8e1c1c0ab01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:07:41.296 INFO:journalctl@ceph.osd.2.smithi143.stdout:Sep 13 18:07:41 smithi143 podman[72389]: 2024-09-13 18:07:41.173658855 +0000 UTC m=+0.537079338 container died 56539909e1f593f672e67e74abd3d57b311e181feb6111841e52d8e1c1c0ab01 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:07:41.741 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T18:07:41.780 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:41.780 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T18:07:41.780 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T18:07:41.781 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.3 2024-09-13T18:07:42.228 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:41 smithi027 systemd[1]: Stopping Ceph osd.3 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:42.557 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:42 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3[51434]: 2024-09-13T18:07:42.226+0000 7fc5b7200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:42.557 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:42 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3[51434]: 2024-09-13T18:07:42.226+0000 7fc5b7200640 -1 osd.3 91 *** Got signal Terminated *** 2024-09-13T18:07:42.557 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:42 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3[51434]: 2024-09-13T18:07:42.226+0000 7fc5b7200640 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:07:45.057 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:44 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3[51434]: 2024-09-13T18:07:44.711+0000 7fc5ae600640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.233294+0000 front 2024-09-13T18:07:20.233528+0000 (oldest deadline 2024-09-13T18:07:44.234364+0000) 2024-09-13T18:07:45.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:44 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:44.915+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:46.057 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:45 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3[51434]: 2024-09-13T18:07:45.760+0000 7fc5ae600640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.233294+0000 front 2024-09-13T18:07:20.233528+0000 (oldest deadline 2024-09-13T18:07:44.234364+0000) 2024-09-13T18:07:46.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:45 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:45.892+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:46.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:46 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:46.018+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:46.867 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:46 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3[51434]: 2024-09-13T18:07:46.719+0000 7fc5ae600640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.233294+0000 front 2024-09-13T18:07:20.233528+0000 (oldest deadline 2024-09-13T18:07:44.234364+0000) 2024-09-13T18:07:46.964 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:46 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:46.489+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:47.307 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:46 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:46.865+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:47.426 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:47.065+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:47.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:47.424+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:47.953 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:47 smithi027 podman[84726]: 2024-09-13 18:07:47.613775823 +0000 UTC m=+5.526018652 container died 522d3d40d736ad3ad886dcf3eb3400763bc426c28932807be14ba0921ae8298a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T18:07:47.953 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:47 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:47.715+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:47.953 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:47 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:47.830+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:47.963 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:47 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:47.528+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:48.210 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:48 smithi027 podman[84726]: 2024-09-13 18:07:48.19015453 +0000 UTC m=+6.102397358 container cleanup 522d3d40d736ad3ad886dcf3eb3400763bc426c28932807be14ba0921ae8298a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:07:48.210 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:48 smithi027 bash[84726]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3 2024-09-13T18:07:48.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:48 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:48.023+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:48.557 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:48 smithi027 podman[84759]: 2024-09-13 18:07:48.400051954 +0000 UTC m=+0.776282505 container remove 522d3d40d736ad3ad886dcf3eb3400763bc426c28932807be14ba0921ae8298a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:07:48.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:48 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:48.403+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:48.964 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:48 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:48.572+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:48.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:48 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:48.814+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:49.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:48 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:48.748+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:49.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:48 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:48.800+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:49.058 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:48 smithi027 podman[84846]: 2024-09-13 18:07:48.880869109 +0000 UTC m=+0.028371877 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:07:49.058 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:48 smithi027 podman[84846]: 2024-09-13 18:07:48.992997556 +0000 UTC m=+0.140500322 container create 51456ee4a12d1a744f8d0ced2884c99e93b4e27f829c9a38bf6209aaa827746c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:07:49.375 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:49.055+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:49.550 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:49 smithi027 podman[84846]: 2024-09-13 18:07:49.270826557 +0000 UTC m=+0.418329348 container init 51456ee4a12d1a744f8d0ced2884c99e93b4e27f829c9a38bf6209aaa827746c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:07:49.550 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:49 smithi027 podman[84846]: 2024-09-13 18:07:49.277711223 +0000 UTC m=+0.425213990 container start 51456ee4a12d1a744f8d0ced2884c99e93b4e27f829c9a38bf6209aaa827746c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T18:07:49.550 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:49 smithi027 podman[84846]: 2024-09-13 18:07:49.361788307 +0000 UTC m=+0.509291081 container attach 51456ee4a12d1a744f8d0ced2884c99e93b4e27f829c9a38bf6209aaa827746c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:07:49.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:49.373+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:49.807 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:49 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:49.790+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:49.807 INFO:journalctl@ceph.osd.3.smithi027.stdout:Sep 13 18:07:49 smithi027 podman[84846]: 2024-09-13 18:07:49.548325699 +0000 UTC m=+0.695828467 container died 51456ee4a12d1a744f8d0ced2884c99e93b4e27f829c9a38bf6209aaa827746c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T18:07:49.807 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:49 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:49.775+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:49.820 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:49 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:49.531+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:50.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:49 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:49.818+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:50.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:50.022+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:50.454 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T18:07:50.534 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:50.535 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T18:07:50.535 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T18:07:50.535 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.4 2024-09-13T18:07:50.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:50.394+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:50.850 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:50 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:50.529+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:50.850 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:50 smithi122 systemd[1]: Stopping Ceph osd.4 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:51.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:50 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:50.811+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:51.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:50 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:50.791+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:51.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:50 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:50.848+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:51.214 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:50 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:50.921+0000 7fad650a7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:51.214 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:50 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:50.921+0000 7fad650a7640 -1 osd.4 91 *** Got signal Terminated *** 2024-09-13T18:07:51.214 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:50 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:50.921+0000 7fad650a7640 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:07:51.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:50.977+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:51.766 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:51.435+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:51.811 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:51 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:51.496+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:52.025 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:51.957+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:52.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:51.824+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:52.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:51 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:51.798+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:52.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:51 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:51.809+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:52.714 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:52 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:52.447+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:52.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:07:52 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:07:52.558+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:07:52.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:52 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:52.449+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:52.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:52 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:52.449+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:07:53.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:52 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:52.796+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:53.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:52 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:52.835+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:53.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:52 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:52.802+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:53.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:52 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:52.969+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:53.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:52 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:52.969+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:07:53.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:07:53 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:07:53.036+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:07:53.714 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:53 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:53.433+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:53.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:07:53 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:07:53.542+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:07:53.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:53 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:53.415+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:53.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:53 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:53.415+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:07:54.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:53 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:53.779+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:54.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:53 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:53.831+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:54.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:53 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:53.831+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:07:54.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:53 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:53.813+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:54.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:53 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:53.940+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:54.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:53 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:53.940+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:07:54.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:07:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:07:54.061+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:07:54.480 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:54.412+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:54.543 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:54.398+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:54.543 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:54.398+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:07:54.849 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:07:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:07:54.506+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:07:55.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:54.779+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:55.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:54.878+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:55.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:54 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:54.878+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:07:55.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:54 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:54.846+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:55.275 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:07:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:07:55.027+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:07:55.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:54.974+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:55.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:54 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:54.974+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:07:55.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:07:55 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:07:55.500+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:07:55.714 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:55 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4[46687]: 2024-09-13T18:07:55.386+0000 7fad5dea3640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:20.850913+0000 front 2024-09-13T18:07:20.851042+0000 (oldest deadline 2024-09-13T18:07:46.151104+0000) 2024-09-13T18:07:55.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:55.370+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:55.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:55.370+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:07:56.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:55 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:55.784+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:56.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:55 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:55.784+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:07:56.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:55 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:55.873+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:56.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:55 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:55.873+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:07:56.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:55 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:55.808+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:56.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:55 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:55.808+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:07:56.275 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:07:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:07:55.996+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:07:56.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:55.985+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:56.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:55 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:55.985+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:07:56.533 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:56 smithi122 podman[68999]: 2024-09-13 18:07:56.256311573 +0000 UTC m=+5.521812894 container died 1a8bd0230758804485ad7f360870e5c3d4688afbfe18adeabc3e2aaf062c42f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-13T18:07:56.533 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:07:56 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:07:56.471+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:07:56.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:56 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:56.360+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:56.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:56 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:56.360+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:07:56.882 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:56 smithi122 podman[68999]: 2024-09-13 18:07:56.629942833 +0000 UTC m=+5.895444138 container cleanup 1a8bd0230758804485ad7f360870e5c3d4688afbfe18adeabc3e2aaf062c42f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T18:07:56.883 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:56 smithi122 bash[68999]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4 2024-09-13T18:07:56.883 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:56 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:56.765+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:56.883 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:56 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:56.765+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:07:57.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:56 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:56.745+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:57.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:56 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:56.745+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:07:57.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:56 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:56.852+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:57.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:56 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:56.852+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:07:57.203 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:56 smithi122 podman[69027]: 2024-09-13 18:07:56.881128242 +0000 UTC m=+0.623165732 container remove 1a8bd0230758804485ad7f360870e5c3d4688afbfe18adeabc3e2aaf062c42f8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-13T18:07:57.275 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:07:56 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:07:56.963+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:07:57.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:56 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:56.993+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:57.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:56 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:56.993+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:07:57.464 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:57 smithi122 podman[69118]: 2024-09-13 18:07:57.104771407 +0000 UTC m=+0.015543987 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:07:57.464 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:57 smithi122 podman[69118]: 2024-09-13 18:07:57.206744629 +0000 UTC m=+0.117517194 container create 19de5c3c9630eb02fb6457657d7926fef62462cf7c64212eef5f419088a5f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4-deactivate, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:07:57.464 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:57 smithi122 podman[69118]: 2024-09-13 18:07:57.434776452 +0000 UTC m=+0.345549035 container init 19de5c3c9630eb02fb6457657d7926fef62462cf7c64212eef5f419088a5f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-13T18:07:57.464 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:57 smithi122 podman[69118]: 2024-09-13 18:07:57.438289449 +0000 UTC m=+0.349062030 container start 19de5c3c9630eb02fb6457657d7926fef62462cf7c64212eef5f419088a5f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:07:57.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:57 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:57.397+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:57.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:57 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:57.397+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:07:57.948 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:07:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:07:57.485+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:07:57.948 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:57.717+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:57.948 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:57 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:57.717+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:07:57.948 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:57 smithi122 podman[69118]: 2024-09-13 18:07:57.534617413 +0000 UTC m=+0.445390001 container attach 19de5c3c9630eb02fb6457657d7926fef62462cf7c64212eef5f419088a5f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T18:07:57.948 INFO:journalctl@ceph.osd.4.smithi122.stdout:Sep 13 18:07:57 smithi122 podman[69118]: 2024-09-13 18:07:57.619426355 +0000 UTC m=+0.530198940 container died 19de5c3c9630eb02fb6457657d7926fef62462cf7c64212eef5f419088a5f1b2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-13T18:07:58.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:57 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:57.714+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:58.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:57 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:57.714+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:07:58.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:57 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:57.873+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:58.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:57 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:57.873+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:07:58.242 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T18:07:58.275 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:07:57 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:07:57.929+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:07:58.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:58 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:58.027+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:58.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:58 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:58.027+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:07:58.281 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:07:58.281 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T18:07:58.281 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T18:07:58.281 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.5 2024-09-13T18:07:58.583 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:58 smithi143 systemd[1]: Stopping Ceph osd.5 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:07:58.583 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:58 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:58.382+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:58.583 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:58 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:58.382+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:07:58.964 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:07:58 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:07:58.514+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:07:58.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:58 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:58.725+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:07:58.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:58 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:58.725+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:07:58.967 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:58 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:58.580+0000 7fcaf1dbb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:07:58.967 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:58 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:58.580+0000 7fcaf1dbb640 -1 osd.5 91 *** Got signal Terminated *** 2024-09-13T18:07:58.967 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:58 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:58.580+0000 7fcaf1dbb640 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:07:59.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:58 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:58.746+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:07:59.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:58 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:58.746+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:07:59.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:58 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:58.888+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:07:59.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:58 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:58.888+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:07:59.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:07:58 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:07:58.965+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:07:59.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:59 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:59.049+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:07:59.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:07:59 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:07:59.049+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:07:59.723 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:07:59 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:07:59.467+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:07:59.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:59 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:59.334+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:07:59.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:07:59 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:07:59.334+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:00.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:59 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:59.778+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:00.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:07:59 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:07:59.778+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:00.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:59 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:59.860+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:00.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:07:59 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:07:59.860+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:00.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:59 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:59.721+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:00.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:07:59 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:07:59.721+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:00.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:07:59 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:07:59.939+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:00.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:00 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:08:00.021+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:08:00.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:00 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:08:00.021+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:08:00.727 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:00 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:00.472+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:00.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:00 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:00.381+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:00.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:00 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:00.381+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:01.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:00.820+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:01.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:00.820+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:01.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:00.750+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:01.058 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:00.750+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:01.058 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:00 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:00.750+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:01.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:00 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:00.726+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:01.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:00 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:00.726+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:01.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:00 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:08:00.990+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:08:01.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:00 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:08:00.990+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:08:01.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:00 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:00.892+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:01.277 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:00 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:00.893+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:01.767 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:01 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:01.507+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:01.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:01 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:01.398+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:01.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:01 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:01.398+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:02.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:01.765+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:02.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:01.765+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:02.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:01.765+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:02.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:01.789+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:02.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:01 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:01.789+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:02.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:01 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:01.765+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:02.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:01 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:01.765+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:02.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:01 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:01.765+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:02.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:01 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:01.942+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:02.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:01 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:01.942+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:02.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:02 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:08:02.015+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:08:02.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:02 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:08:02.015+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:08:02.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:02 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:02.354+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:02.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:02 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:02.354+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:02.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:02 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:02.354+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:02.964 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:02 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:02.537+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:02.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:02 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:02.734+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:02.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:02 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:02.734+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:02.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:02 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:02.734+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:03.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:02 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:02.743+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:03.058 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:02 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:02.743+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:03.058 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:02 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:02.743+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:03.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:02 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:02.808+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:03.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:02 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:02.808+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:03.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:02 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:02.808+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:03.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:02 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:08:02.992+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:17.709543+0000 front 2024-09-13T18:07:17.709651+0000 (oldest deadline 2024-09-13T18:07:45.310084+0000) 2024-09-13T18:08:03.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:02 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5[49728]: 2024-09-13T18:08:02.992+0000 7fcaeabb7640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:29.411080+0000 front 2024-09-13T18:07:29.411056+0000 (oldest deadline 2024-09-13T18:07:52.911155+0000) 2024-09-13T18:08:03.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:02 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:02.957+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:03.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:02 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:02.957+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:03.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:03 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:03.391+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:03.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:03 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:03.391+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:03.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:03 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:03.391+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:03.964 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:03 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:03.522+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:03.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:03 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:03.768+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:03.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:03 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:03.768+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:03.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:03 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:03.768+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:04.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:03.725+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:04.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:03.725+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:04.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:03.725+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:04.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:03.780+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:04.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:03.780+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:04.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:03.780+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:04.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:04 smithi143 podman[72516]: 2024-09-13 18:08:04.093536115 +0000 UTC m=+5.616575260 container died 7e484909011001d1926fa954b31abdc768d0b82b8be952d2f8bc1a0cc0a1ca84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2) 2024-09-13T18:08:04.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:03 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:03.953+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:04.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:03 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:03.953+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:04.728 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:04 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:04.473+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:04.741 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:04 smithi143 podman[72516]: 2024-09-13 18:08:04.472219328 +0000 UTC m=+5.995258480 container cleanup 7e484909011001d1926fa954b31abdc768d0b82b8be952d2f8bc1a0cc0a1ca84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T18:08:04.741 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:04 smithi143 bash[72516]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5 2024-09-13T18:08:04.741 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:04 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:04.390+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:04.741 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:04 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:04.390+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:04.742 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:04 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:04.390+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:05.003 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:04 smithi143 podman[72532]: 2024-09-13 18:08:04.739971559 +0000 UTC m=+0.648151134 container remove 7e484909011001d1926fa954b31abdc768d0b82b8be952d2f8bc1a0cc0a1ca84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T18:08:05.003 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:04 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:04.946+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:05.003 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:04 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:04.946+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:05.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:04.715+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:05.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:04.715+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:05.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:04.715+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:05.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:04.793+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:05.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:04.793+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:05.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:04 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:04.793+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:05.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:04 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:04.726+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:05.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:04 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:04.726+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:05.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:04 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:04.726+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:05.275 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:05 smithi143 podman[72623]: 2024-09-13 18:08:04.980565094 +0000 UTC m=+0.016758895 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:08:05.276 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:05 smithi143 podman[72623]: 2024-09-13 18:08:05.090987974 +0000 UTC m=+0.127181811 container create 63054695acea4c4ca4c9c2fa92602f276c21735d0bc0330487f3f86b600521f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:08:05.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:05.457+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:05.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:05.457+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:05.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:05.382+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:05.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:05.382+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:05.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:05.382+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:05.776 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:05 smithi143 podman[72623]: 2024-09-13 18:08:05.309833945 +0000 UTC m=+0.346027735 container init 63054695acea4c4ca4c9c2fa92602f276c21735d0bc0330487f3f86b600521f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:08:05.776 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:05 smithi143 podman[72623]: 2024-09-13 18:08:05.313363868 +0000 UTC m=+0.349557661 container start 63054695acea4c4ca4c9c2fa92602f276c21735d0bc0330487f3f86b600521f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T18:08:05.777 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:05 smithi143 podman[72623]: 2024-09-13 18:08:05.401346126 +0000 UTC m=+0.437539927 container attach 63054695acea4c4ca4c9c2fa92602f276c21735d0bc0330487f3f86b600521f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:08:05.777 INFO:journalctl@ceph.osd.5.smithi143.stdout:Sep 13 18:08:05 smithi143 podman[72623]: 2024-09-13 18:08:05.497129359 +0000 UTC m=+0.533323151 container died 63054695acea4c4ca4c9c2fa92602f276c21735d0bc0330487f3f86b600521f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:08:06.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:05.702+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:06.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:05.702+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:06.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:05.702+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:06.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:05.799+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:06.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:05.799+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:06.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:05 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:05.799+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:06.075 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:05.980+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:06.075 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:05 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:05.981+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:06.099 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T18:08:06.140 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:08:06.140 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T18:08:06.140 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-13T18:08:06.140 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.6 2024-09-13T18:08:06.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:05.733+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:06.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:05.733+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:06.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:05 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:05.733+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:06.557 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:06 smithi027 systemd[1]: Stopping Ceph osd.6 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:08:06.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:06 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:06.443+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:06.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:06 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:06.443+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:06.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:06 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:06.366+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:06.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:06 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:06.366+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:06.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:06 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:06.366+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:07.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:06.757+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:07.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:06.757+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:07.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:06.757+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:07.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:06.579+0000 7f3a68a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:08:07.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:06.579+0000 7f3a68a00640 -1 osd.6 91 *** Got signal Terminated *** 2024-09-13T18:08:07.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:06.579+0000 7f3a68a00640 -1 osd.6 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:08:07.058 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:06.678+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:07.058 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:06.678+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:07.058 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:06 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:06.678+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:07.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:06 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:06.782+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:07.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:06 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:06.782+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:07.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:06 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:06.782+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:07.275 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:07 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:07.017+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:07.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:07 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:07.017+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:07.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:07 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:07.407+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:07.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:07 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:07.407+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:07.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:07 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:07.323+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:07.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:07 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:07.323+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:07.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:07 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:07.323+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:08.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:07.647+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:08.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:07.647+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:08.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:07.647+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:08.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:07.807+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:08.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:07.808+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:08.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:07.808+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:08.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:07 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:07.776+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:08.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:07 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:07.776+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:08.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:07 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:07.776+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:08.275 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:08 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:08.004+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:08.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:08 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:08.004+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:08.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:08 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:08.393+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:08.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:08 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:08.393+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:08.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:08 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:08.371+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:08.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:08 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:08.371+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:08.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:08 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:08.371+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:08.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:08 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:08.371+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:09.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:08 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:08.666+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:09.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:08 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:08.666+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:09.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:08 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:08.666+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:09.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:08 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:08.781+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:09.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:08 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:08.781+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:09.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:08 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:08.781+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:09.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:08 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:08.765+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:09.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:08 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:08.765+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:09.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:08 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:08.765+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:09.408 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:09 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:09.048+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:09.408 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:09 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:09.048+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:09.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:09 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:09.401+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:09.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:09 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:09.401+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:09.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:09 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:09.401+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:09.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:09 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:09.406+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:09.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:09 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:09.406+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:09.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:09 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:09.406+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:09.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:09 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:09.406+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:10.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:09.655+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:10.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:09.655+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:10.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:09.655+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:10.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:09.739+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:10.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:09.739+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:10.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:09 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:09.739+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:10.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:09 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:09.727+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:10.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:09 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:09.727+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:10.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:09 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:09.727+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:10.407 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:10 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:10.077+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:10.407 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:10 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:10.077+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:10.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:10 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:10.442+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:10.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:10 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:10.442+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:10.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:10 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:10.442+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:10.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:10 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:10.405+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:10.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:10 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:10.405+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:10.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:10 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:10.405+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:10.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:10 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:10.405+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:11.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:10 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:10.685+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.656783+0000 front 2024-09-13T18:07:22.656848+0000 (oldest deadline 2024-09-13T18:07:47.356857+0000) 2024-09-13T18:08:11.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:10 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:10.685+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.258439+0000 front 2024-09-13T18:07:30.258161+0000 (oldest deadline 2024-09-13T18:07:55.558282+0000) 2024-09-13T18:08:11.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:10 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6[58263]: 2024-09-13T18:08:10.685+0000 7f3a64e00640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.558974+0000 front 2024-09-13T18:07:35.558893+0000 (oldest deadline 2024-09-13T18:08:00.258996+0000) 2024-09-13T18:08:11.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:10 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:10.729+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:11.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:10 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:10.729+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:11.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:10 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:10.729+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:11.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:10 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:10.758+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:11.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:10 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:10.758+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:11.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:10 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:10.758+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:11.376 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:11 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:11.069+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:11.376 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:11 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:11.069+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:11.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:11 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:11.461+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:11.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:11 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:11.461+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:11.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:11 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:11.461+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:11.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:11 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:11.374+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:11.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:11 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:11.374+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:11.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:11 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:11.374+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:11.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:11 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:11.374+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:12.055 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:11 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:11.765+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:12.055 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:11 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:11.765+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:12.055 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:11 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:11.765+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:12.055 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:11 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:11.765+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:12.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:11 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:11.733+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:12.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:11 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:11.733+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:12.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:11 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:11.733+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:12.307 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:12 smithi027 podman[84950]: 2024-09-13 18:08:12.053670228 +0000 UTC m=+5.596677054 container died 1fa44cdbe0d08559c7d0c865636e9d39e8d6d6e24fca24139cafacddee6995bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-13T18:08:12.402 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:12 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:12.048+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:12.402 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:12 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:12.048+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:12.402 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:12 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:12.048+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:12.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:12 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:12.447+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:12.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:12 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:12.447+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:12.714 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:12 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:12.447+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:12.740 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:12 smithi027 podman[84950]: 2024-09-13 18:08:12.518278998 +0000 UTC m=+6.061285823 container cleanup 1fa44cdbe0d08559c7d0c865636e9d39e8d6d6e24fca24139cafacddee6995bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True) 2024-09-13T18:08:12.740 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:12 smithi027 bash[84950]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6 2024-09-13T18:08:12.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:12 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:12.399+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:12.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:12 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:12.399+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:12.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:12 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:12.399+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:12.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:12 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:12.399+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:13.057 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:12 smithi027 podman[84970]: 2024-09-13 18:08:12.738499548 +0000 UTC m=+0.669264286 container remove 1fa44cdbe0d08559c7d0c865636e9d39e8d6d6e24fca24139cafacddee6995bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:08:13.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:12.813+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:13.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:12.813+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:13.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:12.813+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:13.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:12 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:12.813+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:13.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:12 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:12.744+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:13.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:12 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:12.744+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:13.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:12 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:12.744+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:13.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:12 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:12.744+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:13.430 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:13 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:13.089+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:13.430 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:13 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:13.089+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:13.431 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:13 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:13.089+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:13.557 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:13 smithi027 podman[85055]: 2024-09-13 18:08:13.205726256 +0000 UTC m=+0.027599313 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:08:13.557 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:13 smithi027 podman[85055]: 2024-09-13 18:08:13.320515019 +0000 UTC m=+0.142388063 container create 0380dde59ea6cf18ead62b653769a96c3d0cce7f597d8ece027d902434915115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:08:13.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:13 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:13.428+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:13.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:13 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:13.428+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:13.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:13 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:13.428+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:13.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:13 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:13.428+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:13.795 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:13 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:13.492+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:13.795 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:13 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:13.492+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:13.795 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:13 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:13.492+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:13.846 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:13 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:13.787+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:13.846 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:13 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:13.787+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:13.846 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:13 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:13.787+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:13.846 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:13 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:13.787+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:13.846 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:13 smithi027 podman[85055]: 2024-09-13 18:08:13.565120156 +0000 UTC m=+0.386993200 container init 0380dde59ea6cf18ead62b653769a96c3d0cce7f597d8ece027d902434915115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T18:08:13.846 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:13 smithi027 podman[85055]: 2024-09-13 18:08:13.572180008 +0000 UTC m=+0.394053062 container start 0380dde59ea6cf18ead62b653769a96c3d0cce7f597d8ece027d902434915115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-13T18:08:13.846 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:13 smithi027 podman[85055]: 2024-09-13 18:08:13.656238687 +0000 UTC m=+0.478111745 container attach 0380dde59ea6cf18ead62b653769a96c3d0cce7f597d8ece027d902434915115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:08:14.177 INFO:journalctl@ceph.osd.6.smithi027.stdout:Sep 13 18:08:13 smithi027 podman[85055]: 2024-09-13 18:08:13.844582425 +0000 UTC m=+0.666455485 container died 0380dde59ea6cf18ead62b653769a96c3d0cce7f597d8ece027d902434915115 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T18:08:14.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:13 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:13.792+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:14.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:13 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:13.792+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:14.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:13 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:13.792+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:14.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:13 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:13.792+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:14.465 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:14 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:14.127+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:14.466 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:14 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:14.127+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:14.466 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:14 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:14.127+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:14.605 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.6.service' 2024-09-13T18:08:14.682 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:08:14.683 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-13T18:08:14.683 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-13T18:08:14.683 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.7 2024-09-13T18:08:14.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:14 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:14.463+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:14.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:14 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:14.463+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:14.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:14 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:14.463+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:14.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:14 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:14.463+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:14.828 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:14.490+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:14.829 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:14.490+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:14.829 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:14.490+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:14.829 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:14 smithi122 systemd[1]: Stopping Ceph osd.7 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:08:15.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:14 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:14.751+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:15.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:14 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:14.751+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:15.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:14 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:14.751+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:15.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:14 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:14.751+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:15.214 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:14.973+0000 7fef1e352640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:08:15.214 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:14.973+0000 7fef1e352640 -1 osd.7 91 *** Got signal Terminated *** 2024-09-13T18:08:15.214 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:14.973+0000 7fef1e352640 -1 osd.7 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:08:15.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:14.826+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:15.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:14.826+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:15.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:14.826+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:15.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:14 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:14.826+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:15.463 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:15 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:15.163+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:15.463 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:15 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:15.163+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:15.463 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:15 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:15.163+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:15.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:15 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:15.460+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:15.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:15 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:15.460+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:15.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:15 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:15.460+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:15.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:15 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:15.460+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:15.863 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:15 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:15.481+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:15.863 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:15 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:15.481+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:15.863 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:15 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:15.481+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:16.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:15 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:15.773+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:16.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:15 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:15.773+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:16.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:15 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:15.773+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:16.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:15 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:15.773+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:16.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:15 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:15.860+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:16.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:15 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:15.860+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:16.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:15 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:15.860+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:16.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:15 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:15.860+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:16.498 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:16 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:16.131+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:16.499 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:16 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:16.131+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:16.499 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:16 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:16.131+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:16.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:16 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:16.496+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:16.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:16 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:16.496+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:16.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:16 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:16.496+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:16.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:16 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:16.496+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:16.820 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:16 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:16.522+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:16.820 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:16 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:16.522+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:16.820 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:16 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:16.522+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:17.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:16 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:16.787+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:17.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:16 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:16.787+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:17.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:16 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:16.787+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:17.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:16 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:16.787+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:17.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:16 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:16.817+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:17.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:16 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:16.817+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:17.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:16 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:16.817+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:17.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:16 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:16.817+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:17.516 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:17 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:17.105+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:17.516 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:17 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:17.105+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:17.516 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:17 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:17.105+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:17.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:17 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:17.514+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:17.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:17 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:17.514+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:17.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:17 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:17.514+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:17.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:17 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:17.514+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:17.855 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:17 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:17.544+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:17.856 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:17 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:17.544+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:17.856 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:17 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:17.544+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:17.856 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:17 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:17.544+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.854190+0000 front 2024-09-13T18:07:55.854206+0000 (oldest deadline 2024-09-13T18:08:16.954376+0000) 2024-09-13T18:08:18.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:17 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:17.853+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:18.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:17 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:17.853+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:18.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:17 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:17.853+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:18.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:17 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:17.853+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:18.307 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:17 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:17.818+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:18.307 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:17 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:17.818+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:18.307 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:17 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:17.818+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:18.307 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:17 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:17.818+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:18.307 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:17 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:17.818+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:18.510 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:18 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:18.146+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:18.510 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:18 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:18.146+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:18.511 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:18 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:18.146+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:18.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:18 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:18.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:18.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:18 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:18.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:18.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:18 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:18.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:18.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:18 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:18.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:18.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:18 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:18.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:18.817 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:18 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:18.503+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:18.817 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:18 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:18.503+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:18.817 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:18 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:18.503+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:18.817 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:18 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:18.503+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.854190+0000 front 2024-09-13T18:07:55.854206+0000 (oldest deadline 2024-09-13T18:08:16.954376+0000) 2024-09-13T18:08:19.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:18 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:18.771+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:19.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:18 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:18.771+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:19.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:18 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:18.771+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:19.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:18 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:18.771+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:19.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:18 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:18.771+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:19.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:18 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:18.814+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:19.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:18 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:18.814+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:19.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:18 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:18.814+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:19.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:18 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:18.814+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:19.525 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:19 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:19.129+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:19.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:19 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:19.129+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:19.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:19 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:19.129+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:19.964 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:19.541+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.249835+0000 front 2024-09-13T18:07:30.249857+0000 (oldest deadline 2024-09-13T18:07:52.450529+0000) 2024-09-13T18:08:19.964 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:19.541+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.852113+0000 front 2024-09-13T18:07:38.852086+0000 (oldest deadline 2024-09-13T18:08:04.752211+0000) 2024-09-13T18:08:19.964 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:19.541+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.752909+0000 front 2024-09-13T18:07:44.752713+0000 (oldest deadline 2024-09-13T18:08:08.852800+0000) 2024-09-13T18:08:19.964 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7[53209]: 2024-09-13T18:08:19.541+0000 7fef1714e640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.854190+0000 front 2024-09-13T18:07:55.854206+0000 (oldest deadline 2024-09-13T18:08:16.954376+0000) 2024-09-13T18:08:19.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:19.773+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:19.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:19.773+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:19.965 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:19.773+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:19.965 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:19.773+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:19.965 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:19.773+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:20.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:19 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:19.536+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:20.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:19 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:19.536+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:20.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:19 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:19.536+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:20.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:19 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:19.536+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:20.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:19 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:19.536+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:20.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:19 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:19.728+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:20.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:19 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:19.728+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:20.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:19 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:19.728+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:20.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:19 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:19.728+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:20.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:19 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:19.728+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:20.525 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:20 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:20.162+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:20.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:20 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:20.162+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:20.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:20 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:20.162+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:20.751 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:20 smithi122 podman[69219]: 2024-09-13 18:08:20.46565641 +0000 UTC m=+5.592531604 container died 681e496fd0fb41fa90d8dc6416a398e7947ecdef7a8020948a8e5225726f32ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:08:21.025 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:20 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:20.529+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:21.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:20 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:20.530+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:21.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:20 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:20.530+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:21.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:20 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:20.530+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:21.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:20 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:20.530+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:21.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:20 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:20.711+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:21.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:20 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:20.711+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:21.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:20 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:20.711+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:21.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:20 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:20.711+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:21.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:20 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:20.711+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:21.110 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:20 smithi122 podman[69219]: 2024-09-13 18:08:20.8406669 +0000 UTC m=+5.967542093 container cleanup 681e496fd0fb41fa90d8dc6416a398e7947ecdef7a8020948a8e5225726f32ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T18:08:21.110 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:20 smithi122 bash[69219]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7 2024-09-13T18:08:21.110 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:20 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:20.805+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:21.111 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:20 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:20.805+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:21.111 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:20 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:20.805+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:21.111 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:20 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:20.805+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:21.111 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:20 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:20.805+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:21.449 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:21 smithi122 podman[69234]: 2024-09-13 18:08:21.108768901 +0000 UTC m=+0.640986911 container remove 681e496fd0fb41fa90d8dc6416a398e7947ecdef7a8020948a8e5225726f32ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T18:08:21.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:21 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:21.124+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:21.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:21 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:21.124+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:21.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:21 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:21.124+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:21.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:21 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:21.124+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.275450+0000 front 2024-09-13T18:07:53.275435+0000 (oldest deadline 2024-09-13T18:08:20.275783+0000) 2024-09-13T18:08:21.711 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:21 smithi122 podman[69326]: 2024-09-13 18:08:21.350676404 +0000 UTC m=+0.015590430 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:08:21.711 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:21 smithi122 podman[69326]: 2024-09-13 18:08:21.477513924 +0000 UTC m=+0.142427937 container create 3dbf608cd6c4951bae55f56c12c03ebbbe09d92544ec4c6a92a89301a7b71162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T18:08:21.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:21 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:21.812+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:21.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:21 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:21.812+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:21.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:21 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:21.812+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:21.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:21 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:21.812+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:21.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:21 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:21.812+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:21.965 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:21 smithi122 podman[69326]: 2024-09-13 18:08:21.819688732 +0000 UTC m=+0.484602753 container init 3dbf608cd6c4951bae55f56c12c03ebbbe09d92544ec4c6a92a89301a7b71162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=) 2024-09-13T18:08:21.965 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:21 smithi122 podman[69326]: 2024-09-13 18:08:21.823082042 +0000 UTC m=+0.487996069 container start 3dbf608cd6c4951bae55f56c12c03ebbbe09d92544ec4c6a92a89301a7b71162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T18:08:21.965 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:21 smithi122 podman[69326]: 2024-09-13 18:08:21.902975501 +0000 UTC m=+0.567889516 container attach 3dbf608cd6c4951bae55f56c12c03ebbbe09d92544ec4c6a92a89301a7b71162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:08:22.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:21 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:21.566+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:22.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:21 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:21.566+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:22.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:21 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:21.566+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:22.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:21 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:21.566+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:22.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:21 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:21.566+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:22.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:21 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:21.740+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:22.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:21 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:21.740+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:22.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:21 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:21.740+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:22.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:21 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:21.740+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:22.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:21 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:21.740+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:22.273 INFO:journalctl@ceph.osd.7.smithi122.stdout:Sep 13 18:08:22 smithi122 podman[69326]: 2024-09-13 18:08:22.006502629 +0000 UTC m=+0.671416649 container died 3dbf608cd6c4951bae55f56c12c03ebbbe09d92544ec4c6a92a89301a7b71162 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-7-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T18:08:22.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:22 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:22.140+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:22.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:22 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:22.140+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:22.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:22 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:22.140+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:22.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:22 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:22.140+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.275450+0000 front 2024-09-13T18:07:53.275435+0000 (oldest deadline 2024-09-13T18:08:20.275783+0000) 2024-09-13T18:08:22.694 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.7.service' 2024-09-13T18:08:22.732 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:08:22.733 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-13T18:08:22.733 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-13T18:08:22.733 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.8 2024-09-13T18:08:22.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:22 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:22.792+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:22.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:22 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:22.792+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:22.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:22 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:22.793+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:22.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:22 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:22.793+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:22.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:22 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:22.793+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:23.025 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:22 smithi143 systemd[1]: Stopping Ceph osd.8 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:08:23.025 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:22 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:22.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:23.025 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:22 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:22.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:23.025 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:22 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:22.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:23.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:22 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:22.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:23.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:22 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:22.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:23.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:22 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:22.726+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:23.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:22 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:22.726+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:23.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:22 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:22.726+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:23.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:22 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:22.726+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:23.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:22 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:22.726+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:23.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:23.022+0000 7fb5e9769640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:08:23.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:23.022+0000 7fb5e9769640 -1 osd.8 91 *** Got signal Terminated *** 2024-09-13T18:08:23.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:23.022+0000 7fb5e9769640 -1 osd.8 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:08:23.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:23.154+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:23.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:23.154+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:23.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:23.154+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:23.276 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:23.154+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.275450+0000 front 2024-09-13T18:07:53.275435+0000 (oldest deadline 2024-09-13T18:08:20.275783+0000) 2024-09-13T18:08:24.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:23.553+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:24.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:23.553+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:24.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:23.553+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:24.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:23.553+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:24.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:23 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:23.553+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:24.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:23 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:23.764+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:24.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:23 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:23.764+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:24.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:23 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:23.764+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:24.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:23 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:23.764+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:24.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:23 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:23.764+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:24.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:23 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:23.802+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:24.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:23 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:23.802+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:24.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:23 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:23.802+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:24.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:23 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:23.802+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:24.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:23 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:23.802+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:24.295 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:24 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:24.138+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:24.296 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:24 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:24.138+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:24.296 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:24 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:24.138+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:24.296 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:24 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:24.138+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.275450+0000 front 2024-09-13T18:07:53.275435+0000 (oldest deadline 2024-09-13T18:08:20.275783+0000) 2024-09-13T18:08:24.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:24 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:24.517+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:24.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:24 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:24.517+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:24.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:24 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:24.517+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:24.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:24 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:24.517+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:24.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:24 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:24.517+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:24.841 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:24 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:24.837+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:24.841 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:24 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:24.837+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:24.841 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:24 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:24.837+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:24.841 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:24 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:24.837+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:24.841 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:24 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:24.837+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:25.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:24 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:24.755+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:25.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:24 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:24.755+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:25.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:24 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:24.755+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:25.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:24 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:24.755+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:25.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:24 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:24.755+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:25.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:25.188+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:25.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:25.188+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:25.527 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:25.188+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:25.527 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:25.188+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.275450+0000 front 2024-09-13T18:07:53.275435+0000 (oldest deadline 2024-09-13T18:08:20.275783+0000) 2024-09-13T18:08:26.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:25.560+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:26.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:25.560+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:26.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:25.560+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:26.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:25.560+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:26.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:25.560+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:26.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:25 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:25.560+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:26.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:25 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:25.721+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:26.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:25 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:25.721+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:26.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:25 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:25.721+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:26.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:25 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:25.721+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:26.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:25 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:25.721+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:26.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:25 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:25.869+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:26.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:25 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:25.869+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:26.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:25 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:25.869+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:26.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:25 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:25.869+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:26.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:25 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:25.869+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:26.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:25 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:25.869+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:26.525 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:26.171+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:26.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:26.171+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:26.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:26.171+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:26.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:26.171+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.275450+0000 front 2024-09-13T18:07:53.275435+0000 (oldest deadline 2024-09-13T18:08:20.275783+0000) 2024-09-13T18:08:27.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:26.594+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:27.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:26.594+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:27.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:26.594+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:27.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:26.594+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:27.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:26.594+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:27.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:26 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:26.594+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:27.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:26 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:26.676+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:27.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:26 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:26.676+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:27.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:26 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:26.676+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:27.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:26 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:26.676+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:27.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:26 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:26.676+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:27.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:26 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:26.825+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:27.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:26 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:26.825+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:27.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:26 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:26.825+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:27.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:26 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:26.825+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:27.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:26 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:26.825+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:27.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:26 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:26.825+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:27.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:27.132+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.371092+0000 front 2024-09-13T18:07:28.371077+0000 (oldest deadline 2024-09-13T18:07:52.471007+0000) 2024-09-13T18:08:27.526 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:27.132+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:38.372108+0000 front 2024-09-13T18:07:38.372129+0000 (oldest deadline 2024-09-13T18:07:59.972720+0000) 2024-09-13T18:08:27.527 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:27.132+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:45.674619+0000 front 2024-09-13T18:07:45.674499+0000 (oldest deadline 2024-09-13T18:08:11.574543+0000) 2024-09-13T18:08:27.527 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8[56719]: 2024-09-13T18:08:27.132+0000 7fb5e656d640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.275450+0000 front 2024-09-13T18:07:53.275435+0000 (oldest deadline 2024-09-13T18:08:20.275783+0000) 2024-09-13T18:08:28.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:27.589+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:28.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:27.589+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:28.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:27.589+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:28.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:27.589+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:28.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:27.589+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:28.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:27.589+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:28.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:27 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:27.679+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:28.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:27 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:27.679+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:28.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:27 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:27.679+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:28.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:27 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:27.679+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:28.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:27 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:27.679+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:28.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:27 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:27.862+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:28.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:27 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:27.862+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:28.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:27 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:27.862+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:28.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:27 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:27.862+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:28.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:27 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:27.862+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:28.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:27 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:27.862+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:28.774 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:28 smithi143 podman[72728]: 2024-09-13 18:08:28.505637212 +0000 UTC m=+5.581050591 container died 60f947a2a80da78f2acca715b95824843eab3d970e4c3d1b94950680ee2909da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:08:28.774 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:28 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:28.599+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:28.774 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:28 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:28.599+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:28.774 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:28 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:28.599+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:28.774 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:28 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:28.599+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:28.774 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:28 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:28.599+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:28.774 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:28 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:28.599+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:29.025 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:28 smithi143 podman[72728]: 2024-09-13 18:08:28.772129382 +0000 UTC m=+5.847542762 container cleanup 60f947a2a80da78f2acca715b95824843eab3d970e4c3d1b94950680ee2909da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T18:08:29.026 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:28 smithi143 bash[72728]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8 2024-09-13T18:08:29.026 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:29 smithi143 podman[72757]: 2024-09-13 18:08:29.006598729 +0000 UTC m=+0.499437620 container remove 60f947a2a80da78f2acca715b95824843eab3d970e4c3d1b94950680ee2909da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0) 2024-09-13T18:08:29.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:28 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:28.661+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:29.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:28 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:28.661+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:29.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:28 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:28.661+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:29.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:28 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:28.661+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:29.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:28 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:28.661+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:29.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:28 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:28.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:29.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:28 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:28.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:29.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:28 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:28.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:29.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:28 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:28.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:29.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:28 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:28.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:29.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:28 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:28.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:29.587 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:29 smithi143 podman[72845]: 2024-09-13 18:08:29.216052688 +0000 UTC m=+0.015427084 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:08:29.587 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:29 smithi143 podman[72845]: 2024-09-13 18:08:29.379942297 +0000 UTC m=+0.179316738 container create af11e17542bced8a53914c304bdb292cde2005da643afe0e293dfbf6caeec949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T18:08:30.026 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:29 smithi143 podman[72845]: 2024-09-13 18:08:29.612066399 +0000 UTC m=+0.411440798 container init af11e17542bced8a53914c304bdb292cde2005da643afe0e293dfbf6caeec949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:08:30.026 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:29 smithi143 podman[72845]: 2024-09-13 18:08:29.615507074 +0000 UTC m=+0.414881470 container start af11e17542bced8a53914c304bdb292cde2005da643afe0e293dfbf6caeec949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T18:08:30.026 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:29 smithi143 podman[72845]: 2024-09-13 18:08:29.684602529 +0000 UTC m=+0.483976941 container attach af11e17542bced8a53914c304bdb292cde2005da643afe0e293dfbf6caeec949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:08:30.026 INFO:journalctl@ceph.osd.8.smithi143.stdout:Sep 13 18:08:29 smithi143 podman[72845]: 2024-09-13 18:08:29.798019817 +0000 UTC m=+0.597394214 container died af11e17542bced8a53914c304bdb292cde2005da643afe0e293dfbf6caeec949 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:08:30.027 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:29 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:29.585+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:30.027 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:29 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:29.585+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:30.027 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:29 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:29.585+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:30.027 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:29 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:29.585+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:30.027 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:29 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:29.585+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:30.027 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:29 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:29.585+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:30.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:29.664+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:30.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:29.664+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:30.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:29.664+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:30.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:29.664+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:30.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:29.664+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:30.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:29 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:29.664+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.674699+0000 front 2024-09-13T18:08:01.674475+0000 (oldest deadline 2024-09-13T18:08:29.275058+0000) 2024-09-13T18:08:30.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:29 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:29.873+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:30.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:29 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:29.873+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:30.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:29 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:29.873+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:30.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:29 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:29.873+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:30.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:29 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:29.873+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:30.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:29 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:29.873+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:30.287 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.8.service' 2024-09-13T18:08:30.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:08:30.325 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-13T18:08:30.325 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-13T18:08:30.326 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.9 2024-09-13T18:08:30.642 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 systemd[1]: Stopping Ceph osd.9 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:08:30.642 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:30.639+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:30.642 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:30.639+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:31.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:30 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:30.619+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:31.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:30 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:30.619+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:31.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:30 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:30.619+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:31.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:30 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:30.619+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:31.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:30 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:30.619+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:31.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:30 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:30.619+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:31.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:30.639+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:31.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:30.639+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:31.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:30.639+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:31.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:30.639+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.674699+0000 front 2024-09-13T18:08:01.674475+0000 (oldest deadline 2024-09-13T18:08:29.275058+0000) 2024-09-13T18:08:31.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:30.757+0000 7fb087e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:08:31.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:30.757+0000 7fb087e00640 -1 osd.9 91 *** Got signal Terminated *** 2024-09-13T18:08:31.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:30 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:30.757+0000 7fb087e00640 -1 osd.9 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:08:31.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:30 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:30.914+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:31.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:30 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:30.914+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:31.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:30 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:30.914+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:31.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:30 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:30.914+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:31.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:30 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:30.914+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:31.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:30 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:30.914+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:32.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:31 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:31.662+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:32.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:31 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:31.662+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:32.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:31 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:31.662+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:32.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:31 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:31.662+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:32.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:31 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:31.662+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:32.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:31 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:31.662+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:32.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:31 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:31.641+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:32.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:31 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:31.641+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:32.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:31 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:31.641+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:32.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:31 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:31.641+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:32.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:31 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:31.641+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:32.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:31 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:31.641+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.674699+0000 front 2024-09-13T18:08:01.674475+0000 (oldest deadline 2024-09-13T18:08:29.275058+0000) 2024-09-13T18:08:32.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:31 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:31.920+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:32.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:31 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:31.920+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:32.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:31 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:31.920+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:32.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:31 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:31.920+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:32.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:31 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:31.920+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:32.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:31 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:31.920+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:33.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:32 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:32.666+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:33.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:32 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:32.666+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:33.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:32 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:32.666+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:33.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:32 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:32.666+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:33.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:32 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:32.666+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:33.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:32 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:32.666+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:33.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:32 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:32.652+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:33.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:32 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:32.652+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:33.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:32 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:32.652+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:33.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:32 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:32.652+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:33.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:32 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:32.652+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:33.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:32 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:32.652+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.674699+0000 front 2024-09-13T18:08:01.674475+0000 (oldest deadline 2024-09-13T18:08:29.275058+0000) 2024-09-13T18:08:33.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:32 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:32.652+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.275696+0000 front 2024-09-13T18:08:09.275614+0000 (oldest deadline 2024-09-13T18:08:32.175641+0000) 2024-09-13T18:08:33.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:32 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:32.886+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:33.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:32 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:32.886+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:33.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:32 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:32.886+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:33.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:32 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:32.886+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:33.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:32 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:32.886+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:33.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:32 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:32.886+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:34.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:33 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:33.654+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:34.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:33 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:33.654+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:34.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:33 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:33.654+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:34.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:33 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:33.654+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:34.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:33 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:33.654+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:34.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:33 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:33.654+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:34.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:33.637+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:34.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:33.637+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:34.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:33.637+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:34.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:33.637+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:34.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:33.637+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:34.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:33.637+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.674699+0000 front 2024-09-13T18:08:01.674475+0000 (oldest deadline 2024-09-13T18:08:29.275058+0000) 2024-09-13T18:08:34.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:33 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:33.637+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.275696+0000 front 2024-09-13T18:08:09.275614+0000 (oldest deadline 2024-09-13T18:08:32.175641+0000) 2024-09-13T18:08:34.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:33 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:33.899+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:34.269 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:33 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:33.899+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:34.270 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:33 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:33.899+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:34.270 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:33 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:33.899+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:34.270 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:33 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:33.899+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:34.270 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:33 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:33.899+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:35.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:34 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:34.617+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:35.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:34 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:34.617+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:35.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:34 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:34.617+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:35.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:34 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:34.617+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:35.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:34 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:34.617+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:35.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:34 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:34.617+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:35.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:34.658+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:35.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:34.658+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:35.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:34.658+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:35.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:34.658+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:35.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:34.658+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:35.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:34.658+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.674699+0000 front 2024-09-13T18:08:01.674475+0000 (oldest deadline 2024-09-13T18:08:29.275058+0000) 2024-09-13T18:08:35.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:34 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:34.658+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.275696+0000 front 2024-09-13T18:08:09.275614+0000 (oldest deadline 2024-09-13T18:08:32.175641+0000) 2024-09-13T18:08:35.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:34 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:34.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:35.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:34 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:34.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:35.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:34 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:34.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:35.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:34 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:34.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:35.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:34 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:34.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:35.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:34 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:34.857+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:36.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:35 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:35.635+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:36.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:35 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:35.635+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:36.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:35 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:35.635+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:36.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:35 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:35.635+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:36.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:35 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:35.635+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:36.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:35 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:35.635+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:36.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:35 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:35.645+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:19.766941+0000 front 2024-09-13T18:07:19.766929+0000 (oldest deadline 2024-09-13T18:07:44.467079+0000) 2024-09-13T18:08:36.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:35 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:35.645+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:30.868796+0000 front 2024-09-13T18:07:30.869035+0000 (oldest deadline 2024-09-13T18:07:53.169014+0000) 2024-09-13T18:08:36.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:35 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:35.645+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:37.770768+0000 front 2024-09-13T18:07:37.770815+0000 (oldest deadline 2024-09-13T18:08:02.470694+0000) 2024-09-13T18:08:36.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:35 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:35.645+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:47.071939+0000 front 2024-09-13T18:07:47.071951+0000 (oldest deadline 2024-09-13T18:08:11.172072+0000) 2024-09-13T18:08:36.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:35 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:35.645+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:53.473371+0000 front 2024-09-13T18:07:53.473658+0000 (oldest deadline 2024-09-13T18:08:17.573382+0000) 2024-09-13T18:08:36.057 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:35 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:35.645+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.674699+0000 front 2024-09-13T18:08:01.674475+0000 (oldest deadline 2024-09-13T18:08:29.275058+0000) 2024-09-13T18:08:36.058 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:35 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9[64802]: 2024-09-13T18:08:35.645+0000 7fb07f200640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.275696+0000 front 2024-09-13T18:08:09.275614+0000 (oldest deadline 2024-09-13T18:08:32.175641+0000) 2024-09-13T18:08:36.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:35 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:35.870+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:36.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:35 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:35.870+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:36.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:35 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:35.870+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:36.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:35 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:35.870+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:36.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:35 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:35.870+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:36.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:35 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:35.870+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:36.532 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:36 smithi027 podman[85169]: 2024-09-13 18:08:36.235263299 +0000 UTC m=+5.602388487 container died 9cf336f3c41ce7fa86905acc6d9070eacd0455de4c110554627fb9daa8e61c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:08:36.807 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:36 smithi027 podman[85169]: 2024-09-13 18:08:36.737571858 +0000 UTC m=+6.104697035 container cleanup 9cf336f3c41ce7fa86905acc6d9070eacd0455de4c110554627fb9daa8e61c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:08:36.807 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:36 smithi027 bash[85169]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9 2024-09-13T18:08:37.025 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:36 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:36.624+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:37.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:36 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:36.624+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:37.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:36 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:36.624+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:37.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:36 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:36.624+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:37.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:36 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:36.624+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:37.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:36 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:36.624+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:37.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:36 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:36.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:37.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:36 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:36.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:37.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:36 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:36.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:37.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:36 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:36.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:37.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:36 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:36.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:37.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:36 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:36.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:37.307 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:37 smithi027 podman[85189]: 2024-09-13 18:08:37.038963662 +0000 UTC m=+0.797159044 container remove 9cf336f3c41ce7fa86905acc6d9070eacd0455de4c110554627fb9daa8e61c92 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T18:08:37.777 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:37 smithi027 podman[85274]: 2024-09-13 18:08:37.523251605 +0000 UTC m=+0.119237590 container create 18c9aefe797f5d21937a96995a39fafef3e69eda76d46908ecb33174f975d051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-13T18:08:37.777 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:37 smithi027 podman[85274]: 2024-09-13 18:08:37.432112966 +0000 UTC m=+0.028098965 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:08:37.777 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:37 smithi027 podman[85274]: 2024-09-13 18:08:37.775805319 +0000 UTC m=+0.371791304 container init 18c9aefe797f5d21937a96995a39fafef3e69eda76d46908ecb33174f975d051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T18:08:38.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:37 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:37.605+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:38.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:37 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:37.605+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:38.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:37 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:37.605+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:38.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:37 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:37.605+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:38.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:37 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:37.605+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:38.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:37 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:37.605+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:38.053 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:37 smithi027 podman[85274]: 2024-09-13 18:08:37.782699984 +0000 UTC m=+0.378685969 container start 18c9aefe797f5d21937a96995a39fafef3e69eda76d46908ecb33174f975d051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T18:08:38.053 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:37 smithi027 podman[85274]: 2024-09-13 18:08:37.875365597 +0000 UTC m=+0.471351594 container attach 18c9aefe797f5d21937a96995a39fafef3e69eda76d46908ecb33174f975d051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T18:08:38.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:37 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:37.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:38.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:37 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:37.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:38.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:37 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:37.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:38.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:37 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:37.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:38.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:37 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:37.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:38.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:37 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:37.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:38.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:37 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:37.868+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.423788+0000 front 2024-09-13T18:08:09.423851+0000 (oldest deadline 2024-09-13T18:08:37.624132+0000) 2024-09-13T18:08:38.307 INFO:journalctl@ceph.osd.9.smithi027.stdout:Sep 13 18:08:38 smithi027 podman[85274]: 2024-09-13 18:08:38.051830669 +0000 UTC m=+0.647816670 container died 18c9aefe797f5d21937a96995a39fafef3e69eda76d46908ecb33174f975d051 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-13T18:08:38.838 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.9.service' 2024-09-13T18:08:38.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:08:38.916 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-13T18:08:38.917 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-13T18:08:38.917 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.10 2024-09-13T18:08:39.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:38 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:38.618+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:39.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:38 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:38.618+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:39.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:38 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:38.618+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:39.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:38 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:38.618+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:39.027 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:38 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:38.618+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:39.027 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:38 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:38.618+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:39.204 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:38 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:38.835+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:39.204 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:38 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:38.835+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:39.204 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:38 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:38.835+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:39.204 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:38 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:38.835+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:39.204 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:38 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:38.835+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:39.204 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:38 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:38.835+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:39.204 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:38 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:38.835+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.423788+0000 front 2024-09-13T18:08:09.423851+0000 (oldest deadline 2024-09-13T18:08:37.624132+0000) 2024-09-13T18:08:39.204 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:38 smithi122 systemd[1]: Stopping Ceph osd.10 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:08:39.464 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.200+0000 7f70dfe76640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:08:39.464 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.200+0000 7f70dfe76640 -1 osd.10 91 *** Got signal Terminated *** 2024-09-13T18:08:39.464 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.200+0000 7f70dfe76640 -1 osd.10 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:08:40.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:39 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:39.639+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:40.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:39 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:39.639+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:40.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:39 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:39.639+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:40.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:39 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:39.639+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:40.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:39 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:39.639+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:40.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:39 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:39.639+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:40.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.833+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:40.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.833+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:40.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.833+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:40.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.833+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:40.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.833+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:40.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.833+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:40.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:39 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:39.833+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.423788+0000 front 2024-09-13T18:08:09.423851+0000 (oldest deadline 2024-09-13T18:08:37.624132+0000) 2024-09-13T18:08:41.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:40 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:40.665+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:41.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:40 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:40.665+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:41.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:40 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:40.665+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:41.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:40 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:40.665+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:41.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:40 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:40.665+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:41.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:40 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:40.665+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:41.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:40 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:40.847+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:41.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:40 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:40.847+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:41.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:40 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:40.847+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:41.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:40 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:40.847+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:41.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:40 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:40.847+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:41.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:40 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:40.847+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:41.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:40 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:40.847+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.423788+0000 front 2024-09-13T18:08:09.423851+0000 (oldest deadline 2024-09-13T18:08:37.624132+0000) 2024-09-13T18:08:42.025 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:41 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:41.647+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:42.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:41 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:41.647+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:42.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:41 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:41.647+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:42.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:41 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:41.647+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:42.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:41 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:41.647+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:42.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:41 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:41.647+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:42.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:41 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:41.803+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:42.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:41 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:41.803+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:42.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:41 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:41.803+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:42.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:41 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:41.803+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:42.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:41 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:41.803+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:42.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:41 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:41.803+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:42.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:41 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:41.803+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.423788+0000 front 2024-09-13T18:08:09.423851+0000 (oldest deadline 2024-09-13T18:08:37.624132+0000) 2024-09-13T18:08:43.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:42 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:42.648+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:43.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:42 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:42.648+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:43.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:42 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:42.648+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:43.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:42 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:42.648+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:43.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:42 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:42.648+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:43.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:42 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:42.648+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:43.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:42 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:42.842+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:43.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:42 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:42.842+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:43.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:42 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:42.842+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:43.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:42 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:42.842+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:43.215 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:42 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:42.842+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:43.216 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:42 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:42.842+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:43.216 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:42 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:42.842+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.423788+0000 front 2024-09-13T18:08:09.423851+0000 (oldest deadline 2024-09-13T18:08:37.624132+0000) 2024-09-13T18:08:44.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:43 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:43.608+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:44.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:43 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:43.608+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:44.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:43 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:43.608+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:44.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:43 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:43.608+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:44.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:43 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:43.608+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:44.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:43 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:43.608+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:44.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:43 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:43.838+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.216675+0000 front 2024-09-13T18:07:22.216846+0000 (oldest deadline 2024-09-13T18:07:48.116778+0000) 2024-09-13T18:08:44.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:43 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:43.838+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:28.117212+0000 front 2024-09-13T18:07:28.117131+0000 (oldest deadline 2024-09-13T18:07:55.117857+0000) 2024-09-13T18:08:44.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:43 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:43.838+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:35.118359+0000 front 2024-09-13T18:07:35.118487+0000 (oldest deadline 2024-09-13T18:08:01.018506+0000) 2024-09-13T18:08:44.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:43 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:43.838+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:43.319330+0000 front 2024-09-13T18:07:43.319278+0000 (oldest deadline 2024-09-13T18:08:12.719623+0000) 2024-09-13T18:08:44.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:43 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:43.838+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:55.521099+0000 front 2024-09-13T18:07:55.521122+0000 (oldest deadline 2024-09-13T18:08:19.521687+0000) 2024-09-13T18:08:44.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:43 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:43.838+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:03.022774+0000 front 2024-09-13T18:08:03.022986+0000 (oldest deadline 2024-09-13T18:08:25.322692+0000) 2024-09-13T18:08:44.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:43 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10[59955]: 2024-09-13T18:08:43.838+0000 7f70dcc7a640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.27:6822 osd.6 since back 2024-09-13T18:08:09.423788+0000 front 2024-09-13T18:08:09.423851+0000 (oldest deadline 2024-09-13T18:08:37.624132+0000) 2024-09-13T18:08:44.911 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:44 smithi122 podman[69439]: 2024-09-13 18:08:44.635833389 +0000 UTC m=+5.531843567 container died ca6b16ab3c2fa73fdf1923bfc9b7a19d4331814fca4132c649a97cb62a04e74d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:08:45.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:44 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:44.564+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:45.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:44 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:44.564+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:45.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:44 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:44.564+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:45.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:44 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:44.564+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:45.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:44 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:44.564+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:45.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:44 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:44.564+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:45.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:44 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:44.564+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6820 osd.7 since back 2024-09-13T18:08:19.250801+0000 front 2024-09-13T18:08:19.250788+0000 (oldest deadline 2024-09-13T18:08:43.950638+0000) 2024-09-13T18:08:45.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:45 smithi122 podman[69439]: 2024-09-13 18:08:45.000506479 +0000 UTC m=+5.896516643 container cleanup ca6b16ab3c2fa73fdf1923bfc9b7a19d4331814fca4132c649a97cb62a04e74d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:08:45.214 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:45 smithi122 bash[69439]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10 2024-09-13T18:08:45.619 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:45 smithi122 podman[69455]: 2024-09-13 18:08:45.310353246 +0000 UTC m=+0.668857885 container remove ca6b16ab3c2fa73fdf1923bfc9b7a19d4331814fca4132c649a97cb62a04e74d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T18:08:45.775 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:45 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:45.522+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:45.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:45 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:45.522+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:45.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:45 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:45.522+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:45.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:45 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:45.522+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:45.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:45 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:45.522+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:45.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:45 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:45.522+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:45.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:45 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:45.522+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6820 osd.7 since back 2024-09-13T18:08:19.250801+0000 front 2024-09-13T18:08:19.250788+0000 (oldest deadline 2024-09-13T18:08:43.950638+0000) 2024-09-13T18:08:45.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:45 smithi122 podman[69542]: 2024-09-13 18:08:45.520255152 +0000 UTC m=+0.015717079 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:08:45.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:45 smithi122 podman[69542]: 2024-09-13 18:08:45.619212664 +0000 UTC m=+0.114674570 container create 547ce8895bbe712eada990d8224580459059e0c3498db736998596d0b6746d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10-deactivate, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T18:08:45.964 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:45 smithi122 podman[69542]: 2024-09-13 18:08:45.855198952 +0000 UTC m=+0.350660859 container init 547ce8895bbe712eada990d8224580459059e0c3498db736998596d0b6746d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T18:08:45.965 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:45 smithi122 podman[69542]: 2024-09-13 18:08:45.858519929 +0000 UTC m=+0.353981840 container start 547ce8895bbe712eada990d8224580459059e0c3498db736998596d0b6746d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-13T18:08:46.318 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:45 smithi122 podman[69542]: 2024-09-13 18:08:45.963189304 +0000 UTC m=+0.458651212 container attach 547ce8895bbe712eada990d8224580459059e0c3498db736998596d0b6746d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T18:08:46.318 INFO:journalctl@ceph.osd.10.smithi122.stdout:Sep 13 18:08:46 smithi122 podman[69542]: 2024-09-13 18:08:46.042144824 +0000 UTC m=+0.537606745 container died 547ce8895bbe712eada990d8224580459059e0c3498db736998596d0b6746d4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T18:08:46.602 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.10.service' 2024-09-13T18:08:46.642 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:08:46.642 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-13T18:08:46.642 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-13T18:08:46.642 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.11 2024-09-13T18:08:46.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:46 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:46.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:46.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:46 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:46.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:46.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:46 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:46.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:46.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:46 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:46.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:46.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:46 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:46.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:46.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:46 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:46.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:46.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:46 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:46.507+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6820 osd.7 since back 2024-09-13T18:08:19.250801+0000 front 2024-09-13T18:08:19.250788+0000 (oldest deadline 2024-09-13T18:08:43.950638+0000) 2024-09-13T18:08:46.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:46 smithi143 systemd[1]: Stopping Ceph osd.11 for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:08:47.526 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.055+0000 7f8d8e808640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:08:47.526 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.055+0000 7f8d8e808640 -1 osd.11 91 *** Got signal Terminated *** 2024-09-13T18:08:47.526 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.055+0000 7f8d8e808640 -1 osd.11 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T18:08:48.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.539+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:48.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.539+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:48.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.539+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:48.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.539+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:48.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.539+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:48.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.539+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:48.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:47 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:47.539+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6820 osd.7 since back 2024-09-13T18:08:19.250801+0000 front 2024-09-13T18:08:19.250788+0000 (oldest deadline 2024-09-13T18:08:43.950638+0000) 2024-09-13T18:08:48.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:48 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:48.506+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:48.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:48 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:48.506+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:48.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:48 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:48.506+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:48.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:48 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:48.506+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:48.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:48 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:48.506+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:48.776 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:48 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:48.506+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:48.777 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:48 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:48.506+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6820 osd.7 since back 2024-09-13T18:08:19.250801+0000 front 2024-09-13T18:08:19.250788+0000 (oldest deadline 2024-09-13T18:08:43.950638+0000) 2024-09-13T18:08:50.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:49.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:50.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:49.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:50.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:49.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:50.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:49.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:50.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:49.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:50.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:49.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:50.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:49.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6820 osd.7 since back 2024-09-13T18:08:19.250801+0000 front 2024-09-13T18:08:19.250788+0000 (oldest deadline 2024-09-13T18:08:43.950638+0000) 2024-09-13T18:08:50.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:49 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:49.548+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6820 osd.8 since back 2024-09-13T18:08:23.951008+0000 front 2024-09-13T18:08:23.951022+0000 (oldest deadline 2024-09-13T18:08:49.251051+0000) 2024-09-13T18:08:51.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:50.555+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:51.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:50.555+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:51.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:50.555+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:51.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:50.555+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:51.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:50.555+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:51.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:50.555+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:51.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:50.555+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6820 osd.7 since back 2024-09-13T18:08:19.250801+0000 front 2024-09-13T18:08:19.250788+0000 (oldest deadline 2024-09-13T18:08:43.950638+0000) 2024-09-13T18:08:51.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:50 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:50.555+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6820 osd.8 since back 2024-09-13T18:08:23.951008+0000 front 2024-09-13T18:08:23.951022+0000 (oldest deadline 2024-09-13T18:08:49.251051+0000) 2024-09-13T18:08:52.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:51.540+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6806 osd.0 since back 2024-09-13T18:07:22.741918+0000 front 2024-09-13T18:07:22.741940+0000 (oldest deadline 2024-09-13T18:07:46.841665+0000) 2024-09-13T18:08:52.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:51.540+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6804 osd.1 since back 2024-09-13T18:07:26.842254+0000 front 2024-09-13T18:07:26.842301+0000 (oldest deadline 2024-09-13T18:07:52.142327+0000) 2024-09-13T18:08:52.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:51.540+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6804 osd.2 since back 2024-09-13T18:07:36.743922+0000 front 2024-09-13T18:07:36.743935+0000 (oldest deadline 2024-09-13T18:08:01.443953+0000) 2024-09-13T18:08:52.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:51.540+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.27:6814 osd.3 since back 2024-09-13T18:07:44.245273+0000 front 2024-09-13T18:07:44.245382+0000 (oldest deadline 2024-09-13T18:08:07.745216+0000) 2024-09-13T18:08:52.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:51.540+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6812 osd.4 since back 2024-09-13T18:07:52.347045+0000 front 2024-09-13T18:07:52.347159+0000 (oldest deadline 2024-09-13T18:08:18.246949+0000) 2024-09-13T18:08:52.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:51.540+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6812 osd.5 since back 2024-09-13T18:08:01.147983+0000 front 2024-09-13T18:08:01.148042+0000 (oldest deadline 2024-09-13T18:08:24.648074+0000) 2024-09-13T18:08:52.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:51.540+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.122:6820 osd.7 since back 2024-09-13T18:08:19.250801+0000 front 2024-09-13T18:08:19.250788+0000 (oldest deadline 2024-09-13T18:08:43.950638+0000) 2024-09-13T18:08:52.026 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:51 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11[63287]: 2024-09-13T18:08:51.540+0000 7f8d8b60c640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.143:6820 osd.8 since back 2024-09-13T18:08:23.951008+0000 front 2024-09-13T18:08:23.951022+0000 (oldest deadline 2024-09-13T18:08:49.251051+0000) 2024-09-13T18:08:52.891 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:52 smithi143 podman[72949]: 2024-09-13 18:08:52.605158344 +0000 UTC m=+5.766368022 container died c25255dd84c38b1ae05ecbbc2a7199b2b03e4eb38bedb6ec926e61f20d26d079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T18:08:53.241 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:52 smithi143 podman[72949]: 2024-09-13 18:08:52.963217432 +0000 UTC m=+6.124427111 container cleanup c25255dd84c38b1ae05ecbbc2a7199b2b03e4eb38bedb6ec926e61f20d26d079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:08:53.241 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:52 smithi143 bash[72949]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11 2024-09-13T18:08:53.525 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:53 smithi143 podman[72964]: 2024-09-13 18:08:53.239423979 +0000 UTC m=+0.635590574 container remove c25255dd84c38b1ae05ecbbc2a7199b2b03e4eb38bedb6ec926e61f20d26d079 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083) 2024-09-13T18:08:53.835 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:53 smithi143 podman[73056]: 2024-09-13 18:08:53.451122039 +0000 UTC m=+0.015755385 image pull 8a91f241d7d4e1d6e26ee4f6ee67f99a623a7da71bd993082f39318b3b5efc61 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256 2024-09-13T18:08:53.835 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:53 smithi143 podman[73056]: 2024-09-13 18:08:53.548352853 +0000 UTC m=+0.112986178 container create 5b64976adbf9bdc9fb4572ac5b26982f239acf6e0fd42be44787ff41bf35b09e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T18:08:53.835 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:53 smithi143 podman[73056]: 2024-09-13 18:08:53.759179752 +0000 UTC m=+0.323813078 container init 5b64976adbf9bdc9fb4572ac5b26982f239acf6e0fd42be44787ff41bf35b09e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T18:08:53.836 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:53 smithi143 podman[73056]: 2024-09-13 18:08:53.762525855 +0000 UTC m=+0.327159180 container start 5b64976adbf9bdc9fb4572ac5b26982f239acf6e0fd42be44787ff41bf35b09e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-13T18:08:53.836 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:53 smithi143 podman[73056]: 2024-09-13 18:08:53.83398458 +0000 UTC m=+0.398617920 container attach 5b64976adbf9bdc9fb4572ac5b26982f239acf6e0fd42be44787ff41bf35b09e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-13T18:08:54.221 INFO:journalctl@ceph.osd.11.smithi143.stdout:Sep 13 18:08:53 smithi143 podman[73056]: 2024-09-13 18:08:53.949103725 +0000 UTC m=+0.513737053 container died 5b64976adbf9bdc9fb4572ac5b26982f239acf6e0fd42be44787ff41bf35b09e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-13T18:08:54.501 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@osd.11.service' 2024-09-13T18:08:54.540 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:08:54.540 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-13T18:08:54.540 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-13T18:08:54.541 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.a 2024-09-13T18:08:55.057 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:08:54 smithi027 systemd[1]: Stopping Ceph mds.a for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:08:55.557 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:08:55 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-a[71160]: 2024-09-13T18:08:55.075+0000 7f97bfc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:08:55.557 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:08:55 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-a[71160]: 2024-09-13T18:08:55.075+0000 7f97bfc00640 -1 mds.a *** got signal Terminated *** 2024-09-13T18:08:58.374 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:08:58 smithi027 podman[85372]: 2024-09-13 18:08:58.057189388 +0000 UTC m=+3.225318142 container died e5e17e48b4294b19ba515a68208c161d22efe4d3977d44a445fdbfa1d0ddb826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-a, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0) 2024-09-13T18:08:58.760 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:08:58 smithi027 podman[85372]: 2024-09-13 18:08:58.581977737 +0000 UTC m=+3.750106477 container cleanup e5e17e48b4294b19ba515a68208c161d22efe4d3977d44a445fdbfa1d0ddb826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-13T18:08:58.760 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:08:58 smithi027 bash[85372]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-a 2024-09-13T18:08:59.018 INFO:journalctl@ceph.mds.a.smithi027.stdout:Sep 13 18:08:58 smithi027 podman[85384]: 2024-09-13 18:08:58.758335475 +0000 UTC m=+0.686463433 container remove e5e17e48b4294b19ba515a68208c161d22efe4d3977d44a445fdbfa1d0ddb826 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-13T18:08:59.036 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.a.service' 2024-09-13T18:08:59.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:08:59.109 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-13T18:08:59.109 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-13T18:08:59.109 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.d 2024-09-13T18:08:59.307 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:08:59 smithi027 systemd[1]: Stopping Ceph mds.d for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:00.057 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:08:59 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-d[70224]: 2024-09-13T18:08:59.639+0000 7f87a4000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:00.057 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:08:59 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-d[70224]: 2024-09-13T18:08:59.639+0000 7f87a4000640 -1 mds.d *** got signal Terminated *** 2024-09-13T18:09:02.447 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:09:02 smithi027 podman[85491]: 2024-09-13 18:09:02.141112231 +0000 UTC m=+2.752783965 container died 0b503c24d687afe8475cc15d915e88d7c0ceb9a9ea2e5eef78a6370370a48363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T18:09:02.788 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:09:02 smithi027 podman[85491]: 2024-09-13 18:09:02.594077835 +0000 UTC m=+3.205749573 container cleanup 0b503c24d687afe8475cc15d915e88d7c0ceb9a9ea2e5eef78a6370370a48363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T18:09:02.789 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:09:02 smithi027 bash[85491]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-d 2024-09-13T18:09:03.057 INFO:journalctl@ceph.mds.d.smithi027.stdout:Sep 13 18:09:02 smithi027 podman[85503]: 2024-09-13 18:09:02.786801967 +0000 UTC m=+0.630360209 container remove 0b503c24d687afe8475cc15d915e88d7c0ceb9a9ea2e5eef78a6370370a48363 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-d, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T18:09:03.105 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.d.service' 2024-09-13T18:09:03.175 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:03.175 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-13T18:09:03.175 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-13T18:09:03.176 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.g 2024-09-13T18:09:03.557 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:09:03 smithi027 systemd[1]: Stopping Ceph mds.g for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:04.057 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:09:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g[70779]: 2024-09-13T18:09:03.625+0000 7fd2a3c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:04.057 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:09:03 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g[70779]: 2024-09-13T18:09:03.625+0000 7fd2a3c00640 -1 mds.g *** got signal Terminated *** 2024-09-13T18:09:06.307 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:09:06 smithi027 podman[85611]: 2024-09-13 18:09:06.046023577 +0000 UTC m=+2.588165412 container died 352630ec46bdb43dfe39110d74bab861f529c8596cd49e9dd1306e0cd2fa50d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T18:09:06.734 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:09:06 smithi027 podman[85611]: 2024-09-13 18:09:06.481165186 +0000 UTC m=+3.023307020 container cleanup 352630ec46bdb43dfe39110d74bab861f529c8596cd49e9dd1306e0cd2fa50d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:09:06.734 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:09:06 smithi027 bash[85611]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g 2024-09-13T18:09:07.019 INFO:journalctl@ceph.mds.g.smithi027.stdout:Sep 13 18:09:06 smithi027 podman[85624]: 2024-09-13 18:09:06.732355794 +0000 UTC m=+0.668797483 container remove 352630ec46bdb43dfe39110d74bab861f529c8596cd49e9dd1306e0cd2fa50d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-g, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:09:07.048 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.g.service' 2024-09-13T18:09:07.120 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:07.120 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-13T18:09:07.120 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-13T18:09:07.121 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.j 2024-09-13T18:09:07.307 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:09:07 smithi027 systemd[1]: Stopping Ceph mds.j for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:07.807 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:09:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j[69834]: 2024-09-13T18:09:07.506+0000 7f20e8e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:07.807 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:09:07 smithi027 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j[69834]: 2024-09-13T18:09:07.506+0000 7f20e8e00640 -1 mds.j *** got signal Terminated *** 2024-09-13T18:09:11.155 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:09:10 smithi027 podman[85733]: 2024-09-13 18:09:10.818375428 +0000 UTC m=+3.423822805 container died b54a53cda8c311bacd431543bdb42f29b090deb7149a8b4ba2d928037bf12c2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-13T18:09:11.448 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:09:11 smithi027 podman[85733]: 2024-09-13 18:09:11.282090333 +0000 UTC m=+3.887537706 container cleanup b54a53cda8c311bacd431543bdb42f29b090deb7149a8b4ba2d928037bf12c2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T18:09:11.448 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:09:11 smithi027 bash[85733]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j 2024-09-13T18:09:11.706 INFO:journalctl@ceph.mds.j.smithi027.stdout:Sep 13 18:09:11 smithi027 podman[85756]: 2024-09-13 18:09:11.445798776 +0000 UTC m=+0.620019149 container remove b54a53cda8c311bacd431543bdb42f29b090deb7149a8b4ba2d928037bf12c2f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-j, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T18:09:11.714 DEBUG:teuthology.orchestra.run.smithi027:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.j.service' 2024-09-13T18:09:11.788 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:11.788 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-13T18:09:11.788 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-13T18:09:11.788 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.b 2024-09-13T18:09:12.085 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:09:11 smithi122 systemd[1]: Stopping Ceph mds.b for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:12.464 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:09:12 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b[65606]: 2024-09-13T18:09:12.083+0000 7f570e030640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:12.464 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:09:12 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b[65606]: 2024-09-13T18:09:12.083+0000 7f570e030640 -1 mds.b *** got signal Terminated *** 2024-09-13T18:09:14.320 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:09:13 smithi122 podman[69643]: 2024-09-13 18:09:13.998453055 +0000 UTC m=+2.026031445 container died 2cd571312c4550df9bc5157cc53c505e45b3ecb43e475248eef2fd2db768482b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-13T18:09:14.628 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:09:14 smithi122 podman[69643]: 2024-09-13 18:09:14.408409443 +0000 UTC m=+2.435987826 container cleanup 2cd571312c4550df9bc5157cc53c505e45b3ecb43e475248eef2fd2db768482b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T18:09:14.628 INFO:journalctl@ceph.mds.b.smithi122.stdout:Sep 13 18:09:14 smithi122 bash[69643]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-b 2024-09-13T18:09:14.765 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.b.service' 2024-09-13T18:09:14.801 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:14.802 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-13T18:09:14.802 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-13T18:09:14.802 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.e 2024-09-13T18:09:15.214 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:09:14 smithi122 systemd[1]: Stopping Ceph mds.e for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:15.214 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:09:15 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e[64997]: 2024-09-13T18:09:15.120+0000 7fa497a92640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:15.214 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:09:15 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e[64997]: 2024-09-13T18:09:15.120+0000 7fa497a92640 -1 mds.e *** got signal Terminated *** 2024-09-13T18:09:18.273 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:09:17 smithi122 podman[69777]: 2024-09-13 18:09:17.987949215 +0000 UTC m=+2.968122647 container died f9e4ac08501cb4e62303c95cc8d1bddc3cc4ec46031eb148bcc5ea45ca2be3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T18:09:18.632 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:09:18 smithi122 podman[69777]: 2024-09-13 18:09:18.384013057 +0000 UTC m=+3.364186478 container cleanup f9e4ac08501cb4e62303c95cc8d1bddc3cc4ec46031eb148bcc5ea45ca2be3dd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:09:18.632 INFO:journalctl@ceph.mds.e.smithi122.stdout:Sep 13 18:09:18 smithi122 bash[69777]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-e 2024-09-13T18:09:18.773 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.e.service' 2024-09-13T18:09:18.807 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:18.807 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-13T18:09:18.807 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-13T18:09:18.808 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.h 2024-09-13T18:09:19.214 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:09:18 smithi122 systemd[1]: Stopping Ceph mds.h for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:19.214 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:09:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h[65299]: 2024-09-13T18:09:19.123+0000 7fe59932c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:19.214 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:09:19 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h[65299]: 2024-09-13T18:09:19.123+0000 7fe59932c640 -1 mds.h *** got signal Terminated *** 2024-09-13T18:09:22.277 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:09:22 smithi122 podman[69897]: 2024-09-13 18:09:22.01328165 +0000 UTC m=+2.996342596 container died 66dd7dec73693d57eee8b95a6f9a19e6693b5b61a6dc9851129e4da36adae591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T18:09:22.644 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:09:22 smithi122 podman[69897]: 2024-09-13 18:09:22.365939434 +0000 UTC m=+3.349000366 container cleanup 66dd7dec73693d57eee8b95a6f9a19e6693b5b61a6dc9851129e4da36adae591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T18:09:22.644 INFO:journalctl@ceph.mds.h.smithi122.stdout:Sep 13 18:09:22 smithi122 bash[69897]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-h 2024-09-13T18:09:22.768 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.h.service' 2024-09-13T18:09:22.801 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:22.801 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-13T18:09:22.802 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-13T18:09:22.802 DEBUG:teuthology.orchestra.run.smithi122:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.k 2024-09-13T18:09:22.964 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:09:22 smithi122 systemd[1]: Stopping Ceph mds.k for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:23.464 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:09:23 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k[64683]: 2024-09-13T18:09:23.127+0000 7efe4bb47640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:23.464 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:09:23 smithi122 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k[64683]: 2024-09-13T18:09:23.127+0000 7efe4bb47640 -1 mds.k *** got signal Terminated *** 2024-09-13T18:09:26.338 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:09:26 smithi122 podman[70019]: 2024-09-13 18:09:26.014496005 +0000 UTC m=+3.000118438 container died 894f3c91308dff514c15012b747544469f43347759a1561b7ca65bd1129f8d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T18:09:26.338 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:09:26 smithi122 podman[70019]: 2024-09-13 18:09:26.336481402 +0000 UTC m=+3.322103834 container cleanup 894f3c91308dff514c15012b747544469f43347759a1561b7ca65bd1129f8d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T18:09:26.714 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:09:26 smithi122 bash[70019]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k 2024-09-13T18:09:26.714 INFO:journalctl@ceph.mds.k.smithi122.stdout:Sep 13 18:09:26 smithi122 podman[70032]: 2024-09-13 18:09:26.537575748 +0000 UTC m=+0.523800697 container remove 894f3c91308dff514c15012b747544469f43347759a1561b7ca65bd1129f8d3b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-09-13T18:09:26.765 DEBUG:teuthology.orchestra.run.smithi122:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.k.service' 2024-09-13T18:09:26.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:26.797 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-13T18:09:26.797 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-13T18:09:26.798 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.c 2024-09-13T18:09:27.097 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:09:26 smithi143 systemd[1]: Stopping Ceph mds.c for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:27.526 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:09:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c[68734]: 2024-09-13T18:09:27.127+0000 7ffa47361640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:27.526 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:09:27 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c[68734]: 2024-09-13T18:09:27.127+0000 7ffa47361640 -1 mds.c *** got signal Terminated *** 2024-09-13T18:09:30.276 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:09:30 smithi143 podman[73171]: 2024-09-13 18:09:30.00596031 +0000 UTC m=+3.018039184 container died 28518d241256de01e48c552433661e3d0ddc41be966669bc67829d8f2ec10122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c, ceph=True, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-13T18:09:30.616 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:09:30 smithi143 podman[73171]: 2024-09-13 18:09:30.368836649 +0000 UTC m=+3.380915523 container cleanup 28518d241256de01e48c552433661e3d0ddc41be966669bc67829d8f2ec10122 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T18:09:30.617 INFO:journalctl@ceph.mds.c.smithi143.stdout:Sep 13 18:09:30 smithi143 bash[73171]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-c 2024-09-13T18:09:30.748 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.c.service' 2024-09-13T18:09:30.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:30.785 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-13T18:09:30.785 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-13T18:09:30.785 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.f 2024-09-13T18:09:31.026 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:09:30 smithi143 systemd[1]: Stopping Ceph mds.f for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:31.525 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:09:31 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f[68433]: 2024-09-13T18:09:31.122+0000 7fbc97f13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:31.526 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:09:31 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f[68433]: 2024-09-13T18:09:31.122+0000 7fbc97f13640 -1 mds.f *** got signal Terminated *** 2024-09-13T18:09:34.275 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:09:33 smithi143 podman[73302]: 2024-09-13 18:09:33.993875807 +0000 UTC m=+2.995435050 container died 99127e990e2b2c6e845c19f938da84efe97d32cd2df9929a625192eff5d273bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-13T18:09:34.616 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:09:34 smithi143 podman[73302]: 2024-09-13 18:09:34.38909957 +0000 UTC m=+3.390658843 container cleanup 99127e990e2b2c6e845c19f938da84efe97d32cd2df9929a625192eff5d273bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2) 2024-09-13T18:09:34.617 INFO:journalctl@ceph.mds.f.smithi143.stdout:Sep 13 18:09:34 smithi143 bash[73302]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-f 2024-09-13T18:09:34.773 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.f.service' 2024-09-13T18:09:34.807 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:34.807 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-13T18:09:34.807 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-13T18:09:34.807 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.i 2024-09-13T18:09:35.276 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:09:34 smithi143 systemd[1]: Stopping Ceph mds.i for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:35.276 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:09:35 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i[69035]: 2024-09-13T18:09:35.109+0000 7fe84b8b1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:35.276 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:09:35 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i[69035]: 2024-09-13T18:09:35.109+0000 7fe84b8b1640 -1 mds.i *** got signal Terminated *** 2024-09-13T18:09:38.261 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:09:37 smithi143 podman[73421]: 2024-09-13 18:09:37.997827929 +0000 UTC m=+2.981035556 container died a121b6f20c09062fe850266b4b97a797dff11f22fd50b7bfd48900031be8d1ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T18:09:38.526 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:09:38 smithi143 podman[73421]: 2024-09-13 18:09:38.350720709 +0000 UTC m=+3.333928333 container cleanup a121b6f20c09062fe850266b4b97a797dff11f22fd50b7bfd48900031be8d1ec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T18:09:38.526 INFO:journalctl@ceph.mds.i.smithi143.stdout:Sep 13 18:09:38 smithi143 bash[73421]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-i 2024-09-13T18:09:38.779 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.i.service' 2024-09-13T18:09:38.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:38.814 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-13T18:09:38.815 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-13T18:09:38.815 DEBUG:teuthology.orchestra.run.smithi143:> sudo systemctl stop ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.l 2024-09-13T18:09:39.275 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:09:38 smithi143 systemd[1]: Stopping Ceph mds.l for f5527e2e-71f8-11ef-bceb-c7b262605968... 2024-09-13T18:09:39.276 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:09:39 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l[68119]: 2024-09-13T18:09:39.112+0000 7f5ef1005640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T18:09:39.276 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:09:39 smithi143 ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l[68119]: 2024-09-13T18:09:39.112+0000 7f5ef1005640 -1 mds.l *** got signal Terminated *** 2024-09-13T18:09:42.272 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:09:42 smithi143 podman[73542]: 2024-09-13 18:09:42.008644184 +0000 UTC m=+2.981941100 container died 27f3b385b71654aaf24b71dac0d1f18e5cad6516d84abff025b91c6d492813fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T18:09:42.526 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:09:42 smithi143 podman[73542]: 2024-09-13 18:09:42.362253073 +0000 UTC m=+3.335549987 container cleanup 27f3b385b71654aaf24b71dac0d1f18e5cad6516d84abff025b91c6d492813fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:71670858e25918b847e38c5069e48a496647b62c9399b70b7ae1aa13108cb256, name=ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240910.100730-reef-6c6b083, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-13T18:09:42.526 INFO:journalctl@ceph.mds.l.smithi143.stdout:Sep 13 18:09:42 smithi143 bash[73542]: ceph-f5527e2e-71f8-11ef-bceb-c7b262605968-mds-l 2024-09-13T18:09:42.788 DEBUG:teuthology.orchestra.run.smithi143:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5527e2e-71f8-11ef-bceb-c7b262605968@mds.l.service' 2024-09-13T18:09:42.819 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T18:09:42.820 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-13T18:09:42.820 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T18:09:43.049 INFO:teuthology.orchestra.run.smithi027.stdout:Deleting cluster with fsid: f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T18:09:46.759 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T18:09:46.918 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T18:09:49.179 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T18:09:49.331 INFO:teuthology.orchestra.run.smithi143.stdout:Deleting cluster with fsid: f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T18:09:51.467 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:09:51.532 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:09:51.566 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T18:09:51.593 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T18:09:51.594 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937/remote/smithi027/crash 2024-09-13T18:09:51.595 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/crash -- . 2024-09-13T18:09:51.654 INFO:teuthology.orchestra.run.smithi027.stderr:tar: /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T18:09:51.654 INFO:teuthology.orchestra.run.smithi027.stderr:tar: Error is not recoverable: exiting now 2024-09-13T18:09:51.657 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937/remote/smithi122/crash 2024-09-13T18:09:51.658 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/crash -- . 2024-09-13T18:09:51.697 INFO:teuthology.orchestra.run.smithi122.stderr:tar: /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T18:09:51.698 INFO:teuthology.orchestra.run.smithi122.stderr:tar: Error is not recoverable: exiting now 2024-09-13T18:09:51.700 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937/remote/smithi143/crash 2024-09-13T18:09:51.701 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/crash -- . 2024-09-13T18:09:51.728 INFO:teuthology.orchestra.run.smithi143.stderr:tar: /var/lib/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T18:09:51.728 INFO:teuthology.orchestra.run.smithi143.stderr:tar: Error is not recoverable: exiting now 2024-09-13T18:09:51.729 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T18:09:51.729 DEBUG:teuthology.orchestra.run.smithi027:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T18:09:51.805 INFO:teuthology.orchestra.run.smithi027.stderr:grep: /var/log/ceph/f5527e2e-71f8-11ef-bceb-c7b262605968/ceph.log: No such file or directory 2024-09-13T18:09:51.811 INFO:tasks.cephadm:Compressing logs... 2024-09-13T18:09:51.811 DEBUG:teuthology.orchestra.run.smithi027:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:09:51.815 DEBUG:teuthology.orchestra.run.smithi122:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:09:51.817 DEBUG:teuthology.orchestra.run.smithi143:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:09:51.841 INFO:teuthology.orchestra.run.smithi143.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T18:09:51.842 INFO:teuthology.orchestra.run.smithi122.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T18:09:51.866 INFO:teuthology.orchestra.run.smithi027.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-13T18:10:28.814 INFO:tasks.cephadm:Archiving logs... 2024-09-13T18:10:28.815 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937/remote/smithi027/log 2024-09-13T18:10:28.816 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:10:29.765 DEBUG:teuthology.misc:Transferring archived files from smithi122:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937/remote/smithi122/log 2024-09-13T18:10:29.766 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:10:34.233 DEBUG:teuthology.misc:Transferring archived files from smithi143:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937/remote/smithi143/log 2024-09-13T18:10:34.234 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:10:35.517 INFO:tasks.cephadm:Removing cluster... 2024-09-13T18:10:35.518 DEBUG:teuthology.orchestra.run.smithi027:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 --force 2024-09-13T18:10:35.748 INFO:teuthology.orchestra.run.smithi027.stdout:Deleting cluster with fsid: f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T18:10:36.250 DEBUG:teuthology.orchestra.run.smithi122:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 --force 2024-09-13T18:10:36.402 INFO:teuthology.orchestra.run.smithi122.stdout:Deleting cluster with fsid: f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T18:10:36.957 DEBUG:teuthology.orchestra.run.smithi143:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5527e2e-71f8-11ef-bceb-c7b262605968 --force 2024-09-13T18:10:37.110 INFO:teuthology.orchestra.run.smithi143.stdout:Deleting cluster with fsid: f5527e2e-71f8-11ef-bceb-c7b262605968 2024-09-13T18:10:37.382 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T18:10:37.383 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T18:10:37.423 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T18:10:37.440 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T18:10:37.456 INFO:tasks.cephadm:Teardown complete 2024-09-13T18:10:37.456 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:10:37.466 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:10:37.466 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:10:37.470 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:10:37.482 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:10:37.626 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:10:37.638 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:10:37.638 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:10:37.643 DEBUG:teuthology.orchestra.run.smithi122:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:10:37.645 DEBUG:teuthology.orchestra.run.smithi143:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:10:37.658 INFO:teuthology.orchestra.run.smithi122.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:10:37.660 INFO:teuthology.orchestra.run.smithi143.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:10:37.663 INFO:teuthology.orchestra.run.smithi122.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:10:37.663 INFO:teuthology.orchestra.run.smithi122.stdout:=============================================================================== 2024-09-13T18:10:37.663 INFO:teuthology.orchestra.run.smithi122.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 -994us[-1000us] +/- 62ms 2024-09-13T18:10:37.663 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 33 +1929us[+1922us] +/- 59ms 2024-09-13T18:10:37.664 INFO:teuthology.orchestra.run.smithi122.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 -1427us[-1433us] +/- 78ms 2024-09-13T18:10:37.664 INFO:teuthology.orchestra.run.smithi122.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:10:37.664 INFO:teuthology.orchestra.run.smithi143.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:10:37.665 INFO:teuthology.orchestra.run.smithi143.stdout:=============================================================================== 2024-09-13T18:10:37.665 INFO:teuthology.orchestra.run.smithi143.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 -940us[ -930us] +/- 62ms 2024-09-13T18:10:37.665 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 34 +1976us[+1986us] +/- 59ms 2024-09-13T18:10:37.665 INFO:teuthology.orchestra.run.smithi143.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 -1381us[-1371us] +/- 78ms 2024-09-13T18:10:37.665 INFO:teuthology.orchestra.run.smithi143.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:10:37.675 INFO:teuthology.orchestra.run.smithi027.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:10:37.683 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:10:37.683 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2024-09-13T18:10:37.683 INFO:teuthology.orchestra.run.smithi027.stdout:^* hv01.front.sepia.ceph.com 3 6 377 33 -960us[ -937us] +/- 62ms 2024-09-13T18:10:37.683 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 +1939us[+1939us] +/- 59ms 2024-09-13T18:10:37.683 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 30 -1416us[-1416us] +/- 78ms 2024-09-13T18:10:37.683 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:10:37.684 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:10:37.693 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:10:37.694 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:10:37.703 DEBUG:teuthology.orchestra.run.smithi027:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:10:37.855 DEBUG:teuthology.orchestra.run.smithi122:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:10:37.924 DEBUG:teuthology.orchestra.run.smithi143:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:10:37.991 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T18:10:38.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:38.054 DEBUG:teuthology.orchestra.run.smithi122:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T18:10:38.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:38.083 DEBUG:teuthology.orchestra.run.smithi143:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-13T18:10:38.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:38.111 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:10:38.121 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:10:38.131 INFO:teuthology.task.internal:Duration was 1489.508752 seconds 2024-09-13T18:10:38.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:10:38.140 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:10:38.140 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:10:38.145 DEBUG:teuthology.orchestra.run.smithi122:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:10:38.147 DEBUG:teuthology.orchestra.run.smithi143:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:10:38.184 INFO:teuthology.orchestra.run.smithi122.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:10:38.189 INFO:teuthology.orchestra.run.smithi143.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:10:38.231 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:10:38.502 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:10:38.503 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2024-09-13T18:10:38.503 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:10:38.555 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi122.front.sepia.ceph.com 2024-09-13T18:10:38.555 DEBUG:teuthology.orchestra.run.smithi122:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:10:38.585 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi143.front.sepia.ceph.com 2024-09-13T18:10:38.586 DEBUG:teuthology.orchestra.run.smithi143:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:10:38.606 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:10:38.607 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:10:38.611 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:10:38.629 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:10:38.673 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:10:38.673 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:10:38.677 DEBUG:teuthology.orchestra.run.smithi122:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:10:38.696 DEBUG:teuthology.orchestra.run.smithi143:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:10:39.156 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:10:39.166 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:10:39.166 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:10:39.224 DEBUG:teuthology.orchestra.run.smithi122:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:10:39.249 DEBUG:teuthology.orchestra.run.smithi143:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:10:39.275 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:10:39.285 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:10:39.290 DEBUG:teuthology.orchestra.run.smithi122:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:10:39.292 DEBUG:teuthology.orchestra.run.smithi143:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:10:39.314 INFO:teuthology.orchestra.run.smithi122.stdout:kernel.core_pattern = core 2024-09-13T18:10:39.338 INFO:teuthology.orchestra.run.smithi143.stdout:kernel.core_pattern = core 2024-09-13T18:10:39.357 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2024-09-13T18:10:39.388 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:10:39.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:39.423 DEBUG:teuthology.orchestra.run.smithi122:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:10:39.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:39.438 DEBUG:teuthology.orchestra.run.smithi143:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:10:39.452 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:10:39.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:10:39.463 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:10:39.464 DEBUG:teuthology.misc:Transferring archived files from smithi027:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937/remote/smithi027 2024-09-13T18:10:39.464 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:10:39.538 DEBUG:teuthology.misc:Transferring archived files from smithi122:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937/remote/smithi122 2024-09-13T18:10:39.538 DEBUG:teuthology.orchestra.run.smithi122:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:10:39.573 DEBUG:teuthology.misc:Transferring archived files from smithi143:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903937/remote/smithi143 2024-09-13T18:10:39.574 DEBUG:teuthology.orchestra.run.smithi143:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:10:39.612 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:10:39.612 DEBUG:teuthology.orchestra.run.smithi027:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:10:39.616 DEBUG:teuthology.orchestra.run.smithi122:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:10:39.619 DEBUG:teuthology.orchestra.run.smithi143:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:10:39.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:10:39.673 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:10:39.674 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:10:39.684 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:10:39.684 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:10:39.693 DEBUG:teuthology.orchestra.run.smithi122:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:10:39.695 DEBUG:teuthology.orchestra.run.smithi143:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:10:39.708 INFO:teuthology.orchestra.run.smithi122.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:10 /home/ubuntu/cephtest 2024-09-13T18:10:39.714 INFO:teuthology.orchestra.run.smithi143.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:10 /home/ubuntu/cephtest 2024-09-13T18:10:39.724 INFO:teuthology.orchestra.run.smithi027.stdout: 393650 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:10 /home/ubuntu/cephtest 2024-09-13T18:10:39.727 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:10:39.739 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:10:39.763 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-workunit/fs/norstats}} duration: 1489.508751630783 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:10:39.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:10:39.859 INFO:teuthology.run:pass